-- Logs begin at Wed 2022-07-20 21:44:51 UTC, end at Wed 2022-07-20 23:07:10 UTC. -- Jul 20 22:26:07.832278 dv-cinder-799871-38-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 20 22:26:07.839631 dv-cinder-799871-38-smb devstack@keystone.service[80605]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 20 22:26:07.841628 dv-cinder-799871-38-smb devstack@keystone.service[80605]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 22:26:07 2022] *** Jul 20 22:26:07.841628 dv-cinder-799871-38-smb devstack@keystone.service[80605]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 22:26:07.841628 dv-cinder-799871-38-smb devstack@keystone.service[80605]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 22:26:07.841628 dv-cinder-799871-38-smb devstack@keystone.service[80605]: nodename: dv-cinder-799871-38-smb Jul 20 22:26:07.841628 dv-cinder-799871-38-smb devstack@keystone.service[80605]: machine: x86_64 Jul 20 22:26:07.841628 dv-cinder-799871-38-smb devstack@keystone.service[80605]: clock source: unix Jul 20 22:26:07.841628 dv-cinder-799871-38-smb devstack@keystone.service[80605]: pcre jit disabled Jul 20 22:26:07.841628 dv-cinder-799871-38-smb devstack@keystone.service[80605]: detected number of CPU cores: 4 Jul 20 22:26:07.841628 dv-cinder-799871-38-smb devstack@keystone.service[80605]: current working directory: / Jul 20 22:26:07.841628 dv-cinder-799871-38-smb devstack@keystone.service[80605]: detected binary path: /usr/bin/uwsgi-core Jul 20 22:26:07.841628 dv-cinder-799871-38-smb devstack@keystone.service[80605]: your processes number limit is 47680 Jul 20 22:26:07.845457 dv-cinder-799871-38-smb devstack@keystone.service[80605]: your memory page size is 4096 bytes Jul 20 22:26:07.845457 dv-cinder-799871-38-smb devstack@keystone.service[80605]: detected max file descriptor number: 2048 Jul 20 22:26:07.845457 dv-cinder-799871-38-smb devstack@keystone.service[80605]: lock engine: pthread robust mutexes Jul 20 22:26:07.845457 dv-cinder-799871-38-smb devstack@keystone.service[80605]: thunder lock: enabled Jul 20 22:26:07.845457 dv-cinder-799871-38-smb devstack@keystone.service[80605]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 20 22:26:07.845457 dv-cinder-799871-38-smb devstack@keystone.service[80605]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 22:26:07.893633 dv-cinder-799871-38-smb devstack@keystone.service[80605]: Python main interpreter initialized at 0x556a183599c0 Jul 20 22:26:07.893633 dv-cinder-799871-38-smb devstack@keystone.service[80605]: python threads support enabled Jul 20 22:26:07.893633 dv-cinder-799871-38-smb devstack@keystone.service[80605]: your server socket listen backlog is limited to 100 connections Jul 20 22:26:07.893633 dv-cinder-799871-38-smb devstack@keystone.service[80605]: your mercy for graceful operations on workers is 90 seconds Jul 20 22:26:07.894045 dv-cinder-799871-38-smb devstack@keystone.service[80605]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 22:26:07.894133 dv-cinder-799871-38-smb devstack@keystone.service[80605]: *** Operational MODE: preforking *** Jul 20 22:26:07.894376 dv-cinder-799871-38-smb devstack@keystone.service[80605]: *** uWSGI is running in multiple interpreter mode *** Jul 20 22:26:07.894376 dv-cinder-799871-38-smb devstack@keystone.service[80605]: spawned uWSGI master process (pid: 80605) Jul 20 22:26:07.894591 dv-cinder-799871-38-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 20 22:26:07.896609 dv-cinder-799871-38-smb devstack@keystone.service[80605]: spawned uWSGI worker 1 (pid: 80614, cores: 1) Jul 20 22:26:07.896609 dv-cinder-799871-38-smb devstack@keystone.service[80605]: spawned uWSGI worker 2 (pid: 80615, cores: 1) Jul 20 22:26:07.896609 dv-cinder-799871-38-smb devstack@keystone.service[80605]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 22:26:13.457124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 22:26:13.457124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: from cryptography.utils import int_from_bytes Jul 20 22:26:13.457992 dv-cinder-799871-38-smb devstack@keystone.service[80614]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 22:26:13.457992 dv-cinder-799871-38-smb devstack@keystone.service[80614]: from cryptography.utils import int_from_bytes Jul 20 22:26:13.478781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 22:26:13.478781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: from cryptography.utils import int_from_bytes Jul 20 22:26:13.479318 dv-cinder-799871-38-smb devstack@keystone.service[80615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 22:26:13.479318 dv-cinder-799871-38-smb devstack@keystone.service[80615]: from cryptography.utils import int_from_bytes Jul 20 22:26:13.511508 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 22:26:13.511723 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 22:26:13.511942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] command line args: [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 22:26:13.512232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 22:26:13.512431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ================================================================================ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 22:26:13.512703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] admin_token = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.512970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] config_dir = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.513176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.513382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] config_source = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.513581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] debug = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.513870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.515061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.515061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.515061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.515061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.515376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.515376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_config_append = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.515576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.515777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_dir = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.516002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_file = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.516258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.516528 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.516796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.517078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.517284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.517519 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.517874 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.518147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.518407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.518661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.518916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.519168 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.519427 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.519676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.519972 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.520455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.83/identity {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.520637 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] publish_errors = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.520866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.521099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.521377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.521561 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.521821 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.522058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] standard_threads = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.522290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.522534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.522716 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.522859 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_journal = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.523041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_json = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.523217 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_stderr = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.523393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] use_syslog = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.523623 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.523877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.524115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.524389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.524613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.524859 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.525097 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.525345 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.525580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.525855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.526105 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.526354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.526588 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.526834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.527068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.527467 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.527611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.527847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.528100 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.528353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.528596 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.528831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.529083 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.529882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.530143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.530400 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.530627 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.530857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.531087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.531321 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.531597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.531845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.532076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.532306 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.532551 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.532798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.533045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.533129 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 22:26:13.533265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 22:26:13.533348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.533485 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] command line args: [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 22:26:13.533573 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.533760 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.533843 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 22:26:13.540125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ================================================================================ {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 22:26:13.540237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.540237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.540400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] admin_token = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.540478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.540550 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] config_dir = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.540621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.540691 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.540691 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] config_source = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.540905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.540991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] debug = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.541074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.541147 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.541250 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.541324 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.541400 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.541471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.541542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.541618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.541706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.541856 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.541942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.542016 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] list_limit = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.542086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.542157 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] log_config_append = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.542235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.542313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.542390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.542390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.542530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] log_dir = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.542602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.542681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] log_file = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.542759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.542836 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.542912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.542989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.543061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.543142 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.543215 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.543286 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.543286 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.543419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.543498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.543576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.543649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.543720 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.543790 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.543861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.543943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.544089 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.544168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.544294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.544384 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.544504 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.544597 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.544671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.544737 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.544808 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.544879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.544998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.545602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.545699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.545699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.545913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.83/identity {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.545986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.546066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] publish_errors = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.546066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.546195 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.546261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.546326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.546404 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.546476 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.546547 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.546623 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.546695 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.546765 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.546843 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] standard_threads = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.546915 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.546990 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.547066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.547138 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.547208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.547288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.547288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] use_journal = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.547482 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.547597 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] use_json = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.547741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.547847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] use_stderr = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.547847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] use_syslog = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.548034 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.548130 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 22:26:13.548225 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.548321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.548430 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.548536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.548640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.548742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.548823 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.548823 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.549008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.549133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.549133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.549133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.549384 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.549500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.549575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.549646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.549832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.549950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.550047 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.550127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.550195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.550296 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.550417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.550496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.550611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.550687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.550801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.550877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.550961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.551035 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.551151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.551227 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.551301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.551374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.551501 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.551579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.551641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.551711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.551772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.551879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.external = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.552001 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.552079 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.552194 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.552271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.552344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.552465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.552556 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.552630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.password = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.552745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.552820 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] auth.token = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.552892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.553006 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.553091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.553166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.553281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.553357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.553438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.553512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.553634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.553770 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.553859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.553933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.554005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.554120 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.554276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.554352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.554423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.554494 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.554565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.554633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.554703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.554787 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.555201 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.555293 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.555366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.555439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.555517 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.555599 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.555679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.555759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.555833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.555952 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.556029 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.556029 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.556170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.556243 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.556316 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.556388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.556460 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.556540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.556614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.556686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.556758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.556830 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.556902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.556982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.557055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.557128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.557199 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.557272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.557272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.557419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.557499 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.557578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.557651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.557749 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.557826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.563141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.563240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.563322 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.563397 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.563470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.563470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.563616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.563695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.563768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.563768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.563898 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.563979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.564059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.564133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.564205 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.564282 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.564356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.564435 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.564515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.564595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.564679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.564755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.564827 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.564926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.565012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.565088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.565168 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.565243 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.565322 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.565322 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.565454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.565528 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.565528 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.565745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.565823 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.565897 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.565969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.566041 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.566130 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.566207 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.566283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.566360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.566433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.566512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.566588 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.566588 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.566719 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.566797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.566877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.566877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.566996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567129 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567337 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567412 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567484 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567771 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567833 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567899 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.567971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.568108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.568108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.568322 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.568322 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.568461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.568533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.568605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.568686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.568771 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.568853 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.568928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.569000 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.569072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.569152 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.569227 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.569299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.569377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.569458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.569533 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.569612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.569687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.569826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.569909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.569984 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.570051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.570131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.570206 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.570280 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.570352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.570425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.570497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.570577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.570651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.570724 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.570796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.570869 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.570941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.571027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.571101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.571173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.571235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] auth.external = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.571294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.571360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.571439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.571513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.571586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.571658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.571730 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.571802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] auth.password = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.571882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.571957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] auth.token = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.572024 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.572096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.572167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.572239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.572319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.572395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.572467 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.572539 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.572611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.572683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.572764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.572867 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.572979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.573095 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.573212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.573328 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] credential.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.573459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.573573 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.573694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.573843 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.573953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.574081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.574174 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.574317 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.574429 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.574560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.574676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.574791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.574924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.575057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.575171 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.575308 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.575418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.575542 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.575648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.575792 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.575895 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.576071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.576152 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.576432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.576676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.576798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.576914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.577075 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.577158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.577339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.577425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.577606 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.577687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.577886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.577994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.578128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.578210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.578374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.578453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.578622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.578701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.578857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.578944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.579088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.579168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.579321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.579400 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.579565 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.579646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.579798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.579877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.580031 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.580110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.580272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.580352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.580516 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.580596 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.580748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.580829 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.580985 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.581065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.581226 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.581305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.581460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.581541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.581693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.581836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.581962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.582042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.582188 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.582266 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.582426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.582507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.582660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] role.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.582777 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.582907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] role.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.583034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.583123 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.583269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.583372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.583499 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.583621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.583731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.583869 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.583975 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.584158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.584311 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.584427 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.584504 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.584646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.584728 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.584892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.584972 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.585141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.585229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.585374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.585454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.585621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.585700 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.585894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.585987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.586144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.586224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.586372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.586451 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.586608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.586806 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.586887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.587044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.587124 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.587294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.587374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.587529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.587609 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.587783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.587861 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.588027 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.588106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.588260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.588341 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.588503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.588582 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.588749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.588835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.588980 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.589057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.589203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.589283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.589432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.589510 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.589663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.589763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.589923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.590002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.590164 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.590244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.590402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.590490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.590645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.590727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.590879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.590959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.591113 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.591257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.591339 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.591414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.591568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.591648 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.592324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.592411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.592565 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.592988 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.593068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.593247 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.593336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.593486 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.593567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.593778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.593863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.593996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.604857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.604857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.605047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.605047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.605159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.605232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.605318 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.605395 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.605469 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.605542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.605614 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.605687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.605798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.605875 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.605944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.606016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.606089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.606089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.606224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.606298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.606371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.606452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.606534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.606609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.606682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.606763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.606838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.606933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.607011 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.607085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.607147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.607215 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.607284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.607356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.607446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.607548 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.608139 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.608266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.608340 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.608411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.608473 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.608550 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.608676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.608774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.608851 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.608925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.608999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609411 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609484 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 22:26:13.609978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.609978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.610511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.610511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.610511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.610511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.610511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.610511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.610511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.610511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.610511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] role.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] role.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.611578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.612122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.612122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.612122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.612122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.612122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.612122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.612491 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.612491 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.612630 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.612857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.613140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.613396 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.613643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.613904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.614139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.614368 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.614612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.614850 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.615097 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.615332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.615585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.615834 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.616070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.616313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.616552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.616796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.617030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.617268 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.617507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.617772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.618063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.618291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.618531 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.618825 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.619085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.connection = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.619330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.619576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.619812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.620051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.620283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.620517 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.620752 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.620992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.621235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.621469 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.621713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.621968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.622215 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.622450 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.622694 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.622923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.623313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.623875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 22:26:13.624089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 22:26:13.632640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.632869 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.633107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.641904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.650488 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.650719 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.650944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.660344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.671427 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.671654 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.679481 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.679710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.815227 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.818720 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.865578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.865880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.867188 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.867424 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.931369 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.931545 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.931637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.931717 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.931795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.931895 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.932005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.932093 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.932220 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.932305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.932435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.932521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.958406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.958566 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.958648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.958746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.958825 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.958956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.959042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.959170 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.959262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.959388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.959475 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.959602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.959687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.959815 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.971212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.971567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.985130 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.985398 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.985627 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.985877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.985965 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.986101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.986187 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.986319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.986418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.986537 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80614) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.986623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.986794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.987008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:13.987219 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80615) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 22:26:14.004890 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.005051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.005140 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 22:26:14.005266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 22:26:14.005451 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.005598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.005686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 22:26:14.005795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 22:26:14.005934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.006019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.006194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.006382 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.006471 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.006549 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.006692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.006776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.018172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.018279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.018445 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.018529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.018714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.018799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.018995 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.019082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.027120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.027215 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.030619 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.030900 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.030988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.031198 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.031283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.031562 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.031655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.031842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.031927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.032100 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.032185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.032364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.032456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.032629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.032714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.032896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.032979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.033157 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.033244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.033418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.033500 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.033679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.060671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.062290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.062477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.062633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.064089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.064366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.067928 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.068152 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.068480 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.069614 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.069916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.070192 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.075788 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.076075 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.077984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.078265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.080739 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.081029 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.081307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.081585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.081879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.082149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.082416 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.082683 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.082872 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.083154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.083433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.083711 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.083985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.084254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.084515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.084775 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.102159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.102432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.104772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.105047 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.107060 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.110645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.111240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.111535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.114267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.114557 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.116553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.119544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.120226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.123635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.124088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.124407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.124680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.124962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.125243 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.125520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.127464 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.127751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.128024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.128307 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.128584 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.128855 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.144777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.145151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.145420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.145683 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.148260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.148633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.148906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.149184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.153583 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.155839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.156113 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.158132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.159173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.159453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.159732 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.159818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.160011 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.160095 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.160342 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.163099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.163385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.163660 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.163937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.164212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.174422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.174697 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.174973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.175260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.175536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.175820 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.176100 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.178568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.178844 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.179118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.179393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.179693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.179968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.180236 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.195609 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.198917 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.200219 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.202391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.203993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.204105 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.205748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.206026 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.206324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.207488 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.209073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.210734 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.211012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.211286 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.213956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.215575 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.219416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.219512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.219799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.220080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.220353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.221043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.224350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.224636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.224912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.225184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.229931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.230219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.230498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.235368 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.235653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.235924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.238606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80614) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.238887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.239163 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.239437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.239705 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.239982 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.240254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.240525 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.240807 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.241074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.241338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.241593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.241883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.242147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80614) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.243752 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80615) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 22:26:14.244027 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.244301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.244571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.244838 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.245116 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.245387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.245655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.245951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.246216 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.246476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.246730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.246997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.247264 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80615) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 22:26:14.281294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556a183599c0 pid: 80614 (default app) Jul 20 22:26:14.284708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6b6b5-3816-400c-9b08-a1a561947a3d None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:14.285001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6b6b5-3816-400c-9b08-a1a561947a3d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:14.285281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6b6b5-3816-400c-9b08-a1a561947a3d None None] PATH_INFO: `/v3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:14.287514 dv-cinder-799871-38-smb devstack@keystone.service[80615]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556a183599c0 pid: 80615 (default app) Jul 20 22:26:14.289466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1/1] 10.222.0.83 () {50 vars in 791 bytes} [Wed Jul 20 22:26:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:23.762425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33649f7-cea0-4f3e-891c-e38ab264e3b6 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:23.763004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33649f7-cea0-4f3e-891c-e38ab264e3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:23.763004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33649f7-cea0-4f3e-891c-e38ab264e3b6 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:23.768149 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1/2] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:26:23.774234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf24d1-f494-41bd-bbbd-8d3235dcc7ef None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:23.774653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf24d1-f494-41bd-bbbd-8d3235dcc7ef None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:23.774791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bf24d1-f494-41bd-bbbd-8d3235dcc7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:23.847357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: INFO dbcounter [None req-c9bf24d1-f494-41bd-bbbd-8d3235dcc7ef None None] Registered counter for database keystone Jul 20 22:26:23.869875 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG oslo_db.sqlalchemy.engines [None req-c9bf24d1-f494-41bd-bbbd-8d3235dcc7ef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:26:23.877452 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writer thread running {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:26:24.071650 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG passlib.handlers.bcrypt [None req-c9bf24d1-f494-41bd-bbbd-8d3235dcc7ef None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80614) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 22:26:24.072012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG passlib.handlers.bcrypt [None req-c9bf24d1-f494-41bd-bbbd-8d3235dcc7ef None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80614) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 22:26:24.128424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c9bf24d1-f494-41bd-bbbd-8d3235dcc7ef None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:24.130126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c9bf24d1-f494-41bd-bbbd-8d3235dcc7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:24.256966 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 2/3] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 20 22:26:24.457888 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33649f7-cea0-4f3e-891c-e38ab264e3b6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:24.530324 dv-cinder-799871-38-smb devstack@keystone.service[80615]: INFO dbcounter [None req-d33649f7-cea0-4f3e-891c-e38ab264e3b6 None None] Registered counter for database keystone Jul 20 22:26:24.550398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG oslo_db.sqlalchemy.engines [None req-d33649f7-cea0-4f3e-891c-e38ab264e3b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 22:26:24.556610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writer thread running {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 22:26:24.680025 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33649f7-cea0-4f3e-891c-e38ab264e3b6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:24.684383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225dbaef-54e9-4010-a2d2-c453ecf4eba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:24.685068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dbaef-54e9-4010-a2d2-c453ecf4eba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:24.685386 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dbaef-54e9-4010-a2d2-c453ecf4eba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:24.685790 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dbaef-54e9-4010-a2d2-c453ecf4eba7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:24.694219 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dbaef-54e9-4010-a2d2-c453ecf4eba7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:24.746157 dv-cinder-799871-38-smb devstack@keystone.service[80615]: WARNING keystone.common.rbac_enforcer.enforcer [None req-225dbaef-54e9-4010-a2d2-c453ecf4eba7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 22:26:24.746435 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dbaef-54e9-4010-a2d2-c453ecf4eba7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:24.756746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 2/4] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Jul 20 22:26:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:26:24.762783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf24d1-f494-41bd-bbbd-8d3235dcc7ef None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:24.777685 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bf24d1-f494-41bd-bbbd-8d3235dcc7ef None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:24.783346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05468052-540c-494a-81dd-ac732fadb071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:24.784493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468052-540c-494a-81dd-ac732fadb071 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:24.784784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468052-540c-494a-81dd-ac732fadb071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:24.785061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05468052-540c-494a-81dd-ac732fadb071 admin admin] PATH_INFO: `/v3/projects/63d2e7ee31ba4d05b54d5a20dae7a17b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:24.789212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05468052-540c-494a-81dd-ac732fadb071 admin admin] RBAC: Authorizing `identity:get_project(project_id=63d2e7ee31ba4d05b54d5a20dae7a17b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:24.840640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: WARNING keystone.common.rbac_enforcer.enforcer [None req-05468052-540c-494a-81dd-ac732fadb071 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 22:26:24.840985 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05468052-540c-494a-81dd-ac732fadb071 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:24.846422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 3/5] 10.222.0.83 () {56 vars in 1207 bytes} [Wed Jul 20 22:26:24 2022] GET /identity/v3/projects/63d2e7ee31ba4d05b54d5a20dae7a17b => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:26.893987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa344-815e-4ab1-bb91-3805767d0489 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:26.894545 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa344-815e-4ab1-bb91-3805767d0489 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:26.894545 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa344-815e-4ab1-bb91-3805767d0489 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:26.898607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 3/6] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:26.904833 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a20e-e6a8-44ef-bbac-cac833fc1aca None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:26.904833 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a20e-e6a8-44ef-bbac-cac833fc1aca None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:26.905416 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a20e-e6a8-44ef-bbac-cac833fc1aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:26.925446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d078a20e-e6a8-44ef-bbac-cac833fc1aca None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:26.927203 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d078a20e-e6a8-44ef-bbac-cac833fc1aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:26.936004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 4/7] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 22:26:26.960085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa344-815e-4ab1-bb91-3805767d0489 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:26.972643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa344-815e-4ab1-bb91-3805767d0489 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:26.977078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae07400-8bba-4bb8-b84a-9db7cb08c20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:26.977749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07400-8bba-4bb8-b84a-9db7cb08c20d admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:26.978027 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07400-8bba-4bb8-b84a-9db7cb08c20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:26.978304 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae07400-8bba-4bb8-b84a-9db7cb08c20d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:26.986752 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae07400-8bba-4bb8-b84a-9db7cb08c20d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:26.988514 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae07400-8bba-4bb8-b84a-9db7cb08c20d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:26.997192 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 4/8] 10.222.0.83 () {58 vars in 1324 bytes} [Wed Jul 20 22:26:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 22:26:27.003967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078a20e-e6a8-44ef-bbac-cac833fc1aca None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:27.013227 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078a20e-e6a8-44ef-bbac-cac833fc1aca None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:27.018375 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c610b32-fb7d-4aa0-b011-4aeedf024f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:27.019250 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c610b32-fb7d-4aa0-b011-4aeedf024f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:27.019538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c610b32-fb7d-4aa0-b011-4aeedf024f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:27.019819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c610b32-fb7d-4aa0-b011-4aeedf024f63 admin admin] PATH_INFO: `/v3/users/641e54d5e34b4a43ad3182391125ef78` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:27.021255 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c610b32-fb7d-4aa0-b011-4aeedf024f63 admin admin] RBAC: Authorizing `identity:get_user(user_id=641e54d5e34b4a43ad3182391125ef78)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:27.023166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c610b32-fb7d-4aa0-b011-4aeedf024f63 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:27.024777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 5/9] 10.222.0.83 () {56 vars in 1198 bytes} [Wed Jul 20 22:26:27 2022] GET /identity/v3/users/641e54d5e34b4a43ad3182391125ef78 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:29.207198 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f304e32-1e2e-45d4-8cf4-8cf2ce90e039 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:29.207710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f304e32-1e2e-45d4-8cf4-8cf2ce90e039 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:29.207814 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f304e32-1e2e-45d4-8cf4-8cf2ce90e039 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:29.209099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 5/10] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:29.214372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dc02a-3f29-400a-aa9d-d0331adb4539 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:29.214771 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dc02a-3f29-400a-aa9d-d0331adb4539 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:29.215010 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dc02a-3f29-400a-aa9d-d0331adb4539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:29.230673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4304d-c9fd-4ba2-9621-53443c5f2239 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:29.230966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4304d-c9fd-4ba2-9621-53443c5f2239 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:29.231247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4304d-c9fd-4ba2-9621-53443c5f2239 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:29.233555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-859dc02a-3f29-400a-aa9d-d0331adb4539 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:29.234043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 6/11] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:29.234809 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-859dc02a-3f29-400a-aa9d-d0331adb4539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:29.240296 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6136a3-553b-4ecb-8ea6-d777eb28aebf None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:29.240582 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6136a3-553b-4ecb-8ea6-d777eb28aebf None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:29.240858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6136a3-553b-4ecb-8ea6-d777eb28aebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:29.282277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG passlib.handlers.bcrypt [None req-9c6136a3-553b-4ecb-8ea6-d777eb28aebf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80615) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 22:26:29.282687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG passlib.handlers.bcrypt [None req-9c6136a3-553b-4ecb-8ea6-d777eb28aebf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80615) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 22:26:29.316913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 6/12] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:29.329882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-9c6136a3-553b-4ecb-8ea6-d777eb28aebf None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:29.331564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9c6136a3-553b-4ecb-8ea6-d777eb28aebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:29.340311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dc02a-3f29-400a-aa9d-d0331adb4539 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:29.365414 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:29.436086 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 7/13] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:26:29.446714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dc02a-3f29-400a-aa9d-d0331adb4539 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:29.458181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6136a3-553b-4ecb-8ea6-d777eb28aebf None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:29.482269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ba02e-af70-4085-8061-6689eda689ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:29.483551 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ba02e-af70-4085-8061-6689eda689ab None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:29.483837 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ba02e-af70-4085-8061-6689eda689ab None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:29.484121 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ba02e-af70-4085-8061-6689eda689ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:29.495064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ba02e-af70-4085-8061-6689eda689ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d51ba02e-af70-4085-8061-6689eda689ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:29.506847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:29.508176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:29.509162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:29.509162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:29.509162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:29.509162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:29.509162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:29.509162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:29.509162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:29.509162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:29.509162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:29.509162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:29.509162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:26:29.509162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:26:29.509162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 7/14] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:26:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:26:29.515032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ba02e-af70-4085-8061-6689eda689ab None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:29.564546 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6136a3-553b-4ecb-8ea6-d777eb28aebf None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:29.567027 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:29.598175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:29.602743 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cd0a6-b3ae-415a-bd38-6a6835421637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:29.603654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cd0a6-b3ae-415a-bd38-6a6835421637 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:29.603942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cd0a6-b3ae-415a-bd38-6a6835421637 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:29.604218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8cd0a6-b3ae-415a-bd38-6a6835421637 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:29.615931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ba02e-af70-4085-8061-6689eda689ab None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:29.650755 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a83b2-7262-4db0-b4c2-47b9894b8b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:29.651433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a83b2-7262-4db0-b4c2-47b9894b8b23 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:29.651719 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a83b2-7262-4db0-b4c2-47b9894b8b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:29.652000 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a83b2-7262-4db0-b4c2-47b9894b8b23 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:29.652767 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a83b2-7262-4db0-b4c2-47b9894b8b23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:29.653123 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a83b2-7262-4db0-b4c2-47b9894b8b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:29.655139 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a83b2-7262-4db0-b4c2-47b9894b8b23 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:29.667298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 8/15] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:29.673393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a83b2-7262-4db0-b4c2-47b9894b8b23 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:29.675331 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cd0a6-b3ae-415a-bd38-6a6835421637 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:29.676903 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8cd0a6-b3ae-415a-bd38-6a6835421637 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:29.780324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a83b2-7262-4db0-b4c2-47b9894b8b23 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:29.784576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 8/16] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:26:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 22:26:29.790863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cd0a6-b3ae-415a-bd38-6a6835421637 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:29.793706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:29.816935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c141d-d001-4c25-a41c-147f42d11628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:29.817912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c141d-d001-4c25-a41c-147f42d11628 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:29.817912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c141d-d001-4c25-a41c-147f42d11628 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:29.817912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c141d-d001-4c25-a41c-147f42d11628 None admin] PATH_INFO: `/v3/users/641e54d5e34b4a43ad3182391125ef78` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:29.819825 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c141d-d001-4c25-a41c-147f42d11628 None admin] RBAC: Authorizing `identity:get_user(user_id=641e54d5e34b4a43ad3182391125ef78)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:29.821427 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c141d-d001-4c25-a41c-147f42d11628 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:29.823283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 9/17] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:29 2022] GET /identity/v3/users/641e54d5e34b4a43ad3182391125ef78 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:29.829279 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c141d-d001-4c25-a41c-147f42d11628 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:29.845282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:29.899831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8cd0a6-b3ae-415a-bd38-6a6835421637 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:29.934693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29e266-0c79-4285-9eab-da4ff27afbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:29.936058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29e266-0c79-4285-9eab-da4ff27afbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:29.937040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29e266-0c79-4285-9eab-da4ff27afbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:29.937404 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29e266-0c79-4285-9eab-da4ff27afbf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:29.949963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c141d-d001-4c25-a41c-147f42d11628 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:29.960344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29e266-0c79-4285-9eab-da4ff27afbf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:29.961864 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29e266-0c79-4285-9eab-da4ff27afbf6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-6d29e266-0c79-4285-9eab-da4ff27afbf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:26:29.983048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:29.983945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:29.984774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:26:29.984774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:26:29.984774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:26:29.984774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:26:29.984774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 9/18] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:26:29.986935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe01a5c-ddbb-4564-afed-30296ca0039d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:29.987753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe01a5c-ddbb-4564-afed-30296ca0039d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:29.988062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe01a5c-ddbb-4564-afed-30296ca0039d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:29.988386 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe01a5c-ddbb-4564-afed-30296ca0039d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:29.989677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe01a5c-ddbb-4564-afed-30296ca0039d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:29.989990 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29e266-0c79-4285-9eab-da4ff27afbf6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:29.991336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe01a5c-ddbb-4564-afed-30296ca0039d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:29.993087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 10/19] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:26:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:29.998666 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe01a5c-ddbb-4564-afed-30296ca0039d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:30.054074 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:30.083496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:30.101590 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29e266-0c79-4285-9eab-da4ff27afbf6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:30.102665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe01a5c-ddbb-4564-afed-30296ca0039d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:30.139076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce50841-9f19-4b73-a97e-70a7b9e5a9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:30.139767 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50841-9f19-4b73-a97e-70a7b9e5a9ae None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:30.140047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50841-9f19-4b73-a97e-70a7b9e5a9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:30.140358 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce50841-9f19-4b73-a97e-70a7b9e5a9ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:30.141675 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd629a6-33b9-41ab-b8f6-604bb3020bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:30.142220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce50841-9f19-4b73-a97e-70a7b9e5a9ae None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.domain.id=default, user.id=641e54d5e34b4a43ad3182391125ef78) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:30.142353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd629a6-33b9-41ab-b8f6-604bb3020bab None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:30.142538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce50841-9f19-4b73-a97e-70a7b9e5a9ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:30.142626 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd629a6-33b9-41ab-b8f6-604bb3020bab None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:30.142907 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd629a6-33b9-41ab-b8f6-604bb3020bab None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:30.143646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd629a6-33b9-41ab-b8f6-604bb3020bab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:30.143956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd629a6-33b9-41ab-b8f6-604bb3020bab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:30.144041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce50841-9f19-4b73-a97e-70a7b9e5a9ae None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:30.145340 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd629a6-33b9-41ab-b8f6-604bb3020bab None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:30.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 11/20] 10.222.0.83 () {56 vars in 1322 bytes} [Wed Jul 20 22:26:29 2022] GET /identity/v3/role_assignments?user.id=641e54d5e34b4a43ad3182391125ef78&scope.domain.id=default&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:30.164918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 10/21] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:32.702127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34434473-d41a-42f9-953e-ccf0c4915c57 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:32.703638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34434473-d41a-42f9-953e-ccf0c4915c57 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:32.704130 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34434473-d41a-42f9-953e-ccf0c4915c57 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:32.705873 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 12/22] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:32.711758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f831-30fb-4a9f-8461-323d4a12169d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:32.712234 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f831-30fb-4a9f-8461-323d4a12169d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:32.712529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f831-30fb-4a9f-8461-323d4a12169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:32.738873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-2343f831-30fb-4a9f-8461-323d4a12169d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:32.740160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2343f831-30fb-4a9f-8461-323d4a12169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:32.834627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 11/23] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:32.845535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607fdf9-52d4-4a5a-95f4-32e76251d836 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:32.846187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607fdf9-52d4-4a5a-95f4-32e76251d836 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:32.846686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c607fdf9-52d4-4a5a-95f4-32e76251d836 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:32.848629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 13/24] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:32.855244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67486287-269b-4e54-b123-cb9721c8a471 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:32.855863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67486287-269b-4e54-b123-cb9721c8a471 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:32.856352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67486287-269b-4e54-b123-cb9721c8a471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:32.874311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607fdf9-52d4-4a5a-95f4-32e76251d836 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:32.879863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-67486287-269b-4e54-b123-cb9721c8a471 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:32.886354 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-67486287-269b-4e54-b123-cb9721c8a471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:32.970203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:33.014488 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 12/25] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:33.022811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb50185-c6cd-4c56-9c41-7f7ece3023be None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:33.023099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb50185-c6cd-4c56-9c41-7f7ece3023be None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:33.023378 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb50185-c6cd-4c56-9c41-7f7ece3023be None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:33.024884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 13/26] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:26:33.035509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22d1cc-77a5-4685-941f-2a66487584ef None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:33.035804 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22d1cc-77a5-4685-941f-2a66487584ef None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:33.036065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22d1cc-77a5-4685-941f-2a66487584ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:33.064666 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c607fdf9-52d4-4a5a-95f4-32e76251d836 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:33.067013 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-5d22d1cc-77a5-4685-941f-2a66487584ef None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:33.068400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5d22d1cc-77a5-4685-941f-2a66487584ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:33.127357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb9ab3-9a22-4747-9304-7d9e26f2d9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:33.128156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb9ab3-9a22-4747-9304-7d9e26f2d9ab None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:33.128438 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb9ab3-9a22-4747-9304-7d9e26f2d9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:33.128710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb9ab3-9a22-4747-9304-7d9e26f2d9ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:33.154626 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb9ab3-9a22-4747-9304-7d9e26f2d9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:33.156268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeb9ab3-9a22-4747-9304-7d9e26f2d9ab None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:33.167091 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:33.183383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 14/27] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:26:33.188276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22d1cc-77a5-4685-941f-2a66487584ef None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-2eeb9ab3-9a22-4747-9304-7d9e26f2d9ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:26:33.205556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:33.206478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:33.207332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:26:33.207332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:26:33.207332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:26:33.207332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:26:33.207332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 14/28] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:26:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:26:33.213124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb9ab3-9a22-4747-9304-7d9e26f2d9ab None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:33.332217 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22d1cc-77a5-4685-941f-2a66487584ef None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:33.341317 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:33.373501 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faec66b-b5e3-44a4-a410-b65c4aedb503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:33.374614 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faec66b-b5e3-44a4-a410-b65c4aedb503 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:33.375601 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faec66b-b5e3-44a4-a410-b65c4aedb503 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:33.376211 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faec66b-b5e3-44a4-a410-b65c4aedb503 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:33.377200 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faec66b-b5e3-44a4-a410-b65c4aedb503 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:33.378907 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faec66b-b5e3-44a4-a410-b65c4aedb503 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:33.379299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb9ab3-9a22-4747-9304-7d9e26f2d9ab None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:33.416173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e1288-06df-4439-955e-9b21ccad714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:33.416857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e1288-06df-4439-955e-9b21ccad714b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:33.417145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e1288-06df-4439-955e-9b21ccad714b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:33.417423 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e1288-06df-4439-955e-9b21ccad714b None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:33.418203 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e1288-06df-4439-955e-9b21ccad714b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:33.418510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e1288-06df-4439-955e-9b21ccad714b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:33.419936 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e1288-06df-4439-955e-9b21ccad714b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:33.441600 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 15/29] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:26:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:33.442500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e1288-06df-4439-955e-9b21ccad714b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:33.508658 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:33.557675 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e1288-06df-4439-955e-9b21ccad714b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:33.597276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d5bd6-fb81-4089-a4ee-18fba524b38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:33.598420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d5bd6-fb81-4089-a4ee-18fba524b38c None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:33.603710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d5bd6-fb81-4089-a4ee-18fba524b38c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:33.603710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d5bd6-fb81-4089-a4ee-18fba524b38c None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:33.603710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d5bd6-fb81-4089-a4ee-18fba524b38c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:33.603710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d5bd6-fb81-4089-a4ee-18fba524b38c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:33.649332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 15/30] 10.222.0.83 () {60 vars in 1131 bytes} [Wed Jul 20 22:26:33 2022] POST /identity/v3/roles => generated 225 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:26:33.657284 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad692-e037-411a-9c69-3bedf36f9462 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:33.657284 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad692-e037-411a-9c69-3bedf36f9462 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:33.657284 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ad692-e037-411a-9c69-3bedf36f9462 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:33.657284 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 16/31] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:33.657284 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ad692-e037-411a-9c69-3bedf36f9462 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:33.833632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ad692-e037-411a-9c69-3bedf36f9462 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:33.884617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df1247-5177-448f-ae03-02f516482956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:33.885409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df1247-5177-448f-ae03-02f516482956 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:33.885708 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df1247-5177-448f-ae03-02f516482956 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:33.886017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df1247-5177-448f-ae03-02f516482956 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:33.887085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df1247-5177-448f-ae03-02f516482956 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:33.889007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df1247-5177-448f-ae03-02f516482956 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:33.906528 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 16/32] 10.222.0.83 () {60 vars in 1131 bytes} [Wed Jul 20 22:26:33 2022] POST /identity/v3/roles => generated 219 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:26:33.908910 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1c5f9-f67d-4c49-a787-91f50244ce9a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:33.909435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1c5f9-f67d-4c49-a787-91f50244ce9a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:33.909979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1c5f9-f67d-4c49-a787-91f50244ce9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:33.937348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9ea1c5f9-f67d-4c49-a787-91f50244ce9a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:33.938964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9ea1c5f9-f67d-4c49-a787-91f50244ce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:34.022861 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 17/33] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 20 22:26:33 2022] POST /identity/v3/projects => generated 301 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:26:34.024863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff02a5-aae9-4bfd-8f53-acab90aa3d52 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:34.025413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff02a5-aae9-4bfd-8f53-acab90aa3d52 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:34.025946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff02a5-aae9-4bfd-8f53-acab90aa3d52 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:34.032971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 17/35] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:34.035256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 18/35] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:34.036197 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1533c2-dd30-4d34-b471-9a531da8da6d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:34.036518 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1533c2-dd30-4d34-b471-9a531da8da6d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:34.036803 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1533c2-dd30-4d34-b471-9a531da8da6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:34.062278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6a1533c2-dd30-4d34-b471-9a531da8da6d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:34.063591 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6a1533c2-dd30-4d34-b471-9a531da8da6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:34.077400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff02a5-aae9-4bfd-8f53-acab90aa3d52 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:34.131730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:34.173255 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:34.220191 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 18/36] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:34.247774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1533c2-dd30-4d34-b471-9a531da8da6d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:34.258417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff02a5-aae9-4bfd-8f53-acab90aa3d52 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:34.302959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8696109-1f73-4a3d-8d44-f9deffa4c017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:34.303787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8696109-1f73-4a3d-8d44-f9deffa4c017 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:34.304075 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8696109-1f73-4a3d-8d44-f9deffa4c017 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:34.304355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8696109-1f73-4a3d-8d44-f9deffa4c017 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:34.326661 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8696109-1f73-4a3d-8d44-f9deffa4c017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-a8696109-1f73-4a3d-8d44-f9deffa4c017 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:34.336812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:34.337884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:34.339623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:34.339623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:34.339623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:34.339623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:34.339623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:34.339623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:34.339623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:34.339623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:34.339623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:34.339623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:34.339623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:26:34.339623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:26:34.339623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 19/37] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:26:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:26:34.344425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8696109-1f73-4a3d-8d44-f9deffa4c017 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:34.391422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1533c2-dd30-4d34-b471-9a531da8da6d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:34.427373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9396a551-3e9c-4ea2-94d7-8d55ac635826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:34.427972 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396a551-3e9c-4ea2-94d7-8d55ac635826 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:34.428262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396a551-3e9c-4ea2-94d7-8d55ac635826 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:34.428541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9396a551-3e9c-4ea2-94d7-8d55ac635826 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:34.429297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396a551-3e9c-4ea2-94d7-8d55ac635826 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:34.430850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9396a551-3e9c-4ea2-94d7-8d55ac635826 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:34.432686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:34.455926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8696109-1f73-4a3d-8d44-f9deffa4c017 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:34.490132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42930857-e4f2-426d-902e-8b367de73df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:34.490807 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42930857-e4f2-426d-902e-8b367de73df1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:34.491093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42930857-e4f2-426d-902e-8b367de73df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:34.491370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42930857-e4f2-426d-902e-8b367de73df1 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:34.492129 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42930857-e4f2-426d-902e-8b367de73df1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:34.492440 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42930857-e4f2-426d-902e-8b367de73df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:34.493866 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42930857-e4f2-426d-902e-8b367de73df1 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:34.506592 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 19/38] 10.222.0.83 () {60 vars in 1131 bytes} [Wed Jul 20 22:26:34 2022] POST /identity/v3/roles => generated 223 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:26:34.512989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 20/39] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:34.513189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e06f3-4f99-400e-8e4d-f04ab347cd8c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:34.513189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e06f3-4f99-400e-8e4d-f04ab347cd8c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:34.513189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e06f3-4f99-400e-8e4d-f04ab347cd8c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:34.513189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 20/40] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:34.514484 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42930857-e4f2-426d-902e-8b367de73df1 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:34.516297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca06a9c-32ac-402c-84a0-269793fa5292 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:34.516603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca06a9c-32ac-402c-84a0-269793fa5292 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:34.516945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca06a9c-32ac-402c-84a0-269793fa5292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:34.544838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6ca06a9c-32ac-402c-84a0-269793fa5292 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:34.546130 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6ca06a9c-32ac-402c-84a0-269793fa5292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:34.592208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:34.642497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42930857-e4f2-426d-902e-8b367de73df1 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:34.686467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df615745-6685-4a74-92cd-4bc3850d02c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:34.687829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df615745-6685-4a74-92cd-4bc3850d02c6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:34.688112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df615745-6685-4a74-92cd-4bc3850d02c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:34.688399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df615745-6685-4a74-92cd-4bc3850d02c6 None admin] PATH_INFO: `/v3/users/641e54d5e34b4a43ad3182391125ef78` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:34.690221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df615745-6685-4a74-92cd-4bc3850d02c6 None admin] RBAC: Authorizing `identity:get_user(user_id=641e54d5e34b4a43ad3182391125ef78)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:34.691775 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df615745-6685-4a74-92cd-4bc3850d02c6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:34.693599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 21/41] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:34 2022] GET /identity/v3/users/641e54d5e34b4a43ad3182391125ef78 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:34.702934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df615745-6685-4a74-92cd-4bc3850d02c6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:34.713934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:34.750664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 21/42] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:26:34.775136 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca06a9c-32ac-402c-84a0-269793fa5292 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:34.816916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df615745-6685-4a74-92cd-4bc3850d02c6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:34.851572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c09ee-8211-42b1-a4c0-1f292c1072ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:34.852657 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c09ee-8211-42b1-a4c0-1f292c1072ca None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:34.852952 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c09ee-8211-42b1-a4c0-1f292c1072ca None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:34.853232 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1c09ee-8211-42b1-a4c0-1f292c1072ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:34.854469 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c09ee-8211-42b1-a4c0-1f292c1072ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:34.856084 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1c09ee-8211-42b1-a4c0-1f292c1072ca None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:34.858363 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 22/43] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:26:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:34.865222 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c09ee-8211-42b1-a4c0-1f292c1072ca None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:34.880935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca06a9c-32ac-402c-84a0-269793fa5292 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:34.916124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ee5ff-ec90-4f15-92e4-be649f96df58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:34.916931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ee5ff-ec90-4f15-92e4-be649f96df58 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:34.917221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ee5ff-ec90-4f15-92e4-be649f96df58 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:34.917495 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ee5ff-ec90-4f15-92e4-be649f96df58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:34.918717 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ee5ff-ec90-4f15-92e4-be649f96df58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:34.920172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ee5ff-ec90-4f15-92e4-be649f96df58 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:34.922843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 22/44] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:26:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:34.928453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ee5ff-ec90-4f15-92e4-be649f96df58 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:34.950232 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:34.967838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:34.973905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1c09ee-8211-42b1-a4c0-1f292c1072ca None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:35.009675 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d8fce-d75a-4667-8ed4-905e7451a308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:35.010585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d8fce-d75a-4667-8ed4-905e7451a308 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:35.010873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d8fce-d75a-4667-8ed4-905e7451a308 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:35.011158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d8fce-d75a-4667-8ed4-905e7451a308 None admin] PATH_INFO: `/v3/domains/default/users/641e54d5e34b4a43ad3182391125ef78/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:35.013205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d8fce-d75a-4667-8ed4-905e7451a308 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=641e54d5e34b4a43ad3182391125ef78, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:35.014752 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d8fce-d75a-4667-8ed4-905e7451a308 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:35.036070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ee5ff-ec90-4f15-92e4-be649f96df58 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:35.070269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d4c06-232d-41f2-90bb-93d74ce6389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:35.070953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d4c06-232d-41f2-90bb-93d74ce6389d None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:35.071241 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d4c06-232d-41f2-90bb-93d74ce6389d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:35.071522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d4c06-232d-41f2-90bb-93d74ce6389d None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:35.072284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d4c06-232d-41f2-90bb-93d74ce6389d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:35.073747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d4c06-232d-41f2-90bb-93d74ce6389d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:35.099920 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 23/45] 10.222.0.83 () {58 vars in 1361 bytes} [Wed Jul 20 22:26:34 2022] PUT /identity/v3/domains/default/users/641e54d5e34b4a43ad3182391125ef78/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:26:35.165741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 23/46] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 20 22:26:34 2022] POST /identity/v3/projects => generated 312 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:26:37.129331 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a5333-452b-4a8d-9d66-54aec18fd8e7 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:37.129881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a5333-452b-4a8d-9d66-54aec18fd8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:37.129964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a5333-452b-4a8d-9d66-54aec18fd8e7 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:37.131310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 24/47] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:37.136576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5f8dd-e053-42fe-933e-f344ae730d74 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:37.136979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5f8dd-e053-42fe-933e-f344ae730d74 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:37.137139 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5f8dd-e053-42fe-933e-f344ae730d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:37.154446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7ea5f8dd-e053-42fe-933e-f344ae730d74 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:37.155620 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7ea5f8dd-e053-42fe-933e-f344ae730d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:37.233318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 24/48] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:37.257015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a5333-452b-4a8d-9d66-54aec18fd8e7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:37.258156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82562d1f-ff07-4098-a581-99ae38fc59fc None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:37.258456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82562d1f-ff07-4098-a581-99ae38fc59fc None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:37.258740 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82562d1f-ff07-4098-a581-99ae38fc59fc None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:37.260135 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 25/49] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:26:37.265142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e79e-6f72-425c-92e6-d3374e0d3e35 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:37.266249 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e79e-6f72-425c-92e6-d3374e0d3e35 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:37.266539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6e79e-6f72-425c-92e6-d3374e0d3e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:37.283186 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-50c6e79e-6f72-425c-92e6-d3374e0d3e35 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:37.284403 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-50c6e79e-6f72-425c-92e6-d3374e0d3e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:37.295105 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:37.352453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 26/50] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:26:37.360425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a5333-452b-4a8d-9d66-54aec18fd8e7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:37.376278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6e79e-6f72-425c-92e6-d3374e0d3e35 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:37.395152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd25250-374b-4ed3-8f30-6f80b398ff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:37.395949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd25250-374b-4ed3-8f30-6f80b398ff73 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:37.396234 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd25250-374b-4ed3-8f30-6f80b398ff73 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:37.396510 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd25250-374b-4ed3-8f30-6f80b398ff73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:37.399280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:37.407487 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd25250-374b-4ed3-8f30-6f80b398ff73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-5fd25250-374b-4ed3-8f30-6f80b398ff73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:37.415059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:37.416012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:37.416799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:37.416799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:37.416799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:37.416799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:37.416799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:37.416799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:37.416799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:37.416799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:37.416799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:37.416799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:37.416799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:26:37.416799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:26:37.416799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 25/51] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:26:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:26:37.422165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd25250-374b-4ed3-8f30-6f80b398ff73 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:37.477619 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6e79e-6f72-425c-92e6-d3374e0d3e35 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:37.512505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaed18-7a3f-4f58-bfb5-91becebb579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:37.513304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaed18-7a3f-4f58-bfb5-91becebb579f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:37.513592 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaed18-7a3f-4f58-bfb5-91becebb579f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:37.513902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeaed18-7a3f-4f58-bfb5-91becebb579f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:37.515841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeaed18-7a3f-4f58-bfb5-91becebb579f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:37.517320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeaed18-7a3f-4f58-bfb5-91becebb579f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:37.518987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 27/52] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:26:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:37.524505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaed18-7a3f-4f58-bfb5-91becebb579f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:37.524959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd25250-374b-4ed3-8f30-6f80b398ff73 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:37.540259 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:37.558612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24033d79-de14-4f37-b3af-0512debff517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:37.559293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24033d79-de14-4f37-b3af-0512debff517 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:37.559576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24033d79-de14-4f37-b3af-0512debff517 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:37.559856 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24033d79-de14-4f37-b3af-0512debff517 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:37.560613 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24033d79-de14-4f37-b3af-0512debff517 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:37.560926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24033d79-de14-4f37-b3af-0512debff517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:37.562896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24033d79-de14-4f37-b3af-0512debff517 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:37.571293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 26/53] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:37.576960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24033d79-de14-4f37-b3af-0512debff517 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:37.627891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeaed18-7a3f-4f58-bfb5-91becebb579f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:37.637733 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:37.664170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400213b-89b2-4879-b684-af4124982086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:37.664871 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400213b-89b2-4879-b684-af4124982086 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:37.665159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400213b-89b2-4879-b684-af4124982086 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:37.665445 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400213b-89b2-4879-b684-af4124982086 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:37.666230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400213b-89b2-4879-b684-af4124982086 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:37.667732 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400213b-89b2-4879-b684-af4124982086 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:37.752844 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 28/54] 10.222.0.83 () {60 vars in 1140 bytes} [Wed Jul 20 22:26:37 2022] POST /identity/v3/projects => generated 298 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:26:37.788057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24033d79-de14-4f37-b3af-0512debff517 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:37.827502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f9b94-8c3e-4973-a3cf-70706b7b2a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:37.828730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f9b94-8c3e-4973-a3cf-70706b7b2a81 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:37.829113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f9b94-8c3e-4973-a3cf-70706b7b2a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:37.829401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0f9b94-8c3e-4973-a3cf-70706b7b2a81 None admin] PATH_INFO: `/v3/users/641e54d5e34b4a43ad3182391125ef78` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:37.830753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f9b94-8c3e-4973-a3cf-70706b7b2a81 None admin] RBAC: Authorizing `identity:get_user(user_id=641e54d5e34b4a43ad3182391125ef78)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:37.832258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0f9b94-8c3e-4973-a3cf-70706b7b2a81 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:37.834114 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 27/55] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:37 2022] GET /identity/v3/users/641e54d5e34b4a43ad3182391125ef78 => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:37.839843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400213b-89b2-4879-b684-af4124982086 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:37.908402 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:37.943587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400213b-89b2-4879-b684-af4124982086 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:37.977542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223b9ca-1ae0-45be-8b79-efb6bc9f9d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:37.978369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223b9ca-1ae0-45be-8b79-efb6bc9f9d6a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:37.978652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223b9ca-1ae0-45be-8b79-efb6bc9f9d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:37.978926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223b9ca-1ae0-45be-8b79-efb6bc9f9d6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:37.980091 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223b9ca-1ae0-45be-8b79-efb6bc9f9d6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:37.981529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223b9ca-1ae0-45be-8b79-efb6bc9f9d6a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:37.983184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 29/56] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:26:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:37.989703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f9b94-8c3e-4973-a3cf-70706b7b2a81 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:38.094604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0f9b94-8c3e-4973-a3cf-70706b7b2a81 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:38.120097 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:38.128214 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b6455-2099-4058-92f1-c32b3aec97b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:38.128890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b6455-2099-4058-92f1-c32b3aec97b2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:38.129171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b6455-2099-4058-92f1-c32b3aec97b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:38.129450 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b6455-2099-4058-92f1-c32b3aec97b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:38.130339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b6455-2099-4058-92f1-c32b3aec97b2 None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.domain.id=default, user.id=641e54d5e34b4a43ad3182391125ef78) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:38.135145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b6455-2099-4058-92f1-c32b3aec97b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:38.135145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b6455-2099-4058-92f1-c32b3aec97b2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:38.141162 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 28/57] 10.222.0.83 () {56 vars in 1322 bytes} [Wed Jul 20 22:26:37 2022] GET /identity/v3/role_assignments?user.id=641e54d5e34b4a43ad3182391125ef78&scope.domain.id=default&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:39.844353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f5040-74b7-436e-8ed9-b1ba956c0950 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:39.844881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f5040-74b7-436e-8ed9-b1ba956c0950 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:39.844997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f5040-74b7-436e-8ed9-b1ba956c0950 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:39.846335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 30/58] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:39.851692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfcff3-2622-4da3-9c91-a99bc74d344f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:39.852371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfcff3-2622-4da3-9c91-a99bc74d344f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:39.852513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfcff3-2622-4da3-9c91-a99bc74d344f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:39.869902 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c3bfcff3-2622-4da3-9c91-a99bc74d344f None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:39.871451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c3bfcff3-2622-4da3-9c91-a99bc74d344f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:39.940949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 29/59] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:39.967594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f5040-74b7-436e-8ed9-b1ba956c0950 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:40.101352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4f5040-74b7-436e-8ed9-b1ba956c0950 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:40.141147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cd1688-3172-4eac-98ef-bf1d4a617389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:40.142001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd1688-3172-4eac-98ef-bf1d4a617389 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:40.142290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd1688-3172-4eac-98ef-bf1d4a617389 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:40.142568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cd1688-3172-4eac-98ef-bf1d4a617389 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:40.143751 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd1688-3172-4eac-98ef-bf1d4a617389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:40.145203 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cd1688-3172-4eac-98ef-bf1d4a617389 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:40.146874 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 31/60] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:26:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:40.152704 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfcff3-2622-4da3-9c91-a99bc74d344f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:40.253967 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfcff3-2622-4da3-9c91-a99bc74d344f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:40.273746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:40.287840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd67a42d-e64a-4ed5-ba44-083c0b5abec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:40.288560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67a42d-e64a-4ed5-ba44-083c0b5abec2 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:40.288850 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67a42d-e64a-4ed5-ba44-083c0b5abec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:40.289133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd67a42d-e64a-4ed5-ba44-083c0b5abec2 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:40.289901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67a42d-e64a-4ed5-ba44-083c0b5abec2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:40.291383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd67a42d-e64a-4ed5-ba44-083c0b5abec2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:40.373815 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 30/61] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:26:40 2022] POST /identity/v3/users => generated 275 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:26:43.428949 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658d0b5-1014-4573-b085-aa0c8759c670 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:43.429816 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658d0b5-1014-4573-b085-aa0c8759c670 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:43.430244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658d0b5-1014-4573-b085-aa0c8759c670 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:43.431780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 32/62] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:43.437227 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450b02d-e85b-47d1-8b14-ba36b0963701 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:43.438159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450b02d-e85b-47d1-8b14-ba36b0963701 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:43.438601 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7450b02d-e85b-47d1-8b14-ba36b0963701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:43.462698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7450b02d-e85b-47d1-8b14-ba36b0963701 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:43.464134 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7450b02d-e85b-47d1-8b14-ba36b0963701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:43.505985 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b9eb7-06f4-4b00-b682-8e270654ae65 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:43.506628 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b9eb7-06f4-4b00-b682-8e270654ae65 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:43.507132 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17b9eb7-06f4-4b00-b682-8e270654ae65 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:43.508832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 33/63] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:43.520790 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f301776-38f1-4105-9d9e-6be89fb56980 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:43.521343 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f301776-38f1-4105-9d9e-6be89fb56980 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:43.521860 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f301776-38f1-4105-9d9e-6be89fb56980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:43.535658 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:43.549659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 31/64] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:43.554745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8f301776-38f1-4105-9d9e-6be89fb56980 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:43.561998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8f301776-38f1-4105-9d9e-6be89fb56980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:43.573115 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450b02d-e85b-47d1-8b14-ba36b0963701 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:43.720280 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 34/65] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:43.728930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7450b02d-e85b-47d1-8b14-ba36b0963701 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:43.750101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:43.756227 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f301776-38f1-4105-9d9e-6be89fb56980 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:43.784162 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66400d-7ca0-4775-8dfc-db2a1de0fd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:43.785518 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66400d-7ca0-4775-8dfc-db2a1de0fd21 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:43.785976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66400d-7ca0-4775-8dfc-db2a1de0fd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:43.786395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66400d-7ca0-4775-8dfc-db2a1de0fd21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:43.797562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66400d-7ca0-4775-8dfc-db2a1de0fd21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-4e66400d-7ca0-4775-8dfc-db2a1de0fd21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:43.805669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:43.806789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:43.807717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:43.807717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:43.807717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:43.807717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:43.807717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:43.807717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:43.807717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:43.807717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:43.807717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:43.807717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:43.807717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:26:43.807717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:26:43.809623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 32/66] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:26:43.811034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b229d4-e6a7-4680-b345-75d77b438a0f None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:43.811469 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b229d4-e6a7-4680-b345-75d77b438a0f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:43.812013 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b229d4-e6a7-4680-b345-75d77b438a0f None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:43.813556 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 33/67] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:43.819550 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b229d4-e6a7-4680-b345-75d77b438a0f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:43.878238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f301776-38f1-4105-9d9e-6be89fb56980 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:43.915636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:43.922319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac3c54-4637-4249-90ec-80dad06a0bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:43.923574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac3c54-4637-4249-90ec-80dad06a0bbc None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:43.924062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac3c54-4637-4249-90ec-80dad06a0bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:43.924502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac3c54-4637-4249-90ec-80dad06a0bbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:43.936622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac3c54-4637-4249-90ec-80dad06a0bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-eeac3c54-4637-4249-90ec-80dad06a0bbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:43.945791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:43.946709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:43.947498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:43.947498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:43.947498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:43.947498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:43.947498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:43.947498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:43.947498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:43.947498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:43.947498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:43.947498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:43.947498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:26:43.947498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:26:43.955957 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 35/68] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:26:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:26:43.956322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b229d4-e6a7-4680-b345-75d77b438a0f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:43.959587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4ff39-0663-4d9c-a456-a8b141783ab6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:43.960107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4ff39-0663-4d9c-a456-a8b141783ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:43.960578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4ff39-0663-4d9c-a456-a8b141783ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:43.979897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a2d4ff39-0663-4d9c-a456-a8b141783ab6 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:43.981465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a2d4ff39-0663-4d9c-a456-a8b141783ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:43.998564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3b59e-0af0-43a4-839d-cf204b01f39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:44.000204 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3b59e-0af0-43a4-839d-cf204b01f39e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:44.001183 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3b59e-0af0-43a4-839d-cf204b01f39e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:44.001654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb3b59e-0af0-43a4-839d-cf204b01f39e None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:44.002636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3b59e-0af0-43a4-839d-cf204b01f39e None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:44.003160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3b59e-0af0-43a4-839d-cf204b01f39e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:44.004743 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb3b59e-0af0-43a4-839d-cf204b01f39e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:44.014235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 34/69] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:26:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:44.016589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3b59e-0af0-43a4-839d-cf204b01f39e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:44.049205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:44.090660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 36/70] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:44.090660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4ff39-0663-4d9c-a456-a8b141783ab6 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:44.156901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb3b59e-0af0-43a4-839d-cf204b01f39e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:44.204788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e50f7-b861-49c8-9e02-08b7a0c99856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:44.205927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e50f7-b861-49c8-9e02-08b7a0c99856 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:44.206654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e50f7-b861-49c8-9e02-08b7a0c99856 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:44.207095 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e50f7-b861-49c8-9e02-08b7a0c99856 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:44.208248 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e50f7-b861-49c8-9e02-08b7a0c99856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:44.208700 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e50f7-b861-49c8-9e02-08b7a0c99856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:44.209548 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4ff39-0663-4d9c-a456-a8b141783ab6 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:44.210285 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e50f7-b861-49c8-9e02-08b7a0c99856 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:44.226670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 35/71] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:44.228224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e50f7-b861-49c8-9e02-08b7a0c99856 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:44.239810 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:44.253858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdcbdd-30c6-4ca7-b96f-36fbd6964e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:44.254953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdcbdd-30c6-4ca7-b96f-36fbd6964e95 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:44.255282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdcbdd-30c6-4ca7-b96f-36fbd6964e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:44.255537 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdcbdd-30c6-4ca7-b96f-36fbd6964e95 None admin] PATH_INFO: `/v3/users/35d4d449311544628df57904899e79de` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:44.271553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdcbdd-30c6-4ca7-b96f-36fbd6964e95 None admin] RBAC: Authorizing `identity:get_user(user_id=35d4d449311544628df57904899e79de)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:44.273193 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdcbdd-30c6-4ca7-b96f-36fbd6964e95 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:44.274970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 37/72] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:44 2022] GET /identity/v3/users/35d4d449311544628df57904899e79de => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:44.275736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdcbdd-30c6-4ca7-b96f-36fbd6964e95 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:44.330682 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:44.339984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e50f7-b861-49c8-9e02-08b7a0c99856 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:44.374775 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a285919-ba6a-4ab2-80a1-2f5b52acf085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:44.376152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a285919-ba6a-4ab2-80a1-2f5b52acf085 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:44.376255 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdcbdd-30c6-4ca7-b96f-36fbd6964e95 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:44.376438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a285919-ba6a-4ab2-80a1-2f5b52acf085 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:44.376714 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a285919-ba6a-4ab2-80a1-2f5b52acf085 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:44.386693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a285919-ba6a-4ab2-80a1-2f5b52acf085 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-5a285919-ba6a-4ab2-80a1-2f5b52acf085 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:44.395783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:44.396627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:44.397403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:44.397403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:44.397403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:44.397403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:44.397403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:44.397403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:44.397403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:44.397403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:44.397403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:44.397403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:44.397403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:26:44.397403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:26:44.397403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 36/73] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:26:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:26:44.403776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35048f4-ca9e-41d2-863d-974162ab8a71 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:44.403776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35048f4-ca9e-41d2-863d-974162ab8a71 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:44.403776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35048f4-ca9e-41d2-863d-974162ab8a71 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:44.403776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 37/74] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:44.403776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35048f4-ca9e-41d2-863d-974162ab8a71 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:44.414540 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e9a7f-b13b-44df-bdce-b0ffae384be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:44.415432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e9a7f-b13b-44df-bdce-b0ffae384be3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:44.415714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e9a7f-b13b-44df-bdce-b0ffae384be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:44.415989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e9a7f-b13b-44df-bdce-b0ffae384be3 None admin] PATH_INFO: `/v3/users/641e54d5e34b4a43ad3182391125ef78` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:44.417192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e9a7f-b13b-44df-bdce-b0ffae384be3 None admin] RBAC: Authorizing `identity:get_user(user_id=641e54d5e34b4a43ad3182391125ef78)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:44.418660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e9a7f-b13b-44df-bdce-b0ffae384be3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:44.420285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 38/75] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:44 2022] GET /identity/v3/users/641e54d5e34b4a43ad3182391125ef78 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:44.422594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8dc5e-eee3-45c8-bdb5-628c9ba63927 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:44.422888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8dc5e-eee3-45c8-bdb5-628c9ba63927 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:44.423168 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d8dc5e-eee3-45c8-bdb5-628c9ba63927 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:44.424413 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 39/76] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:44.425340 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8dc5e-eee3-45c8-bdb5-628c9ba63927 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:44.487278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:44.521426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35048f4-ca9e-41d2-863d-974162ab8a71 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:44.539407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d8dc5e-eee3-45c8-bdb5-628c9ba63927 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:44.555131 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bde8042-90c7-4d42-a6b8-5235396f0698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:44.555789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8042-90c7-4d42-a6b8-5235396f0698 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:44.556074 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8042-90c7-4d42-a6b8-5235396f0698 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:44.556357 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bde8042-90c7-4d42-a6b8-5235396f0698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:44.574063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a2078-f07d-4946-9182-caba6c328112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:44.574742 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a2078-f07d-4946-9182-caba6c328112 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:44.575030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a2078-f07d-4946-9182-caba6c328112 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:44.575311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a2078-f07d-4946-9182-caba6c328112 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:44.575635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:44.576077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a2078-f07d-4946-9182-caba6c328112 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:44.576419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a2078-f07d-4946-9182-caba6c328112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:44.577983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a2078-f07d-4946-9182-caba6c328112 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:44.586254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 40/77] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:26:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:44.587639 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80dda2-422e-4704-91fd-7d067bf0aba1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:44.587945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80dda2-422e-4704-91fd-7d067bf0aba1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:44.588229 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80dda2-422e-4704-91fd-7d067bf0aba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:44.604316 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2f80dda2-422e-4704-91fd-7d067bf0aba1 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:44.605595 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2f80dda2-422e-4704-91fd-7d067bf0aba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:44.627085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8042-90c7-4d42-a6b8-5235396f0698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:44.628980 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bde8042-90c7-4d42-a6b8-5235396f0698 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:44.673695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 41/78] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:44.674729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80dda2-422e-4704-91fd-7d067bf0aba1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:44.716794 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:44.741843 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 38/79] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:26:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:26:44.743341 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e217b-7d1f-4ca2-97b4-ea3763a334c9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:44.743779 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e217b-7d1f-4ca2-97b4-ea3763a334c9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:44.744205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e217b-7d1f-4ca2-97b4-ea3763a334c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:44.761136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-355e217b-7d1f-4ca2-97b4-ea3763a334c9 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:44.762388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-355e217b-7d1f-4ca2-97b4-ea3763a334c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:44.776708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80dda2-422e-4704-91fd-7d067bf0aba1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:44.811102 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:44.811535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288da2e5-12b5-4f92-890d-3daef2bd2dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:44.812444 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288da2e5-12b5-4f92-890d-3daef2bd2dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:44.812561 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288da2e5-12b5-4f92-890d-3daef2bd2dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:44.812836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288da2e5-12b5-4f92-890d-3daef2bd2dc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:44.845901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 39/80] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:44.847018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e217b-7d1f-4ca2-97b4-ea3763a334c9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:44.881688 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288da2e5-12b5-4f92-890d-3daef2bd2dc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:44.883196 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288da2e5-12b5-4f92-890d-3daef2bd2dc8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:44.923298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:44.947484 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e217b-7d1f-4ca2-97b4-ea3763a334c9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:44.982787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74658163-926f-4ce0-a87d-52c598d65117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:44.983718 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74658163-926f-4ce0-a87d-52c598d65117 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:44.984323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 42/81] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:26:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:26:44.984514 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74658163-926f-4ce0-a87d-52c598d65117 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:44.984778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74658163-926f-4ce0-a87d-52c598d65117 None admin] PATH_INFO: `/v3/users/35d4d449311544628df57904899e79de` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:44.985362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288da2e5-12b5-4f92-890d-3daef2bd2dc8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:44.986057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74658163-926f-4ce0-a87d-52c598d65117 None admin] RBAC: Authorizing `identity:get_user(user_id=35d4d449311544628df57904899e79de)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:44.987527 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74658163-926f-4ce0-a87d-52c598d65117 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:44.989297 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 40/82] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:44 2022] GET /identity/v3/users/35d4d449311544628df57904899e79de => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:44.989971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74658163-926f-4ce0-a87d-52c598d65117 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:45.038708 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:45.084431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288da2e5-12b5-4f92-890d-3daef2bd2dc8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:45.092831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74658163-926f-4ce0-a87d-52c598d65117 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:45.118795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3ac4e-8479-4e57-8a23-978b458b91a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:45.119592 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3ac4e-8479-4e57-8a23-978b458b91a2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:45.119882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3ac4e-8479-4e57-8a23-978b458b91a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:45.120157 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca3ac4e-8479-4e57-8a23-978b458b91a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:45.121328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3ac4e-8479-4e57-8a23-978b458b91a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:45.122840 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca3ac4e-8479-4e57-8a23-978b458b91a2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:45.124809 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 43/83] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:26:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:45.125856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3ac4e-8479-4e57-8a23-978b458b91a2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:45.128085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b496b6b-7b22-459e-b52f-d9b1bd85f675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:45.129113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b496b6b-7b22-459e-b52f-d9b1bd85f675 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:45.129398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b496b6b-7b22-459e-b52f-d9b1bd85f675 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:45.129678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b496b6b-7b22-459e-b52f-d9b1bd85f675 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:45.130934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b496b6b-7b22-459e-b52f-d9b1bd85f675 None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:45.132400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b496b6b-7b22-459e-b52f-d9b1bd85f675 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:45.134136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 41/84] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:44 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:45.134992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b496b6b-7b22-459e-b52f-d9b1bd85f675 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:45.136684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:45.232506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca3ac4e-8479-4e57-8a23-978b458b91a2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:45.235279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b496b6b-7b22-459e-b52f-d9b1bd85f675 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:45.251817 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:45.268685 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb745a0d-4bce-4055-b95b-d05c22434e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:45.269502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb745a0d-4bce-4055-b95b-d05c22434e37 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:45.269817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb745a0d-4bce-4055-b95b-d05c22434e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:45.270101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb745a0d-4bce-4055-b95b-d05c22434e37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:45.271933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6514c7b-d01c-40c3-820c-8cfa271abc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:45.272803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6514c7b-d01c-40c3-820c-8cfa271abc3d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:45.273087 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6514c7b-d01c-40c3-820c-8cfa271abc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:45.273364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6514c7b-d01c-40c3-820c-8cfa271abc3d None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:45.274615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6514c7b-d01c-40c3-820c-8cfa271abc3d None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:45.276080 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6514c7b-d01c-40c3-820c-8cfa271abc3d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:45.277816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 42/85] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:45 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:45.278584 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6514c7b-d01c-40c3-820c-8cfa271abc3d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:45.280319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb745a0d-4bce-4055-b95b-d05c22434e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-bb745a0d-4bce-4055-b95b-d05c22434e37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:45.288567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:45.289597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:45.290703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:45.290703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:45.290703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:45.290703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:45.290703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:45.290703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:45.290703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:45.290703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:45.290703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:45.290703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:45.290703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:26:45.290703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:26:45.290703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 44/86] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:26:45.290703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb745a0d-4bce-4055-b95b-d05c22434e37 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:45.355996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:45.382889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6514c7b-d01c-40c3-820c-8cfa271abc3d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:45.390061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb745a0d-4bce-4055-b95b-d05c22434e37 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:45.416577 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf13e2-f201-40ad-bf60-a2b925934158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:45.417230 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf13e2-f201-40ad-bf60-a2b925934158 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:45.417520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf13e2-f201-40ad-bf60-a2b925934158 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:45.417833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf13e2-f201-40ad-bf60-a2b925934158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:45.423963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aef750-14d5-48a1-a803-40b8323f7230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:45.424636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aef750-14d5-48a1-a803-40b8323f7230 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:45.424928 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aef750-14d5-48a1-a803-40b8323f7230 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:45.425210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aef750-14d5-48a1-a803-40b8323f7230 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:45.425967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aef750-14d5-48a1-a803-40b8323f7230 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:45.427762 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aef750-14d5-48a1-a803-40b8323f7230 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:45.472357 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:45.488285 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf13e2-f201-40ad-bf60-a2b925934158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:45.489805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf13e2-f201-40ad-bf60-a2b925934158 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:45.516365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 45/87] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:26:45 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:26:45.517211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aef750-14d5-48a1-a803-40b8323f7230 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:45.614802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 43/88] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:26:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:26:45.616233 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf13e2-f201-40ad-bf60-a2b925934158 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:45.644020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aef750-14d5-48a1-a803-40b8323f7230 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:45.671161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:45.684750 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d17e1-71e6-4645-8262-56b40ae58f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:45.685418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d17e1-71e6-4645-8262-56b40ae58f55 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:45.686226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d17e1-71e6-4645-8262-56b40ae58f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:45.686226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d17e1-71e6-4645-8262-56b40ae58f55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:45.687596 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d17e1-71e6-4645-8262-56b40ae58f55 None admin] RBAC: Adding query filter params (role.id=2749d7dcfd844991883fa3f4e90ed75c, scope.project.id=6020d15ded71492c8adbc59366b3f07d, user.id=35d4d449311544628df57904899e79de) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:45.687596 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d17e1-71e6-4645-8262-56b40ae58f55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:45.688699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d17e1-71e6-4645-8262-56b40ae58f55 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:45.695981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 46/89] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:26:45 2022] GET /identity/v3/role_assignments?user.id=35d4d449311544628df57904899e79de&scope.project.id=6020d15ded71492c8adbc59366b3f07d&role.id=2749d7dcfd844991883fa3f4e90ed75c => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:45.696812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d17e1-71e6-4645-8262-56b40ae58f55 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:45.722257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:45.746454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf13e2-f201-40ad-bf60-a2b925934158 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:45.802195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5990ec7-c107-4fe7-abcd-2662821e6916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:45.802891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5990ec7-c107-4fe7-abcd-2662821e6916 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:45.803178 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5990ec7-c107-4fe7-abcd-2662821e6916 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:45.803459 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5990ec7-c107-4fe7-abcd-2662821e6916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:45.804329 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5990ec7-c107-4fe7-abcd-2662821e6916 None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=6020d15ded71492c8adbc59366b3f07d, user.id=641e54d5e34b4a43ad3182391125ef78) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:45.804647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5990ec7-c107-4fe7-abcd-2662821e6916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:45.806170 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5990ec7-c107-4fe7-abcd-2662821e6916 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:45.813240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 44/90] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:26:45 2022] GET /identity/v3/role_assignments?user.id=641e54d5e34b4a43ad3182391125ef78&scope.project.id=6020d15ded71492c8adbc59366b3f07d&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:45.814020 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5990ec7-c107-4fe7-abcd-2662821e6916 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:45.843505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d17e1-71e6-4645-8262-56b40ae58f55 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:45.899717 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930ffdd-c10e-49d9-9de1-b08e7a0dc3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:45.900330 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930ffdd-c10e-49d9-9de1-b08e7a0dc3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:45.900664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930ffdd-c10e-49d9-9de1-b08e7a0dc3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:45.900950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930ffdd-c10e-49d9-9de1-b08e7a0dc3b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:45.901749 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930ffdd-c10e-49d9-9de1-b08e7a0dc3b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:45.902187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930ffdd-c10e-49d9-9de1-b08e7a0dc3b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:45.903637 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930ffdd-c10e-49d9-9de1-b08e7a0dc3b3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:45.917076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 47/91] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:26:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:45.923109 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930ffdd-c10e-49d9-9de1-b08e7a0dc3b3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:45.961615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5990ec7-c107-4fe7-abcd-2662821e6916 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:45.994987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:46.011760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e37b2-fe84-4e5a-813e-f07cd5b95a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:46.012749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e37b2-fe84-4e5a-813e-f07cd5b95a8f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:46.013227 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e37b2-fe84-4e5a-813e-f07cd5b95a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:46.013512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e37b2-fe84-4e5a-813e-f07cd5b95a8f None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:46.016281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e37b2-fe84-4e5a-813e-f07cd5b95a8f None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:46.019547 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e37b2-fe84-4e5a-813e-f07cd5b95a8f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:46.020701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 45/92] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:45 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:46.027523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e37b2-fe84-4e5a-813e-f07cd5b95a8f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:46.053651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:46.054849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930ffdd-c10e-49d9-9de1-b08e7a0dc3b3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:46.098791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7f0ca-fdcb-4b51-a98a-4da35c448acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:46.099970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7f0ca-fdcb-4b51-a98a-4da35c448acd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:46.100425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7f0ca-fdcb-4b51-a98a-4da35c448acd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:46.100850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7f0ca-fdcb-4b51-a98a-4da35c448acd None admin] PATH_INFO: `/v3/users/35d4d449311544628df57904899e79de` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:46.102613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7f0ca-fdcb-4b51-a98a-4da35c448acd None admin] RBAC: Authorizing `identity:get_user(user_id=35d4d449311544628df57904899e79de)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:46.104313 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7f0ca-fdcb-4b51-a98a-4da35c448acd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:46.106234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 48/93] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:45 2022] GET /identity/v3/users/35d4d449311544628df57904899e79de => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:46.114746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7f0ca-fdcb-4b51-a98a-4da35c448acd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:46.156542 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e37b2-fe84-4e5a-813e-f07cd5b95a8f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:46.207113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73316a-84ea-4bf0-9916-c971f9dd8428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:46.207800 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73316a-84ea-4bf0-9916-c971f9dd8428 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:46.208090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73316a-84ea-4bf0-9916-c971f9dd8428 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:46.208400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73316a-84ea-4bf0-9916-c971f9dd8428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:46.209235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73316a-84ea-4bf0-9916-c971f9dd8428 None admin] RBAC: Adding query filter params (role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48, scope.project.id=6020d15ded71492c8adbc59366b3f07d, user.id=35d4d449311544628df57904899e79de) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:46.209563 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73316a-84ea-4bf0-9916-c971f9dd8428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:46.211136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73316a-84ea-4bf0-9916-c971f9dd8428 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:46.217245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 46/94] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:26:46 2022] GET /identity/v3/role_assignments?user.id=35d4d449311544628df57904899e79de&scope.project.id=6020d15ded71492c8adbc59366b3f07d&role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:46.272049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7f0ca-fdcb-4b51-a98a-4da35c448acd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:46.308193 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:46.311491 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85845125-a628-4db5-a45f-0d568ed802b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:46.313001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85845125-a628-4db5-a45f-0d568ed802b6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:46.313496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85845125-a628-4db5-a45f-0d568ed802b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:46.314020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85845125-a628-4db5-a45f-0d568ed802b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:46.393699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85845125-a628-4db5-a45f-0d568ed802b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:46.395568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85845125-a628-4db5-a45f-0d568ed802b6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:46.507740 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 49/95] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:26:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:26:46.513519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73316a-84ea-4bf0-9916-c971f9dd8428 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:46.626463 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:46.649359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73316a-84ea-4bf0-9916-c971f9dd8428 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:46.695102 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c17803-ca0a-439d-bcf4-6e78807fdc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:46.695988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c17803-ca0a-439d-bcf4-6e78807fdc27 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:46.696277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c17803-ca0a-439d-bcf4-6e78807fdc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:46.696565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c17803-ca0a-439d-bcf4-6e78807fdc27 None admin] PATH_INFO: `/v3/projects/a07bb472596842e3b2f9477f55b54ce0` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:46.698932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c17803-ca0a-439d-bcf4-6e78807fdc27 None admin] RBAC: Authorizing `identity:get_project(project_id=a07bb472596842e3b2f9477f55b54ce0)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:46.700421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c17803-ca0a-439d-bcf4-6e78807fdc27 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:46.702600 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 47/96] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:46 2022] GET /identity/v3/projects/a07bb472596842e3b2f9477f55b54ce0 => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:46.708206 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85845125-a628-4db5-a45f-0d568ed802b6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:46.748786 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:46.861683 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85845125-a628-4db5-a45f-0d568ed802b6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:46.906748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8744df-9543-4703-a884-ca195c48cce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:46.907713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8744df-9543-4703-a884-ca195c48cce1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:46.908213 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8744df-9543-4703-a884-ca195c48cce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:46.908670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8744df-9543-4703-a884-ca195c48cce1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:46.909706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8744df-9543-4703-a884-ca195c48cce1 None admin] RBAC: Adding query filter params (role.id=2749d7dcfd844991883fa3f4e90ed75c, scope.project.id=a07bb472596842e3b2f9477f55b54ce0, user.id=35d4d449311544628df57904899e79de) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:46.910227 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8744df-9543-4703-a884-ca195c48cce1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:46.911907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8744df-9543-4703-a884-ca195c48cce1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:46.918038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 50/97] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:26:46 2022] GET /identity/v3/role_assignments?user.id=35d4d449311544628df57904899e79de&scope.project.id=a07bb472596842e3b2f9477f55b54ce0&role.id=2749d7dcfd844991883fa3f4e90ed75c => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:48.365162 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06380a00-61d0-4c89-b18d-829498c75186 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:48.365651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06380a00-61d0-4c89-b18d-829498c75186 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:48.365651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06380a00-61d0-4c89-b18d-829498c75186 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:48.367075 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 48/98] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:48.372560 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9a37-b9b2-40cb-b89a-28245cba7fcb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:48.372967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9a37-b9b2-40cb-b89a-28245cba7fcb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:48.373150 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a9a37-b9b2-40cb-b89a-28245cba7fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:48.394675 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-719a9a37-b9b2-40cb-b89a-28245cba7fcb None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:48.395896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-719a9a37-b9b2-40cb-b89a-28245cba7fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:48.489050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 51/99] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:48.514618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be9436-d6ae-40d6-848e-d72bcf616f97 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:48.515519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be9436-d6ae-40d6-848e-d72bcf616f97 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:48.515885 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be9436-d6ae-40d6-848e-d72bcf616f97 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:48.517437 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 49/100] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:48.522939 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fae3fb-e597-4f02-9c7d-9d9accbb31a0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:48.523237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fae3fb-e597-4f02-9c7d-9d9accbb31a0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:48.523524 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fae3fb-e597-4f02-9c7d-9d9accbb31a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:48.539986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be9436-d6ae-40d6-848e-d72bcf616f97 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:48.546087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-94fae3fb-e597-4f02-9c7d-9d9accbb31a0 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:48.547345 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-94fae3fb-e597-4f02-9c7d-9d9accbb31a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:48.560916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:48.695417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be9436-d6ae-40d6-848e-d72bcf616f97 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:48.716045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 52/101] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:48.749873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dd404-bdcd-490e-8c6b-4e6a0d4366f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:48.750698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dd404-bdcd-490e-8c6b-4e6a0d4366f7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:48.750983 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dd404-bdcd-490e-8c6b-4e6a0d4366f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:48.751261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dd404-bdcd-490e-8c6b-4e6a0d4366f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:48.756097 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fae3fb-e597-4f02-9c7d-9d9accbb31a0 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:48.772531 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21dd404-bdcd-490e-8c6b-4e6a0d4366f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-f21dd404-bdcd-490e-8c6b-4e6a0d4366f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:48.781541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:48.783544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:48.785493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:48.785493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:48.785493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:48.785493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:48.785493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:48.785493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:48.785493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:48.785493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:48.785493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:48.785493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:48.785493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:26:48.785493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:26:48.785493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 50/102] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:26:48.793738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dd404-bdcd-490e-8c6b-4e6a0d4366f7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:48.808035 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:48.943571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21dd404-bdcd-490e-8c6b-4e6a0d4366f7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:48.962821 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fae3fb-e597-4f02-9c7d-9d9accbb31a0 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:49.007883 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc5cc3e-0bca-4775-a74f-e372effa7dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:49.008995 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5cc3e-0bca-4775-a74f-e372effa7dcc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:49.009569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5cc3e-0bca-4775-a74f-e372effa7dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:49.010593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc5cc3e-0bca-4775-a74f-e372effa7dcc None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:49.011309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5cc3e-0bca-4775-a74f-e372effa7dcc None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:49.011641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5cc3e-0bca-4775-a74f-e372effa7dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:49.013585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc5cc3e-0bca-4775-a74f-e372effa7dcc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:49.029965 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 51/103] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:26:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:49.031958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f644258-5ea5-40b6-a1d1-a0a49ae70ec7 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:49.032274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f644258-5ea5-40b6-a1d1-a0a49ae70ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:49.032562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f644258-5ea5-40b6-a1d1-a0a49ae70ec7 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:49.033664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ab545-8bbe-4d94-94e0-a2bf04377bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:49.034103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 52/104] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:49.034745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ab545-8bbe-4d94-94e0-a2bf04377bbb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:49.035029 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ab545-8bbe-4d94-94e0-a2bf04377bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:49.035305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ab545-8bbe-4d94-94e0-a2bf04377bbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:49.042697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad96ae-8806-4d7a-a64a-d273867b033f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:49.042992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad96ae-8806-4d7a-a64a-d273867b033f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:49.043278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad96ae-8806-4d7a-a64a-d273867b033f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:49.062495 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6dad96ae-8806-4d7a-a64a-d273867b033f None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:49.064512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6dad96ae-8806-4d7a-a64a-d273867b033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:49.071814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043ab545-8bbe-4d94-94e0-a2bf04377bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-043ab545-8bbe-4d94-94e0-a2bf04377bbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:49.087069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:49.088107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:49.089211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:49.089211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:49.089211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:49.089211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:49.089211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:49.089211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:49.089211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:49.089211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:49.089211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:49.089211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:49.089211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:26:49.089211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:26:49.089211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 53/105] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:26:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:26:49.089211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ab545-8bbe-4d94-94e0-a2bf04377bbb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:49.100077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:49.142138 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:49.148770 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 53/106] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:49.149761 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad96ae-8806-4d7a-a64a-d273867b033f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:49.278160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ab545-8bbe-4d94-94e0-a2bf04377bbb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:49.283288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad96ae-8806-4d7a-a64a-d273867b033f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:49.317119 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d4f41-edf0-4fbc-92fe-8d39fd97b491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:49.318136 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d4f41-edf0-4fbc-92fe-8d39fd97b491 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:49.318425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d4f41-edf0-4fbc-92fe-8d39fd97b491 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:49.318705 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d4f41-edf0-4fbc-92fe-8d39fd97b491 None admin] PATH_INFO: `/v3/users/35d4d449311544628df57904899e79de` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:49.320001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d4f41-edf0-4fbc-92fe-8d39fd97b491 None admin] RBAC: Authorizing `identity:get_user(user_id=35d4d449311544628df57904899e79de)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:49.321340 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7117f-7171-43df-9b44-f9ba3b042e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:49.322057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7117f-7171-43df-9b44-f9ba3b042e91 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:49.322349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7117f-7171-43df-9b44-f9ba3b042e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:49.322633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7117f-7171-43df-9b44-f9ba3b042e91 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:49.323097 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d4f41-edf0-4fbc-92fe-8d39fd97b491 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:49.323400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7117f-7171-43df-9b44-f9ba3b042e91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:49.323717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7117f-7171-43df-9b44-f9ba3b042e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:49.325098 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7117f-7171-43df-9b44-f9ba3b042e91 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:49.325553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 54/107] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:49 2022] GET /identity/v3/users/35d4d449311544628df57904899e79de => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:49.334561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 54/108] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:49.336065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451a9bb-c9ed-4b8e-a27d-a9e76d42de3c None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:49.336171 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d4f41-edf0-4fbc-92fe-8d39fd97b491 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:49.336420 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451a9bb-c9ed-4b8e-a27d-a9e76d42de3c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:49.336710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451a9bb-c9ed-4b8e-a27d-a9e76d42de3c None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:49.338001 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 55/109] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:49.342874 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451a9bb-c9ed-4b8e-a27d-a9e76d42de3c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:49.416756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:49.421903 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:49.456052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d4f41-edf0-4fbc-92fe-8d39fd97b491 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:49.461620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451a9bb-c9ed-4b8e-a27d-a9e76d42de3c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:49.495931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa016cb1-0083-4454-a287-ef1e68cebd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:49.496934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa016cb1-0083-4454-a287-ef1e68cebd20 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:49.497300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa016cb1-0083-4454-a287-ef1e68cebd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:49.497642 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa016cb1-0083-4454-a287-ef1e68cebd20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:49.499107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa016cb1-0083-4454-a287-ef1e68cebd20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:49.501264 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa016cb1-0083-4454-a287-ef1e68cebd20 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:49.503493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 55/110] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:26:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:49.504246 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce381737-91fc-4f9c-9126-331bcc5de067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:49.504396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa016cb1-0083-4454-a287-ef1e68cebd20 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:49.505451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381737-91fc-4f9c-9126-331bcc5de067 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:49.505912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381737-91fc-4f9c-9126-331bcc5de067 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:49.506381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce381737-91fc-4f9c-9126-331bcc5de067 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:49.508065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce381737-91fc-4f9c-9126-331bcc5de067 None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:49.509822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce381737-91fc-4f9c-9126-331bcc5de067 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:49.511779 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 56/111] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:49 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:49.513297 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51136c1-19c0-401c-a61d-a3d5c7e7f147 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:49.513756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51136c1-19c0-401c-a61d-a3d5c7e7f147 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:49.514210 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51136c1-19c0-401c-a61d-a3d5c7e7f147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:49.535664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d51136c1-19c0-401c-a61d-a3d5c7e7f147 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:49.538109 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d51136c1-19c0-401c-a61d-a3d5c7e7f147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:49.613638 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 57/112] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:49.618902 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51136c1-19c0-401c-a61d-a3d5c7e7f147 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:49.620014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa016cb1-0083-4454-a287-ef1e68cebd20 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:49.666065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc90c-5dc4-4fb6-91bd-3ae1707e7144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:49.667291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc90c-5dc4-4fb6-91bd-3ae1707e7144 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:49.667787 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc90c-5dc4-4fb6-91bd-3ae1707e7144 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:49.668289 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc90c-5dc4-4fb6-91bd-3ae1707e7144 None admin] PATH_INFO: `/v3/users/641e54d5e34b4a43ad3182391125ef78` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:49.669569 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc90c-5dc4-4fb6-91bd-3ae1707e7144 None admin] RBAC: Authorizing `identity:get_user(user_id=641e54d5e34b4a43ad3182391125ef78)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:49.671360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc90c-5dc4-4fb6-91bd-3ae1707e7144 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:49.673157 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 56/113] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:49 2022] GET /identity/v3/users/641e54d5e34b4a43ad3182391125ef78 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:49.673749 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc90c-5dc4-4fb6-91bd-3ae1707e7144 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:49.683664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:49.693671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:49.742441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51136c1-19c0-401c-a61d-a3d5c7e7f147 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:49.782407 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84768d93-d32a-4136-bf4d-83ec95b92c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:49.783091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84768d93-d32a-4136-bf4d-83ec95b92c4e None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:49.783378 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84768d93-d32a-4136-bf4d-83ec95b92c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:49.783659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84768d93-d32a-4136-bf4d-83ec95b92c4e None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:49.783916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc90c-5dc4-4fb6-91bd-3ae1707e7144 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:49.784384 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84768d93-d32a-4136-bf4d-83ec95b92c4e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:49.785954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84768d93-d32a-4136-bf4d-83ec95b92c4e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:49.818881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2f4d8-f6e5-4104-92be-24a4373c11de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:49.819775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f4d8-f6e5-4104-92be-24a4373c11de None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:49.820060 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f4d8-f6e5-4104-92be-24a4373c11de None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:49.820335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f4d8-f6e5-4104-92be-24a4373c11de None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d/users/35d4d449311544628df57904899e79de/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:49.822337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2f4d8-f6e5-4104-92be-24a4373c11de None admin] RBAC: Authorizing `identity:create_grant(project_id=6020d15ded71492c8adbc59366b3f07d, user_id=35d4d449311544628df57904899e79de, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:49.823793 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2f4d8-f6e5-4104-92be-24a4373c11de None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:49.895821 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 58/114] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 20 22:26:49 2022] POST /identity/v3/projects => generated 302 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:26:49.901774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78585a-485c-41ac-a333-e670ddc6f280 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:49.901774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78585a-485c-41ac-a333-e670ddc6f280 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:49.901774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78585a-485c-41ac-a333-e670ddc6f280 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:49.901774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 59/115] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:49.901774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78585a-485c-41ac-a333-e670ddc6f280 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:49.926689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 57/116] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:26:49 2022] PUT /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d/users/35d4d449311544628df57904899e79de/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:26:49.926689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2f4d8-f6e5-4104-92be-24a4373c11de None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:50.058964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:50.106255 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2f4d8-f6e5-4104-92be-24a4373c11de None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:50.131000 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78585a-485c-41ac-a333-e670ddc6f280 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:50.148262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16f9f5-534f-4a40-a3b5-983472a8816b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:50.149479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16f9f5-534f-4a40-a3b5-983472a8816b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:50.150017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16f9f5-534f-4a40-a3b5-983472a8816b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:50.150476 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16f9f5-534f-4a40-a3b5-983472a8816b None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:50.151893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16f9f5-534f-4a40-a3b5-983472a8816b None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:50.152610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:50.153923 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba16f9f5-534f-4a40-a3b5-983472a8816b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:50.155972 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 58/117] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:49 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:50.157608 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e0e5b-67c7-400e-85b6-e204d4551f22 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:50.158118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e0e5b-67c7-400e-85b6-e204d4551f22 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:50.161468 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e0e5b-67c7-400e-85b6-e204d4551f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:50.178254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-464e0e5b-67c7-400e-85b6-e204d4551f22 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:50.180162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-464e0e5b-67c7-400e-85b6-e204d4551f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:50.189661 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31701b6-2114-4f55-a037-ac0f9e3104fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:50.190519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31701b6-2114-4f55-a037-ac0f9e3104fc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:50.190807 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31701b6-2114-4f55-a037-ac0f9e3104fc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:50.191087 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31701b6-2114-4f55-a037-ac0f9e3104fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:50.214614 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31701b6-2114-4f55-a037-ac0f9e3104fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e31701b6-2114-4f55-a037-ac0f9e3104fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:50.223654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:50.224585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:50.225359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:50.225359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:50.225359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:50.225359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:50.225359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:50.225359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:50.225359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:50.225359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:50.225359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:50.225359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:50.225359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:26:50.225359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:26:50.225359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 60/118] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:26:50.226071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31701b6-2114-4f55-a037-ac0f9e3104fc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:50.259639 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 59/119] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:50.261268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448eac1-c907-4600-b0df-bfbfcccfa878 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:50.261702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448eac1-c907-4600-b0df-bfbfcccfa878 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:50.262167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448eac1-c907-4600-b0df-bfbfcccfa878 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:50.263837 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 60/120] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:50.269201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448eac1-c907-4600-b0df-bfbfcccfa878 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:50.334733 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:50.342208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31701b6-2114-4f55-a037-ac0f9e3104fc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:50.375812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448eac1-c907-4600-b0df-bfbfcccfa878 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:50.380982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81721f29-4522-4e13-95a3-ea4dbc1dd269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:50.382058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81721f29-4522-4e13-95a3-ea4dbc1dd269 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:50.382445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81721f29-4522-4e13-95a3-ea4dbc1dd269 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:50.382822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81721f29-4522-4e13-95a3-ea4dbc1dd269 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d/users/641e54d5e34b4a43ad3182391125ef78/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:50.385242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81721f29-4522-4e13-95a3-ea4dbc1dd269 None admin] RBAC: Authorizing `identity:create_grant(project_id=6020d15ded71492c8adbc59366b3f07d, user_id=641e54d5e34b4a43ad3182391125ef78, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:50.386759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81721f29-4522-4e13-95a3-ea4dbc1dd269 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:50.414252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4d280-e077-453e-991b-dc03ee0656a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:50.414938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4d280-e077-453e-991b-dc03ee0656a6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:50.415223 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4d280-e077-453e-991b-dc03ee0656a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:50.415505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4d280-e077-453e-991b-dc03ee0656a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:50.416265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4d280-e077-453e-991b-dc03ee0656a6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:50.416578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4d280-e077-453e-991b-dc03ee0656a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:50.417998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4d280-e077-453e-991b-dc03ee0656a6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:50.427404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 61/121] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:26:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:50.428480 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed27fdb-dda3-417e-8af1-e63fc9f80a02 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:50.428771 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed27fdb-dda3-417e-8af1-e63fc9f80a02 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:50.429050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed27fdb-dda3-417e-8af1-e63fc9f80a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:50.450721 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8ed27fdb-dda3-417e-8af1-e63fc9f80a02 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:50.451912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8ed27fdb-dda3-417e-8af1-e63fc9f80a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:50.492458 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 61/122] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:26:50 2022] PUT /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d/users/641e54d5e34b4a43ad3182391125ef78/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:26:50.494224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81721f29-4522-4e13-95a3-ea4dbc1dd269 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:50.541414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:50.556644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 62/123] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:50.557764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed27fdb-dda3-417e-8af1-e63fc9f80a02 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:50.684019 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:50.690998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81721f29-4522-4e13-95a3-ea4dbc1dd269 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:50.739799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b8083-ba09-4bcd-adb4-0793311d3f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:50.740427 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b8083-ba09-4bcd-adb4-0793311d3f6f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:50.740717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b8083-ba09-4bcd-adb4-0793311d3f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:50.740999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b8083-ba09-4bcd-adb4-0793311d3f6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:50.754936 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed27fdb-dda3-417e-8af1-e63fc9f80a02 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:50.757555 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b8083-ba09-4bcd-adb4-0793311d3f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-3d1b8083-ba09-4bcd-adb4-0793311d3f6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:50.768742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:50.769896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:50.770782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:50.770782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:50.770782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:50.770782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:50.770782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:50.770782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:50.770782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:50.770782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:50.770782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:50.770782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:50.770782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:26:50.770782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:26:50.770782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 62/124] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:26:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:26:50.771552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b8083-ba09-4bcd-adb4-0793311d3f6f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:50.802980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d06f5d-1e4e-40b8-b377-62e1726f9009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:50.804893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d06f5d-1e4e-40b8-b377-62e1726f9009 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:50.805328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d06f5d-1e4e-40b8-b377-62e1726f9009 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:50.805800 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d06f5d-1e4e-40b8-b377-62e1726f9009 None admin] PATH_INFO: `/v3/users/5249bdd5a8c44702b0bcf30916f92884` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:50.838985 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d06f5d-1e4e-40b8-b377-62e1726f9009 None admin] RBAC: Authorizing `identity:get_user(user_id=5249bdd5a8c44702b0bcf30916f92884)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:50.840718 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d06f5d-1e4e-40b8-b377-62e1726f9009 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:50.843693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 63/125] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:50 2022] GET /identity/v3/users/5249bdd5a8c44702b0bcf30916f92884 => generated 289 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:50.844629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d06f5d-1e4e-40b8-b377-62e1726f9009 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:50.887651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:50.901746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b8083-ba09-4bcd-adb4-0793311d3f6f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:50.957537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36bb39-737e-4daf-8319-89ef52a834e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:50.958296 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36bb39-737e-4daf-8319-89ef52a834e7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:50.958584 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36bb39-737e-4daf-8319-89ef52a834e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:50.958866 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36bb39-737e-4daf-8319-89ef52a834e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:50.986480 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36bb39-737e-4daf-8319-89ef52a834e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-8e36bb39-737e-4daf-8319-89ef52a834e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:51.004663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:51.005794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:51.006794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:51.006794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:51.006794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:51.006794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:51.006794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:51.006794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:51.006794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:51.006794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:51.006794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:51.006794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:51.006794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:26:51.006794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:26:51.006794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 63/126] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:26:51.006794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36bb39-737e-4daf-8319-89ef52a834e7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:51.057331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d06f5d-1e4e-40b8-b377-62e1726f9009 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:51.095610 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:51.141345 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a216dee-17fa-46ae-b94f-b5712c987c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:51.142354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a216dee-17fa-46ae-b94f-b5712c987c85 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:51.142790 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a216dee-17fa-46ae-b94f-b5712c987c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:51.143226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a216dee-17fa-46ae-b94f-b5712c987c85 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:51.144196 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a216dee-17fa-46ae-b94f-b5712c987c85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:51.144744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a216dee-17fa-46ae-b94f-b5712c987c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:51.146400 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a216dee-17fa-46ae-b94f-b5712c987c85 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:51.159730 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 64/127] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:26:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:51.162284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a216dee-17fa-46ae-b94f-b5712c987c85 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:51.191891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36bb39-737e-4daf-8319-89ef52a834e7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:51.252295 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a908095-a429-44d1-b481-7efce9a56f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:51.253911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a908095-a429-44d1-b481-7efce9a56f9a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:51.255111 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a908095-a429-44d1-b481-7efce9a56f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:51.256289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a908095-a429-44d1-b481-7efce9a56f9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:51.297671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:51.371302 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a216dee-17fa-46ae-b94f-b5712c987c85 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:51.388167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a908095-a429-44d1-b481-7efce9a56f9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:51.390020 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a908095-a429-44d1-b481-7efce9a56f9a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:51.441156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad090d8a-861d-4878-bea2-6ebe02b364bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:51.442668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad090d8a-861d-4878-bea2-6ebe02b364bf None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:51.443179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad090d8a-861d-4878-bea2-6ebe02b364bf None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:51.443660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad090d8a-861d-4878-bea2-6ebe02b364bf None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:51.444734 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad090d8a-861d-4878-bea2-6ebe02b364bf None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:51.445295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad090d8a-861d-4878-bea2-6ebe02b364bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:51.446913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad090d8a-861d-4878-bea2-6ebe02b364bf None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:51.464574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 65/128] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:26:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:51.465960 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad090d8a-861d-4878-bea2-6ebe02b364bf None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:51.538138 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:51.541236 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 64/129] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:26:51.542653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a908095-a429-44d1-b481-7efce9a56f9a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:51.633145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:51.685628 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a908095-a429-44d1-b481-7efce9a56f9a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:51.691646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad090d8a-861d-4878-bea2-6ebe02b364bf None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:51.725008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be54b1b-5e5b-42aa-a237-bfa0e0819cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:51.726158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be54b1b-5e5b-42aa-a237-bfa0e0819cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:51.726727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be54b1b-5e5b-42aa-a237-bfa0e0819cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:51.727415 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be54b1b-5e5b-42aa-a237-bfa0e0819cc4 None admin] PATH_INFO: `/v3/users/35d4d449311544628df57904899e79de` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:51.735418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be54b1b-5e5b-42aa-a237-bfa0e0819cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=35d4d449311544628df57904899e79de)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:51.737058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be54b1b-5e5b-42aa-a237-bfa0e0819cc4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:51.740185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 65/130] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:51 2022] GET /identity/v3/users/35d4d449311544628df57904899e79de => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:51.741121 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be54b1b-5e5b-42aa-a237-bfa0e0819cc4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:51.755153 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd514bc-5bbd-4527-923b-f66b6c692969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:51.756359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd514bc-5bbd-4527-923b-f66b6c692969 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:51.756833 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd514bc-5bbd-4527-923b-f66b6c692969 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:51.757305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd514bc-5bbd-4527-923b-f66b6c692969 None admin] PATH_INFO: `/v3/users/35d4d449311544628df57904899e79de` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:51.758796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd514bc-5bbd-4527-923b-f66b6c692969 None admin] RBAC: Authorizing `identity:get_user(user_id=35d4d449311544628df57904899e79de)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:51.760455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd514bc-5bbd-4527-923b-f66b6c692969 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:51.762909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 66/131] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:51 2022] GET /identity/v3/users/35d4d449311544628df57904899e79de => generated 275 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:51.766618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd514bc-5bbd-4527-923b-f66b6c692969 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:51.901622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd514bc-5bbd-4527-923b-f66b6c692969 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:51.914652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:51.927807 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be54b1b-5e5b-42aa-a237-bfa0e0819cc4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:51.975248 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:51.976162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4755fd2-5850-4700-8e24-20f77c0ebbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:51.977043 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4755fd2-5850-4700-8e24-20f77c0ebbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:51.977578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4755fd2-5850-4700-8e24-20f77c0ebbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:51.977881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4755fd2-5850-4700-8e24-20f77c0ebbf5 None admin] PATH_INFO: `/v3/projects/a07bb472596842e3b2f9477f55b54ce0` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:51.979133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4755fd2-5850-4700-8e24-20f77c0ebbf5 None admin] RBAC: Authorizing `identity:get_project(project_id=a07bb472596842e3b2f9477f55b54ce0)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:51.980595 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4755fd2-5850-4700-8e24-20f77c0ebbf5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:51.982389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 67/132] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:51 2022] GET /identity/v3/projects/a07bb472596842e3b2f9477f55b54ce0 => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:51.983176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4755fd2-5850-4700-8e24-20f77c0ebbf5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:52.006727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c6a06-ffa4-410a-9c27-42ffd9457a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:52.007644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6a06-ffa4-410a-9c27-42ffd9457a33 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:52.007925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6a06-ffa4-410a-9c27-42ffd9457a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:52.008257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c6a06-ffa4-410a-9c27-42ffd9457a33 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:52.009576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c6a06-ffa4-410a-9c27-42ffd9457a33 None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:52.011137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c6a06-ffa4-410a-9c27-42ffd9457a33 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:52.015540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 66/133] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:51 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:52.018546 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c6a06-ffa4-410a-9c27-42ffd9457a33 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:52.159685 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4755fd2-5850-4700-8e24-20f77c0ebbf5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:52.195680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39912d-1d3a-4cfa-ba84-46a4b9bf5bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:52.196133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c6a06-ffa4-410a-9c27-42ffd9457a33 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:52.196611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39912d-1d3a-4cfa-ba84-46a4b9bf5bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:52.196896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39912d-1d3a-4cfa-ba84-46a4b9bf5bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:52.197220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39912d-1d3a-4cfa-ba84-46a4b9bf5bb1 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:52.206544 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39912d-1d3a-4cfa-ba84-46a4b9bf5bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:52.208024 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39912d-1d3a-4cfa-ba84-46a4b9bf5bb1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:52.209801 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 68/134] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:51 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:52.210573 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39912d-1d3a-4cfa-ba84-46a4b9bf5bb1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:52.239894 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c512a-db13-484f-9ec2-5a61d7988cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:52.240805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c512a-db13-484f-9ec2-5a61d7988cd4 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:52.241094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c512a-db13-484f-9ec2-5a61d7988cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:52.241433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c512a-db13-484f-9ec2-5a61d7988cd4 None admin] PATH_INFO: `/v3/projects/a07bb472596842e3b2f9477f55b54ce0/users/35d4d449311544628df57904899e79de/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:52.243541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c512a-db13-484f-9ec2-5a61d7988cd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a07bb472596842e3b2f9477f55b54ce0, user_id=35d4d449311544628df57904899e79de, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:52.245067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c512a-db13-484f-9ec2-5a61d7988cd4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:52.268037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:52.319854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 67/135] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:26:52 2022] PUT /identity/v3/projects/a07bb472596842e3b2f9477f55b54ce0/users/35d4d449311544628df57904899e79de/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:26:52.322639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c512a-db13-484f-9ec2-5a61d7988cd4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:52.338611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39912d-1d3a-4cfa-ba84-46a4b9bf5bb1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:52.394372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa735f2c-ade3-4d6b-9918-a147dfe5b5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:52.395852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa735f2c-ade3-4d6b-9918-a147dfe5b5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:52.395852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa735f2c-ade3-4d6b-9918-a147dfe5b5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:52.395852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa735f2c-ade3-4d6b-9918-a147dfe5b5b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:52.396459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa735f2c-ade3-4d6b-9918-a147dfe5b5b7 None admin] RBAC: Adding query filter params (role.id=37c1e273f187464f842780ff08196d0c, scope.project.id=6020d15ded71492c8adbc59366b3f07d, user.id=5249bdd5a8c44702b0bcf30916f92884) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:52.396776 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa735f2c-ade3-4d6b-9918-a147dfe5b5b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:52.398317 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa735f2c-ade3-4d6b-9918-a147dfe5b5b7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:52.405165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 69/136] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:26:52 2022] GET /identity/v3/role_assignments?user.id=5249bdd5a8c44702b0bcf30916f92884&scope.project.id=6020d15ded71492c8adbc59366b3f07d&role.id=37c1e273f187464f842780ff08196d0c => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:52.407200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89d15f-6c38-4817-ac4a-bbe09209b141 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:52.407492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89d15f-6c38-4817-ac4a-bbe09209b141 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:52.407771 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89d15f-6c38-4817-ac4a-bbe09209b141 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:52.409222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 70/137] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:52.410778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879e22-6c49-485c-947b-b41d28076e1a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:52.411021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879e22-6c49-485c-947b-b41d28076e1a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:52.411319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879e22-6c49-485c-947b-b41d28076e1a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:52.416727 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 71/138] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:52.419580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1474fd-8c7f-489a-a3e3-02da107ae428 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:52.419998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1474fd-8c7f-489a-a3e3-02da107ae428 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:52.420401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1474fd-8c7f-489a-a3e3-02da107ae428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:52.423591 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:52.459056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2f1474fd-8c7f-489a-a3e3-02da107ae428 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:52.462265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2f1474fd-8c7f-489a-a3e3-02da107ae428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:52.544026 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c512a-db13-484f-9ec2-5a61d7988cd4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:52.603759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e2742-c5d0-4363-8a22-00fa044bd98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:52.605029 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e2742-c5d0-4363-8a22-00fa044bd98c None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:52.605516 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e2742-c5d0-4363-8a22-00fa044bd98c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:52.606070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857e2742-c5d0-4363-8a22-00fa044bd98c None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d/users/35d4d449311544628df57904899e79de/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:52.607738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 72/139] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:52.609472 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e2742-c5d0-4363-8a22-00fa044bd98c None admin] RBAC: Authorizing `identity:create_grant(project_id=6020d15ded71492c8adbc59366b3f07d, user_id=35d4d449311544628df57904899e79de, role_id=5e5bc4ce5d004cd1bb07ef755bf3bb48)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:52.610437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7b4a-4de6-4d1b-9d62-00764981ba6a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:52.612340 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7b4a-4de6-4d1b-9d62-00764981ba6a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:52.612340 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7b4a-4de6-4d1b-9d62-00764981ba6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:52.612541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857e2742-c5d0-4363-8a22-00fa044bd98c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:52.628903 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-765b7b4a-4de6-4d1b-9d62-00764981ba6a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:52.630229 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-765b7b4a-4de6-4d1b-9d62-00764981ba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:52.669828 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:52.694495 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 68/140] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:26:52 2022] PUT /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d/users/35d4d449311544628df57904899e79de/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:26:52.695720 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e2742-c5d0-4363-8a22-00fa044bd98c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:52.745442 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 73/141] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:52.798475 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b7b4a-4de6-4d1b-9d62-00764981ba6a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:52.894905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857e2742-c5d0-4363-8a22-00fa044bd98c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:52.911410 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:52.951308 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f5b7-016f-483e-9ede-53be41e2259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:52.953166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f5b7-016f-483e-9ede-53be41e2259d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:52.953604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f5b7-016f-483e-9ede-53be41e2259d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:52.953940 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84f5b7-016f-483e-9ede-53be41e2259d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:52.966912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84f5b7-016f-483e-9ede-53be41e2259d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-8e84f5b7-016f-483e-9ede-53be41e2259d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:52.977758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:52.978787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:52.979602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:52.979602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:52.979602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:52.979602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:52.979602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:52.979602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:52.979602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:52.979602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:52.979602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:52.979602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:52.979602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:26:52.979602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:26:52.984895 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 69/142] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:26:52.986530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f5b7-016f-483e-9ede-53be41e2259d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:53.008784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b7b4a-4de6-4d1b-9d62-00764981ba6a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:53.056710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d850a-d005-4d50-ad53-6af5b4dbffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:53.057661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d850a-d005-4d50-ad53-6af5b4dbffa1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:53.058078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d850a-d005-4d50-ad53-6af5b4dbffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:53.059094 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d850a-d005-4d50-ad53-6af5b4dbffa1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:53.059886 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d850a-d005-4d50-ad53-6af5b4dbffa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:53.061542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407d850a-d005-4d50-ad53-6af5b4dbffa1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:53.065656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 74/143] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:26:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:53.072181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d850a-d005-4d50-ad53-6af5b4dbffa1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:53.118092 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:53.133382 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84f5b7-016f-483e-9ede-53be41e2259d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:53.211562 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407d850a-d005-4d50-ad53-6af5b4dbffa1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:53.215060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74839661-9db3-4799-ac9a-3946fa0631ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:53.215803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74839661-9db3-4799-ac9a-3946fa0631ef None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:53.216089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74839661-9db3-4799-ac9a-3946fa0631ef None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:53.216411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74839661-9db3-4799-ac9a-3946fa0631ef None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:53.217181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74839661-9db3-4799-ac9a-3946fa0631ef None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:53.217493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74839661-9db3-4799-ac9a-3946fa0631ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:53.219366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74839661-9db3-4799-ac9a-3946fa0631ef None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:53.238754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 70/144] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:26:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:53.240739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a38a2-c17e-447c-bf1b-e15e8fd2a5b8 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:53.241030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a38a2-c17e-447c-bf1b-e15e8fd2a5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:53.241312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a38a2-c17e-447c-bf1b-e15e8fd2a5b8 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:53.245184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 71/145] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:53.246950 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a38a2-c17e-447c-bf1b-e15e8fd2a5b8 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:53.285613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18570448-0c86-44ac-8381-1201e1b09111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:53.286372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18570448-0c86-44ac-8381-1201e1b09111 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:53.286662 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18570448-0c86-44ac-8381-1201e1b09111 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:53.286945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18570448-0c86-44ac-8381-1201e1b09111 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:53.287773 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18570448-0c86-44ac-8381-1201e1b09111 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:53.289277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18570448-0c86-44ac-8381-1201e1b09111 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:53.292034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:53.370620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a38a2-c17e-447c-bf1b-e15e8fd2a5b8 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:53.402766 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 75/146] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:26:53 2022] POST /identity/v3/users => generated 283 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:26:53.404584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f9f95-5e7c-4012-ae8e-9961e9f8d3ff None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:53.404810 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f9f95-5e7c-4012-ae8e-9961e9f8d3ff None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:53.405156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f9f95-5e7c-4012-ae8e-9961e9f8d3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:53.414871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b7f27-9c83-434c-8eee-cc4589f8566c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:53.416079 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7f27-9c83-434c-8eee-cc4589f8566c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:53.416543 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7f27-9c83-434c-8eee-cc4589f8566c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:53.416967 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7f27-9c83-434c-8eee-cc4589f8566c None admin] PATH_INFO: `/v3/users/35d4d449311544628df57904899e79de` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:53.419968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b7f27-9c83-434c-8eee-cc4589f8566c None admin] RBAC: Authorizing `identity:get_user(user_id=35d4d449311544628df57904899e79de)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:53.422248 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816b7f27-9c83-434c-8eee-cc4589f8566c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:53.424230 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 72/147] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:53 2022] GET /identity/v3/users/35d4d449311544628df57904899e79de => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:53.426392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-872f9f95-5e7c-4012-ae8e-9961e9f8d3ff None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:53.427725 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-872f9f95-5e7c-4012-ae8e-9961e9f8d3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:53.433397 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b7f27-9c83-434c-8eee-cc4589f8566c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:53.555347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 76/148] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:53.574154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:53.577920 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816b7f27-9c83-434c-8eee-cc4589f8566c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:53.602521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f9f95-5e7c-4012-ae8e-9961e9f8d3ff None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:53.615430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155d5fe-5f2d-4114-a123-1e51a1ff7edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:53.616376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155d5fe-5f2d-4114-a123-1e51a1ff7edb None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:53.616830 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155d5fe-5f2d-4114-a123-1e51a1ff7edb None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:53.617252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155d5fe-5f2d-4114-a123-1e51a1ff7edb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:53.642446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:53.700523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155d5fe-5f2d-4114-a123-1e51a1ff7edb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:53.702808 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155d5fe-5f2d-4114-a123-1e51a1ff7edb None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:53.798667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f9f95-5e7c-4012-ae8e-9961e9f8d3ff None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:53.838490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b627356-bc54-4c24-b625-63d0c204f119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:53.839230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627356-bc54-4c24-b625-63d0c204f119 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:53.839508 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627356-bc54-4c24-b625-63d0c204f119 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:53.839781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627356-bc54-4c24-b625-63d0c204f119 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:53.854469 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b627356-bc54-4c24-b625-63d0c204f119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-0b627356-bc54-4c24-b625-63d0c204f119 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:53.866273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:53.867221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:53.868027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:53.868027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:53.868027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:53.868027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:53.868027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:53.868027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:53.868027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:53.868027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:53.868027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:53.868027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:53.868027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:26:53.868027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:26:53.868027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 77/149] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:26:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:26:53.873433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b627356-bc54-4c24-b625-63d0c204f119 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:53.889525 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:53.895795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 73/150] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:26:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 22:26:53.902607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155d5fe-5f2d-4114-a123-1e51a1ff7edb None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:53.962776 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:53.982948 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b627356-bc54-4c24-b625-63d0c204f119 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:54.020914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc38c2-2df6-4de6-aae6-2d463415d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:54.021591 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc38c2-2df6-4de6-aae6-2d463415d8ce None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:54.021916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc38c2-2df6-4de6-aae6-2d463415d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:54.022192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc38c2-2df6-4de6-aae6-2d463415d8ce None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:54.023080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc38c2-2df6-4de6-aae6-2d463415d8ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:54.023391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc38c2-2df6-4de6-aae6-2d463415d8ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:54.024791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdc38c2-2df6-4de6-aae6-2d463415d8ce None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:54.034538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 78/151] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:54.040159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc38c2-2df6-4de6-aae6-2d463415d8ce None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:54.103962 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155d5fe-5f2d-4114-a123-1e51a1ff7edb None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:54.159530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc38c2-2df6-4de6-aae6-2d463415d8ce None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:54.167260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1ccac-b1ec-4964-bddd-4952e0cc8551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:54.168263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1ccac-b1ec-4964-bddd-4952e0cc8551 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:54.168653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1ccac-b1ec-4964-bddd-4952e0cc8551 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:54.169365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1ccac-b1ec-4964-bddd-4952e0cc8551 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:54.172173 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1ccac-b1ec-4964-bddd-4952e0cc8551 None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:54.173802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1ccac-b1ec-4964-bddd-4952e0cc8551 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:54.176152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 74/152] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:53 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:54.181834 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1ccac-b1ec-4964-bddd-4952e0cc8551 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:54.196067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bbdcc-f63f-49ad-9f48-99657d644638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:54.197142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bbdcc-f63f-49ad-9f48-99657d644638 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:54.197568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bbdcc-f63f-49ad-9f48-99657d644638 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:54.198008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bbdcc-f63f-49ad-9f48-99657d644638 None admin] PATH_INFO: `/v3/users/641e54d5e34b4a43ad3182391125ef78` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:54.199330 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bbdcc-f63f-49ad-9f48-99657d644638 None admin] RBAC: Authorizing `identity:get_user(user_id=641e54d5e34b4a43ad3182391125ef78)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:54.200967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bbdcc-f63f-49ad-9f48-99657d644638 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:54.203007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 79/153] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:54 2022] GET /identity/v3/users/641e54d5e34b4a43ad3182391125ef78 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:54.208798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bbdcc-f63f-49ad-9f48-99657d644638 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:54.222150 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:54.306549 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:54.316099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bbdcc-f63f-49ad-9f48-99657d644638 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:54.353123 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7252be4-810b-4e0d-aed6-58c03c607a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:54.354225 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7252be4-810b-4e0d-aed6-58c03c607a4c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:54.354656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7252be4-810b-4e0d-aed6-58c03c607a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:54.355199 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7252be4-810b-4e0d-aed6-58c03c607a4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:54.362695 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1ccac-b1ec-4964-bddd-4952e0cc8551 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:54.413758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823fc5f-ece7-4009-a199-19d51deb4564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:54.415122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823fc5f-ece7-4009-a199-19d51deb4564 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:54.415835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823fc5f-ece7-4009-a199-19d51deb4564 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:54.416269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823fc5f-ece7-4009-a199-19d51deb4564 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:54.417421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823fc5f-ece7-4009-a199-19d51deb4564 None admin] RBAC: Adding query filter params (role.id=2749d7dcfd844991883fa3f4e90ed75c, scope.project.id=6020d15ded71492c8adbc59366b3f07d, user.id=35d4d449311544628df57904899e79de) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:54.418506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823fc5f-ece7-4009-a199-19d51deb4564 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:54.420167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823fc5f-ece7-4009-a199-19d51deb4564 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:54.429106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 75/154] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:26:54 2022] GET /identity/v3/role_assignments?user.id=35d4d449311544628df57904899e79de&scope.project.id=6020d15ded71492c8adbc59366b3f07d&role.id=2749d7dcfd844991883fa3f4e90ed75c => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:54.449491 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7252be4-810b-4e0d-aed6-58c03c607a4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:54.451301 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7252be4-810b-4e0d-aed6-58c03c607a4c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:54.465232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:54.571302 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 80/155] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:26:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 22:26:54.578250 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823fc5f-ece7-4009-a199-19d51deb4564 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:54.698430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823fc5f-ece7-4009-a199-19d51deb4564 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:54.734121 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:54.743879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bfef76-5902-48a6-9f50-2a9e68b89498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:54.744986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfef76-5902-48a6-9f50-2a9e68b89498 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:54.746548 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfef76-5902-48a6-9f50-2a9e68b89498 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:54.746548 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bfef76-5902-48a6-9f50-2a9e68b89498 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:54.747234 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfef76-5902-48a6-9f50-2a9e68b89498 None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:54.748891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bfef76-5902-48a6-9f50-2a9e68b89498 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:54.751428 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 76/156] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:54 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:54.757567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7252be4-810b-4e0d-aed6-58c03c607a4c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:54.885570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7252be4-810b-4e0d-aed6-58c03c607a4c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:54.898384 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:54.929320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cf764-4128-4438-a470-9f47de67910d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:54.930283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cf764-4128-4438-a470-9f47de67910d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:54.930902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cf764-4128-4438-a470-9f47de67910d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:54.931447 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cf764-4128-4438-a470-9f47de67910d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:54.932689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cf764-4128-4438-a470-9f47de67910d None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=6020d15ded71492c8adbc59366b3f07d, user.id=641e54d5e34b4a43ad3182391125ef78) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:54.933158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cf764-4128-4438-a470-9f47de67910d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:54.934801 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60cf764-4128-4438-a470-9f47de67910d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:54.947840 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 81/157] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:26:54 2022] GET /identity/v3/role_assignments?user.id=641e54d5e34b4a43ad3182391125ef78&scope.project.id=6020d15ded71492c8adbc59366b3f07d&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:55.168697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb032f-8047-4526-bd80-17296f51aedf None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:55.169355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb032f-8047-4526-bd80-17296f51aedf None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:55.169868 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb032f-8047-4526-bd80-17296f51aedf None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:55.172937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 77/158] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:55.178908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2f86-3a1e-42cd-bb9c-81667b59dfb3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:55.179463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2f86-3a1e-42cd-bb9c-81667b59dfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:55.179949 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2f86-3a1e-42cd-bb9c-81667b59dfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:55.202204 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-bf8f2f86-3a1e-42cd-bb9c-81667b59dfb3 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:55.204399 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bf8f2f86-3a1e-42cd-bb9c-81667b59dfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:55.297764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 82/159] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:55.340863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb032f-8047-4526-bd80-17296f51aedf None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:55.495546 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb032f-8047-4526-bd80-17296f51aedf None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:55.516638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137ed30-a7fe-4037-bad3-f849a9bdb0b7 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:55.516925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137ed30-a7fe-4037-bad3-f849a9bdb0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:55.517421 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137ed30-a7fe-4037-bad3-f849a9bdb0b7 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:55.519031 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 83/160] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:55.524338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3c517-4edd-4e42-8c4f-854130ccbf70 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:55.525081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3c517-4edd-4e42-8c4f-854130ccbf70 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:55.525590 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3c517-4edd-4e42-8c4f-854130ccbf70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:55.560330 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-68c3c517-4edd-4e42-8c4f-854130ccbf70 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:55.562484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-68c3c517-4edd-4e42-8c4f-854130ccbf70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:55.564450 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa5f0-f2c5-4d16-bdb2-cfa06d3efc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:55.565275 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa5f0-f2c5-4d16-bdb2-cfa06d3efc2a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:55.565538 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa5f0-f2c5-4d16-bdb2-cfa06d3efc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:55.565829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062aa5f0-f2c5-4d16-bdb2-cfa06d3efc2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:55.598985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062aa5f0-f2c5-4d16-bdb2-cfa06d3efc2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-062aa5f0-f2c5-4d16-bdb2-cfa06d3efc2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:55.608989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:55.611165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:55.612002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:55.612002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:55.612002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:55.612002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:55.612002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:55.612002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:55.612002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:55.612002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:55.612002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:55.612002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:55.612002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:26:55.612002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:26:55.614144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 78/161] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:26:55.618597 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa5f0-f2c5-4d16-bdb2-cfa06d3efc2a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:55.736730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:55.740210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 84/162] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:55.815278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3c517-4edd-4e42-8c4f-854130ccbf70 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:55.828712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062aa5f0-f2c5-4d16-bdb2-cfa06d3efc2a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:55.885375 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:55.887685 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4bee3-5a67-482a-ba71-267e5f78287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:55.888373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bee3-5a67-482a-ba71-267e5f78287f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:55.888661 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bee3-5a67-482a-ba71-267e5f78287f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:55.888938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f4bee3-5a67-482a-ba71-267e5f78287f None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:55.889780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4bee3-5a67-482a-ba71-267e5f78287f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:55.890132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4bee3-5a67-482a-ba71-267e5f78287f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:55.891530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f4bee3-5a67-482a-ba71-267e5f78287f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:55.905873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 79/163] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:26:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:55.911479 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4bee3-5a67-482a-ba71-267e5f78287f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:56.025561 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3c517-4edd-4e42-8c4f-854130ccbf70 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:56.039383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f4bee3-5a67-482a-ba71-267e5f78287f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:56.060662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:56.077840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af189d-e1fb-4cb9-8db5-90878c81a6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:56.078763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af189d-e1fb-4cb9-8db5-90878c81a6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:56.079048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af189d-e1fb-4cb9-8db5-90878c81a6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:56.079326 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af189d-e1fb-4cb9-8db5-90878c81a6b8 None admin] PATH_INFO: `/v3/users/5249bdd5a8c44702b0bcf30916f92884` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:56.082291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af189d-e1fb-4cb9-8db5-90878c81a6b8 None admin] RBAC: Authorizing `identity:get_user(user_id=5249bdd5a8c44702b0bcf30916f92884)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:56.082920 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af189d-e1fb-4cb9-8db5-90878c81a6b8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:56.084818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 80/164] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:55 2022] GET /identity/v3/users/5249bdd5a8c44702b0bcf30916f92884 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:56.090494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96a69-19c9-4e33-bc6a-a781adcd0537 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:56.091366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96a69-19c9-4e33-bc6a-a781adcd0537 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:56.091653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b96a69-19c9-4e33-bc6a-a781adcd0537 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:56.094249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 81/165] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:56.094607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96a69-19c9-4e33-bc6a-a781adcd0537 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:56.099201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378528c-f080-4609-8dd4-fe9a55028366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:56.100021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378528c-f080-4609-8dd4-fe9a55028366 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:56.100303 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378528c-f080-4609-8dd4-fe9a55028366 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:56.100580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378528c-f080-4609-8dd4-fe9a55028366 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:56.117430 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8378528c-f080-4609-8dd4-fe9a55028366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-8378528c-f080-4609-8dd4-fe9a55028366 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:56.133160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:56.134158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:56.135230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:56.135230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:56.135230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:56.135230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:56.135230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:56.135230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:56.135230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:56.135230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:56.135230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:56.135230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:56.135230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:26:56.135230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:26:56.135230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 85/166] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:26:56.135959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7e2d1-4000-4675-b30d-a19d65d2ebaa None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:56.135959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7e2d1-4000-4675-b30d-a19d65d2ebaa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:56.136309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7e2d1-4000-4675-b30d-a19d65d2ebaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:56.179802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-99e7e2d1-4000-4675-b30d-a19d65d2ebaa None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:56.181011 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-99e7e2d1-4000-4675-b30d-a19d65d2ebaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:56.292841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b96a69-19c9-4e33-bc6a-a781adcd0537 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:56.315308 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 86/167] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:56.316057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7e2d1-4000-4675-b30d-a19d65d2ebaa None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:56.347141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36224d91-a073-430f-8f72-c9684608b1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:56.348017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36224d91-a073-430f-8f72-c9684608b1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:56.348299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36224d91-a073-430f-8f72-c9684608b1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:56.348573 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36224d91-a073-430f-8f72-c9684608b1e0 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:56.350585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36224d91-a073-430f-8f72-c9684608b1e0 None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:56.352038 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36224d91-a073-430f-8f72-c9684608b1e0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:56.354131 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 82/168] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:56 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:56.360569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36224d91-a073-430f-8f72-c9684608b1e0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:56.363945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:56.443988 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7e2d1-4000-4675-b30d-a19d65d2ebaa None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:56.474819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:56.479970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69429a-6548-4b9d-99ac-91f51760d3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:56.480907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69429a-6548-4b9d-99ac-91f51760d3ca None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:56.481390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69429a-6548-4b9d-99ac-91f51760d3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:56.481913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b69429a-6548-4b9d-99ac-91f51760d3ca None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:56.482910 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69429a-6548-4b9d-99ac-91f51760d3ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:56.483947 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69429a-6548-4b9d-99ac-91f51760d3ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:56.485555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b69429a-6548-4b9d-99ac-91f51760d3ca None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:56.494346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 87/169] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:26:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:56.496810 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69429a-6548-4b9d-99ac-91f51760d3ca None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:56.532753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36224d91-a073-430f-8f72-c9684608b1e0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:56.586415 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97054309-9a8c-49f1-addc-b76e20053434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:56.587609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97054309-9a8c-49f1-addc-b76e20053434 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:56.587893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97054309-9a8c-49f1-addc-b76e20053434 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:56.588237 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97054309-9a8c-49f1-addc-b76e20053434 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d/users/5249bdd5a8c44702b0bcf30916f92884/roles/37c1e273f187464f842780ff08196d0c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:56.591296 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97054309-9a8c-49f1-addc-b76e20053434 None admin] RBAC: Authorizing `identity:create_grant(project_id=6020d15ded71492c8adbc59366b3f07d, user_id=5249bdd5a8c44702b0bcf30916f92884, role_id=37c1e273f187464f842780ff08196d0c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:56.592791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97054309-9a8c-49f1-addc-b76e20053434 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:56.640454 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:56.655962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b69429a-6548-4b9d-99ac-91f51760d3ca None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:56.683433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 83/170] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:26:56 2022] PUT /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d/users/5249bdd5a8c44702b0bcf30916f92884/roles/37c1e273f187464f842780ff08196d0c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:26:56.684367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97054309-9a8c-49f1-addc-b76e20053434 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:56.740553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dd13e-29f2-44c9-baee-44e197891e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:56.741300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dd13e-29f2-44c9-baee-44e197891e23 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:56.741582 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dd13e-29f2-44c9-baee-44e197891e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:56.743426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9dd13e-29f2-44c9-baee-44e197891e23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:56.772072 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9dd13e-29f2-44c9-baee-44e197891e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-2f9dd13e-29f2-44c9-baee-44e197891e23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:56.788057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:56.789116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:56.789974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:56.789974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:56.789974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:56.789974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:56.789974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:56.789974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:56.789974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:56.789974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:56.789974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:56.789974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:56.789974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:26:56.789974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:26:56.793772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 88/171] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:26:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:26:56.800339 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dd13e-29f2-44c9-baee-44e197891e23 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:56.956278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97054309-9a8c-49f1-addc-b76e20053434 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:56.985355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:57.008477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9dd13e-29f2-44c9-baee-44e197891e23 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:57.023438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805a16a-391c-4fe5-afca-c2ccd504f96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:57.024320 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805a16a-391c-4fe5-afca-c2ccd504f96f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:57.024604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805a16a-391c-4fe5-afca-c2ccd504f96f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:57.024881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805a16a-391c-4fe5-afca-c2ccd504f96f None admin] PATH_INFO: `/v3/users/35d4d449311544628df57904899e79de` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:57.027538 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805a16a-391c-4fe5-afca-c2ccd504f96f None admin] RBAC: Authorizing `identity:get_user(user_id=35d4d449311544628df57904899e79de)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:57.028993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805a16a-391c-4fe5-afca-c2ccd504f96f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:57.031113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 84/172] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:56 2022] GET /identity/v3/users/35d4d449311544628df57904899e79de => generated 275 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:57.036778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805a16a-391c-4fe5-afca-c2ccd504f96f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:57.089745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5c8cd-a2c5-4ec7-9a2d-f68dc2ba387f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:57.089745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5c8cd-a2c5-4ec7-9a2d-f68dc2ba387f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:57.089745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5c8cd-a2c5-4ec7-9a2d-f68dc2ba387f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:57.089745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5c8cd-a2c5-4ec7-9a2d-f68dc2ba387f None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:57.090104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5c8cd-a2c5-4ec7-9a2d-f68dc2ba387f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:57.090104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5c8cd-a2c5-4ec7-9a2d-f68dc2ba387f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:57.090550 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5c8cd-a2c5-4ec7-9a2d-f68dc2ba387f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:57.104614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 89/173] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:26:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:57.110069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5c8cd-a2c5-4ec7-9a2d-f68dc2ba387f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:57.126252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:57.217558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805a16a-391c-4fe5-afca-c2ccd504f96f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:57.294143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5c8cd-a2c5-4ec7-9a2d-f68dc2ba387f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:57.296678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2991d719-7019-451b-8da4-32567badfc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:57.297334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991d719-7019-451b-8da4-32567badfc88 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:57.297615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991d719-7019-451b-8da4-32567badfc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:57.297933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2991d719-7019-451b-8da4-32567badfc88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:57.362479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d62f14-1978-4992-86dd-e02e78be9df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:57.363384 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d62f14-1978-4992-86dd-e02e78be9df5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:57.363670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d62f14-1978-4992-86dd-e02e78be9df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:57.363951 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d62f14-1978-4992-86dd-e02e78be9df5 None admin] PATH_INFO: `/v3/users/35d4d449311544628df57904899e79de` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:57.365242 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d62f14-1978-4992-86dd-e02e78be9df5 None admin] RBAC: Authorizing `identity:get_user(user_id=35d4d449311544628df57904899e79de)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:57.366730 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d62f14-1978-4992-86dd-e02e78be9df5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:57.368393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 90/174] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:57 2022] GET /identity/v3/users/35d4d449311544628df57904899e79de => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:57.369601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1674936-b938-48fd-a8b3-24215a11b1c7 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:57.369915 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1674936-b938-48fd-a8b3-24215a11b1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:57.370194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1674936-b938-48fd-a8b3-24215a11b1c7 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:57.371595 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 91/175] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:57.375270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:57.378742 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1674936-b938-48fd-a8b3-24215a11b1c7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:57.394059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991d719-7019-451b-8da4-32567badfc88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:57.396049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2991d719-7019-451b-8da4-32567badfc88 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:57.506870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 85/176] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:26:57.508711 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e83d2-6cf4-438b-8331-a62e61fcef56 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:57.509222 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e83d2-6cf4-438b-8331-a62e61fcef56 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:57.509709 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e83d2-6cf4-438b-8331-a62e61fcef56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:57.527410 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f66e83d2-6cf4-438b-8331-a62e61fcef56 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:57.529000 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f66e83d2-6cf4-438b-8331-a62e61fcef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:57.580350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:57.605392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 86/177] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:57.606702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e83d2-6cf4-438b-8331-a62e61fcef56 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:57.625716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:57.635573 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1674936-b938-48fd-a8b3-24215a11b1c7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:57.722507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc0435-fdc8-4687-91fd-706c2c03029c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:57.723286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc0435-fdc8-4687-91fd-706c2c03029c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:57.723577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc0435-fdc8-4687-91fd-706c2c03029c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:57.723855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc0435-fdc8-4687-91fd-706c2c03029c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:57.734634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e83d2-6cf4-438b-8331-a62e61fcef56 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:57.773887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9c58a-b0d4-42f6-904f-572ce3b3bab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:57.775263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c58a-b0d4-42f6-904f-572ce3b3bab4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:57.775780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c58a-b0d4-42f6-904f-572ce3b3bab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:57.776265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c58a-b0d4-42f6-904f-572ce3b3bab4 None admin] PATH_INFO: `/v3/projects/a07bb472596842e3b2f9477f55b54ce0` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:57.777801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9c58a-b0d4-42f6-904f-572ce3b3bab4 None admin] RBAC: Authorizing `identity:get_project(project_id=a07bb472596842e3b2f9477f55b54ce0)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:57.779542 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d9c58a-b0d4-42f6-904f-572ce3b3bab4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:57.781891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 87/178] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:57 2022] GET /identity/v3/projects/a07bb472596842e3b2f9477f55b54ce0 => generated 312 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:57.782896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9c58a-b0d4-42f6-904f-572ce3b3bab4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:57.820349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc0435-fdc8-4687-91fd-706c2c03029c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:57.821849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc0435-fdc8-4687-91fd-706c2c03029c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:57.876207 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:57.898584 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9c58a-b0d4-42f6-904f-572ce3b3bab4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:57.904480 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:57.936401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691985ed-2f18-42a1-b8b4-701d6a2196ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:57.937848 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691985ed-2f18-42a1-b8b4-701d6a2196ca None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:57.938225 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691985ed-2f18-42a1-b8b4-701d6a2196ca None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:57.938521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691985ed-2f18-42a1-b8b4-701d6a2196ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:57.941793 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 92/179] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:26:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:26:57.943437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42b7e4-89e1-4022-8ae0-5df737a038f3 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:57.943956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42b7e4-89e1-4022-8ae0-5df737a038f3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:57.944457 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf42b7e4-89e1-4022-8ae0-5df737a038f3 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:57.946059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 93/180] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:57.946975 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42b7e4-89e1-4022-8ae0-5df737a038f3 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:57.959279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691985ed-2f18-42a1-b8b4-701d6a2196ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-691985ed-2f18-42a1-b8b4-701d6a2196ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:57.967119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:57.968191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:57.969063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:57.969063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:57.969063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:57.969063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:57.969063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:57.969063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:57.969063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:57.969063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:57.969063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:57.969063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:57.969063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:26:57.969063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:26:57.969063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 88/181] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:26:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:26:57.973932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691985ed-2f18-42a1-b8b4-701d6a2196ca None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:58.059548 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf42b7e4-89e1-4022-8ae0-5df737a038f3 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:58.087235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691985ed-2f18-42a1-b8b4-701d6a2196ca None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:58.097678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f55aa-425e-4d5c-bc02-8137956e23ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:58.098368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f55aa-425e-4d5c-bc02-8137956e23ab None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:58.098654 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f55aa-425e-4d5c-bc02-8137956e23ab None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:58.098936 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f55aa-425e-4d5c-bc02-8137956e23ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:58.099777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f55aa-425e-4d5c-bc02-8137956e23ab None admin] RBAC: Adding query filter params (role.id=2749d7dcfd844991883fa3f4e90ed75c, scope.project.id=a07bb472596842e3b2f9477f55b54ce0, user.id=35d4d449311544628df57904899e79de) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:58.100090 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f55aa-425e-4d5c-bc02-8137956e23ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:58.101543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f55aa-425e-4d5c-bc02-8137956e23ab None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:58.107644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 94/182] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:26:57 2022] GET /identity/v3/role_assignments?user.id=35d4d449311544628df57904899e79de&scope.project.id=a07bb472596842e3b2f9477f55b54ce0&role.id=2749d7dcfd844991883fa3f4e90ed75c => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:58.111056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0774-4a7f-41ba-9d6b-5b7b62d57642 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:58.114875 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0774-4a7f-41ba-9d6b-5b7b62d57642 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:58.115234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0774-4a7f-41ba-9d6b-5b7b62d57642 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:58.117200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 95/183] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:58.119476 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2994d9-7caa-455c-b278-4798d05bbe38 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:58.119834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2994d9-7caa-455c-b278-4798d05bbe38 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:58.120176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2994d9-7caa-455c-b278-4798d05bbe38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:58.138193 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3d109-997e-4e46-851c-3eeb731aa821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:58.139400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3d109-997e-4e46-851c-3eeb731aa821 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:58.140527 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3d109-997e-4e46-851c-3eeb731aa821 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:58.141010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3d109-997e-4e46-851c-3eeb731aa821 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:58.142577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7d2994d9-7caa-455c-b278-4798d05bbe38 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:58.143146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3d109-997e-4e46-851c-3eeb731aa821 None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:58.144046 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7d2994d9-7caa-455c-b278-4798d05bbe38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:58.145104 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a3d109-997e-4e46-851c-3eeb731aa821 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:58.147469 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 89/184] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:57 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:58.149494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3d109-997e-4e46-851c-3eeb731aa821 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:58.169766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:58.193258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:58.242860 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 96/185] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:58.244539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2711-0d5c-4dea-a4e5-abfacf629120 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:58.245042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2711-0d5c-4dea-a4e5-abfacf629120 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:58.245541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2711-0d5c-4dea-a4e5-abfacf629120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:58.265852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-361d2711-0d5c-4dea-a4e5-abfacf629120 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:58.267435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-361d2711-0d5c-4dea-a4e5-abfacf629120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:58.296032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3d109-997e-4e46-851c-3eeb731aa821 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:58.369851 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 97/186] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:58.369851 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d2711-0d5c-4dea-a4e5-abfacf629120 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:58.378417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ea053-9c83-4091-82d6-b02c2d3a1c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:58.379124 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ea053-9c83-4091-82d6-b02c2d3a1c47 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:58.379411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ea053-9c83-4091-82d6-b02c2d3a1c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:58.379693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ea053-9c83-4091-82d6-b02c2d3a1c47 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:58.380470 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ea053-9c83-4091-82d6-b02c2d3a1c47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:58.380786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ea053-9c83-4091-82d6-b02c2d3a1c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:58.382363 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ea053-9c83-4091-82d6-b02c2d3a1c47 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:58.393832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 90/187] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:58.395015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ea053-9c83-4091-82d6-b02c2d3a1c47 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:58.492679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:58.512499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:58.517287 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d2711-0d5c-4dea-a4e5-abfacf629120 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:58.538970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ea053-9c83-4091-82d6-b02c2d3a1c47 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:58.560377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3df52-cb98-4a2f-bcb2-b08c2310f184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:58.561190 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3df52-cb98-4a2f-bcb2-b08c2310f184 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:58.561611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3df52-cb98-4a2f-bcb2-b08c2310f184 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:58.562066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac3df52-cb98-4a2f-bcb2-b08c2310f184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:58.563158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3df52-cb98-4a2f-bcb2-b08c2310f184 None admin] RBAC: Adding query filter params (role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48, scope.project.id=6020d15ded71492c8adbc59366b3f07d, user.id=35d4d449311544628df57904899e79de) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:58.563582 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3df52-cb98-4a2f-bcb2-b08c2310f184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:58.565252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac3df52-cb98-4a2f-bcb2-b08c2310f184 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:58.571870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 98/188] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:26:58 2022] GET /identity/v3/role_assignments?user.id=35d4d449311544628df57904899e79de&scope.project.id=6020d15ded71492c8adbc59366b3f07d&role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:58.572849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3df52-cb98-4a2f-bcb2-b08c2310f184 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:58.593311 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db5635-3eb8-42f8-904d-5781b8efa255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:58.595050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db5635-3eb8-42f8-904d-5781b8efa255 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:58.597955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db5635-3eb8-42f8-904d-5781b8efa255 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:58.602022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db5635-3eb8-42f8-904d-5781b8efa255 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:58.602022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db5635-3eb8-42f8-904d-5781b8efa255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:58.602022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2db5635-3eb8-42f8-904d-5781b8efa255 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:58.606976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 91/189] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:26:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:58.607875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db5635-3eb8-42f8-904d-5781b8efa255 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:58.706062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac3df52-cb98-4a2f-bcb2-b08c2310f184 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:58.744636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c8655-caa4-4fbc-b878-bba2704bc17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:58.745529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c8655-caa4-4fbc-b878-bba2704bc17f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:58.745854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c8655-caa4-4fbc-b878-bba2704bc17f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:58.746133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c8655-caa4-4fbc-b878-bba2704bc17f None admin] PATH_INFO: `/v3/users/be627fbeab8e406b84cdc27a2c105f33` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:58.768573 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c8655-caa4-4fbc-b878-bba2704bc17f None admin] RBAC: Authorizing `identity:get_user(user_id=be627fbeab8e406b84cdc27a2c105f33)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:58.770105 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c8655-caa4-4fbc-b878-bba2704bc17f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:58.771865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 99/190] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:58 2022] GET /identity/v3/users/be627fbeab8e406b84cdc27a2c105f33 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:58.772623 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c8655-caa4-4fbc-b878-bba2704bc17f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:58.807780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:58.812122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db5635-3eb8-42f8-904d-5781b8efa255 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:58.872101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b2c08-6f9d-4c95-a430-ebbc6abcb838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:58.873038 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b2c08-6f9d-4c95-a430-ebbc6abcb838 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:58.873324 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b2c08-6f9d-4c95-a430-ebbc6abcb838 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:58.873604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b2c08-6f9d-4c95-a430-ebbc6abcb838 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:58.882316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:58.886761 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b2c08-6f9d-4c95-a430-ebbc6abcb838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-2f9b2c08-6f9d-4c95-a430-ebbc6abcb838 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:58.897066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:58.898034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:58.903977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:58.903977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:58.903977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:58.903977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:58.903977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:58.903977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:58.903977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:58.903977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:58.903977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:58.903977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:58.903977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:26:58.903977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:26:58.903977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 92/191] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:26:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:26:58.903977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b2c08-6f9d-4c95-a430-ebbc6abcb838 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:58.911479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c8655-caa4-4fbc-b878-bba2704bc17f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:58.948021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14db47-4632-44b4-98ad-e391060bff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:58.948708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14db47-4632-44b4-98ad-e391060bff8d None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:58.948992 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14db47-4632-44b4-98ad-e391060bff8d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:58.949269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc14db47-4632-44b4-98ad-e391060bff8d None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:58.950117 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14db47-4632-44b4-98ad-e391060bff8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:58.951476 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc14db47-4632-44b4-98ad-e391060bff8d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:59.008260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b2c08-6f9d-4c95-a430-ebbc6abcb838 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:59.042202 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf43ca9-6eb8-45ec-84a4-60ff1826a986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:59.042854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43ca9-6eb8-45ec-84a4-60ff1826a986 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:59.043140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43ca9-6eb8-45ec-84a4-60ff1826a986 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:59.043504 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43ca9-6eb8-45ec-84a4-60ff1826a986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:59.061469 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 100/192] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:26:58 2022] POST /identity/v3/users => generated 297 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:26:59.062838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14db47-4632-44b4-98ad-e391060bff8d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:59.143321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:59.146504 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf43ca9-6eb8-45ec-84a4-60ff1826a986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:59.148160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf43ca9-6eb8-45ec-84a4-60ff1826a986 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:59.183431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:59.209146 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc14db47-4632-44b4-98ad-e391060bff8d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:59.251811 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb8c6c-28b7-46fa-8725-1dd264d02464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:59.252869 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb8c6c-28b7-46fa-8725-1dd264d02464 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:59.253436 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb8c6c-28b7-46fa-8725-1dd264d02464 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:59.253962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb8c6c-28b7-46fa-8725-1dd264d02464 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:59.254989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb8c6c-28b7-46fa-8725-1dd264d02464 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:59.255695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb8c6c-28b7-46fa-8725-1dd264d02464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:59.257452 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb8c6c-28b7-46fa-8725-1dd264d02464 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:59.268899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 101/193] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:26:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:59.274534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb8c6c-28b7-46fa-8725-1dd264d02464 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:59.287412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 93/194] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:26:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:26:59.293192 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf43ca9-6eb8-45ec-84a4-60ff1826a986 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:59.397963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb8c6c-28b7-46fa-8725-1dd264d02464 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:59.427190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:59.431874 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf43ca9-6eb8-45ec-84a4-60ff1826a986 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:59.445970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56bb649-5328-4eca-a923-d33cbc29a5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:59.449748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bb649-5328-4eca-a923-d33cbc29a5aa None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:59.449748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bb649-5328-4eca-a923-d33cbc29a5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:59.449748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56bb649-5328-4eca-a923-d33cbc29a5aa None admin] PATH_INFO: `/v3/users/be627fbeab8e406b84cdc27a2c105f33` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:59.449748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bb649-5328-4eca-a923-d33cbc29a5aa None admin] RBAC: Authorizing `identity:get_user(user_id=be627fbeab8e406b84cdc27a2c105f33)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:59.450245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56bb649-5328-4eca-a923-d33cbc29a5aa None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:59.452139 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 102/195] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:26:59 2022] GET /identity/v3/users/be627fbeab8e406b84cdc27a2c105f33 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:59.453449 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bf1ed-2da4-4d89-860c-4e367ebf6e83 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:59.453756 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bf1ed-2da4-4d89-860c-4e367ebf6e83 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:59.458157 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bf1ed-2da4-4d89-860c-4e367ebf6e83 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:59.459618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 103/196] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:26:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:26:59.460880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bf1ed-2da4-4d89-860c-4e367ebf6e83 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:59.472312 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:59.477881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b651c91-831e-4873-826c-2c192ea7ce41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:59.479015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b651c91-831e-4873-826c-2c192ea7ce41 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:59.479466 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b651c91-831e-4873-826c-2c192ea7ce41 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:59.479906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b651c91-831e-4873-826c-2c192ea7ce41 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:59.481353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b651c91-831e-4873-826c-2c192ea7ce41 None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:59.483118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b651c91-831e-4873-826c-2c192ea7ce41 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:59.485890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 94/197] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:59 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:26:59.487401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a87a0-dd3e-48dd-b7c2-f4b0ca02e480 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:59.487891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a87a0-dd3e-48dd-b7c2-f4b0ca02e480 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:59.488348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a87a0-dd3e-48dd-b7c2-f4b0ca02e480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:59.508780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6a8a87a0-dd3e-48dd-b7c2-f4b0ca02e480 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:26:59.510741 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6a8a87a0-dd3e-48dd-b7c2-f4b0ca02e480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:26:59.595398 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bf1ed-2da4-4d89-860c-4e367ebf6e83 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:59.598154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 95/198] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:26:59.599879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a87a0-dd3e-48dd-b7c2-f4b0ca02e480 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:59.643375 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e834a-6c95-417d-9793-66485ee60f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:59.645034 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e834a-6c95-417d-9793-66485ee60f21 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:59.645686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e834a-6c95-417d-9793-66485ee60f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:59.646191 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e834a-6c95-417d-9793-66485ee60f21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:59.710362 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:59.714565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a87a0-dd3e-48dd-b7c2-f4b0ca02e480 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:59.737065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e834a-6c95-417d-9793-66485ee60f21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:59.738733 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e834a-6c95-417d-9793-66485ee60f21 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:59.751298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:26:59.758511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217f5ae-78d6-483a-ad39-c294d0e60451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:59.759270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f5ae-78d6-483a-ad39-c294d0e60451 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:59.759633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f5ae-78d6-483a-ad39-c294d0e60451 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:59.759986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f5ae-78d6-483a-ad39-c294d0e60451 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:59.760847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217f5ae-78d6-483a-ad39-c294d0e60451 None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=e6537af9fe7a48c5890955b7c03e22c2, user.id=be627fbeab8e406b84cdc27a2c105f33) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:26:59.761166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217f5ae-78d6-483a-ad39-c294d0e60451 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:26:59.762802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217f5ae-78d6-483a-ad39-c294d0e60451 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:26:59.775275 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 96/199] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:26:59 2022] GET /identity/v3/role_assignments?user.id=be627fbeab8e406b84cdc27a2c105f33&scope.project.id=e6537af9fe7a48c5890955b7c03e22c2&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:26:59.775275 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217f5ae-78d6-483a-ad39-c294d0e60451 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:59.890226 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217f5ae-78d6-483a-ad39-c294d0e60451 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:26:59.931110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f0961-70e7-4a3e-b457-2d9c1ac505a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:26:59.931936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f0961-70e7-4a3e-b457-2d9c1ac505a2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:26:59.932221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f0961-70e7-4a3e-b457-2d9c1ac505a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:26:59.932500 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f0961-70e7-4a3e-b457-2d9c1ac505a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:26:59.945061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f0961-70e7-4a3e-b457-2d9c1ac505a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-543f0961-70e7-4a3e-b457-2d9c1ac505a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:26:59.953352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:26:59.954322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:26:59.955146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:26:59.955146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:26:59.955146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:26:59.955146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:26:59.955146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:26:59.955146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:26:59.955146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:26:59.955146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:26:59.955146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:26:59.955146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:26:59.955146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:26:59.955146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:26:59.955146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 97/200] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:26:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:26:59.955806 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 104/201] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:26:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 22:26:59.962779 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f0961-70e7-4a3e-b457-2d9c1ac505a2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:59.962934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e834a-6c95-417d-9793-66485ee60f21 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:26:59.997555 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:00.121879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f0961-70e7-4a3e-b457-2d9c1ac505a2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:00.177627 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e834a-6c95-417d-9793-66485ee60f21 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:00.195094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fe4c3-d39b-4043-b198-12b0a31cba30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:00.196092 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fe4c3-d39b-4043-b198-12b0a31cba30 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:00.196595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fe4c3-d39b-4043-b198-12b0a31cba30 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:00.197085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fe4c3-d39b-4043-b198-12b0a31cba30 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:00.198045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:00.198172 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fe4c3-d39b-4043-b198-12b0a31cba30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:00.198383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fe4c3-d39b-4043-b198-12b0a31cba30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:00.202297 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fe4c3-d39b-4043-b198-12b0a31cba30 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:00.221422 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 98/202] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:26:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:00.230369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea66fd6-9e50-4a96-b7ad-94774fc9d5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:00.230676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fe4c3-d39b-4043-b198-12b0a31cba30 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:00.231245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea66fd6-9e50-4a96-b7ad-94774fc9d5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:00.231646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea66fd6-9e50-4a96-b7ad-94774fc9d5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:00.231924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea66fd6-9e50-4a96-b7ad-94774fc9d5f6 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:00.233126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea66fd6-9e50-4a96-b7ad-94774fc9d5f6 None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:00.235300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea66fd6-9e50-4a96-b7ad-94774fc9d5f6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:00.237359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 105/203] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:26:59 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:00.246702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea66fd6-9e50-4a96-b7ad-94774fc9d5f6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:00.330122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:00.342316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fe4c3-d39b-4043-b198-12b0a31cba30 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:00.382066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02f4bf-e389-4e59-b780-c72838f90bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:00.383062 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f4bf-e389-4e59-b780-c72838f90bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:00.383352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f4bf-e389-4e59-b780-c72838f90bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:00.383651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02f4bf-e389-4e59-b780-c72838f90bc9 None admin] PATH_INFO: `/v3/users/5249bdd5a8c44702b0bcf30916f92884` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:00.385083 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02f4bf-e389-4e59-b780-c72838f90bc9 None admin] RBAC: Authorizing `identity:get_user(user_id=5249bdd5a8c44702b0bcf30916f92884)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:00.386660 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02f4bf-e389-4e59-b780-c72838f90bc9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:00.388786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 99/204] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:00 2022] GET /identity/v3/users/5249bdd5a8c44702b0bcf30916f92884 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:00.389376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea66fd6-9e50-4a96-b7ad-94774fc9d5f6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:00.395137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02f4bf-e389-4e59-b780-c72838f90bc9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:00.508073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02f4bf-e389-4e59-b780-c72838f90bc9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:00.512495 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a9a4e-4cff-4c1c-8d17-dad2890358fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:00.513290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a9a4e-4cff-4c1c-8d17-dad2890358fc None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:00.513577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a9a4e-4cff-4c1c-8d17-dad2890358fc None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:00.513919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56a9a4e-4cff-4c1c-8d17-dad2890358fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:00.515384 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a9a4e-4cff-4c1c-8d17-dad2890358fc None admin] RBAC: Adding query filter params (role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48, scope.project.id=e6537af9fe7a48c5890955b7c03e22c2, user.id=be627fbeab8e406b84cdc27a2c105f33) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:00.515707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a9a4e-4cff-4c1c-8d17-dad2890358fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:00.517182 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56a9a4e-4cff-4c1c-8d17-dad2890358fc None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:00.539982 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 106/205] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:00 2022] GET /identity/v3/role_assignments?user.id=be627fbeab8e406b84cdc27a2c105f33&scope.project.id=e6537af9fe7a48c5890955b7c03e22c2&role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:00.544666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa6609-01b3-4bf9-98e7-43984a69b2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:00.545347 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa6609-01b3-4bf9-98e7-43984a69b2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:00.545635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa6609-01b3-4bf9-98e7-43984a69b2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:00.546011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aa6609-01b3-4bf9-98e7-43984a69b2e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:00.610412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:00.625249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa6609-01b3-4bf9-98e7-43984a69b2e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:00.627053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1aa6609-01b3-4bf9-98e7-43984a69b2e8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:00.745042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 100/206] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:00.746542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a9a4e-4cff-4c1c-8d17-dad2890358fc None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:00.818536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:00.892856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56a9a4e-4cff-4c1c-8d17-dad2890358fc None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:00.931123 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e9cd0-25ef-4120-b3dc-18a2c9389f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:00.932049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e9cd0-25ef-4120-b3dc-18a2c9389f06 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:00.932379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e9cd0-25ef-4120-b3dc-18a2c9389f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:00.932660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e9cd0-25ef-4120-b3dc-18a2c9389f06 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:00.933892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e9cd0-25ef-4120-b3dc-18a2c9389f06 None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:00.935337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e9cd0-25ef-4120-b3dc-18a2c9389f06 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:00.938206 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 107/207] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:00 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:00.946244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa6609-01b3-4bf9-98e7-43984a69b2e8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:01.021131 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:01.075554 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1aa6609-01b3-4bf9-98e7-43984a69b2e8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:01.112234 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0119e-4414-403c-b458-1cf9b33417bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:01.112912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0119e-4414-403c-b458-1cf9b33417bd None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:01.113201 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0119e-4414-403c-b458-1cf9b33417bd None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:01.113483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0119e-4414-403c-b458-1cf9b33417bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:01.114376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0119e-4414-403c-b458-1cf9b33417bd None admin] RBAC: Adding query filter params (role.id=37c1e273f187464f842780ff08196d0c, scope.project.id=6020d15ded71492c8adbc59366b3f07d, user.id=5249bdd5a8c44702b0bcf30916f92884) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:01.114693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0119e-4414-403c-b458-1cf9b33417bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:01.116150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0119e-4414-403c-b458-1cf9b33417bd None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:01.122558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 101/208] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:00 2022] GET /identity/v3/role_assignments?user.id=5249bdd5a8c44702b0bcf30916f92884&scope.project.id=6020d15ded71492c8adbc59366b3f07d&role.id=37c1e273f187464f842780ff08196d0c => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:01.555892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d9538-22de-4d72-b7df-e5b3a9a7f00a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:01.556424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d9538-22de-4d72-b7df-e5b3a9a7f00a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:01.556512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d9538-22de-4d72-b7df-e5b3a9a7f00a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:01.557863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 108/209] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:01.564365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d489fb6-d468-472e-8364-96c02cf94e15 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:01.564925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d489fb6-d468-472e-8364-96c02cf94e15 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:01.565500 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d489fb6-d468-472e-8364-96c02cf94e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:01.585756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-9d489fb6-d468-472e-8364-96c02cf94e15 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:01.587308 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9d489fb6-d468-472e-8364-96c02cf94e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:01.669098 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 102/210] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:01.694058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d9538-22de-4d72-b7df-e5b3a9a7f00a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:01.810457 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d9538-22de-4d72-b7df-e5b3a9a7f00a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:01.813674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3c70a-b56c-4eb6-a74e-80ab888e9760 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:01.813994 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3c70a-b56c-4eb6-a74e-80ab888e9760 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:01.814277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3c70a-b56c-4eb6-a74e-80ab888e9760 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:01.815831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 103/211] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:27:01.821099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e123d-b282-4aa2-8634-16918064170b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:01.821663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e123d-b282-4aa2-8634-16918064170b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:01.822190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822e123d-b282-4aa2-8634-16918064170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:01.826013 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:01.842945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-822e123d-b282-4aa2-8634-16918064170b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:01.845059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-822e123d-b282-4aa2-8634-16918064170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:01.850499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8094559-8581-4eff-aa93-8c8cde2f91aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:01.851397 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8094559-8581-4eff-aa93-8c8cde2f91aa None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:01.851756 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8094559-8581-4eff-aa93-8c8cde2f91aa None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:01.852105 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8094559-8581-4eff-aa93-8c8cde2f91aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:01.867436 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8094559-8581-4eff-aa93-8c8cde2f91aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c8094559-8581-4eff-aa93-8c8cde2f91aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:01.878341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:01.879272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:01.880118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:01.880118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:01.880118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:01.880118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:01.880118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:01.880118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:01.880118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:01.880118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:01.880118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:01.880118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:01.880118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:01.880118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:01.880118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 109/212] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:01.886088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8094559-8581-4eff-aa93-8c8cde2f91aa None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:01.905439 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:01.945763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 104/213] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:27:01.964340 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e123d-b282-4aa2-8634-16918064170b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:02.019444 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8094559-8581-4eff-aa93-8c8cde2f91aa None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:02.056739 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bbcb8-7d8c-423f-8fc7-0f42d8e56dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:02.057899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bbcb8-7d8c-423f-8fc7-0f42d8e56dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:02.058438 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bbcb8-7d8c-423f-8fc7-0f42d8e56dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:02.059058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bbcb8-7d8c-423f-8fc7-0f42d8e56dc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:02.060012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bbcb8-7d8c-423f-8fc7-0f42d8e56dc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:02.060614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bbcb8-7d8c-423f-8fc7-0f42d8e56dc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:02.063201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bbcb8-7d8c-423f-8fc7-0f42d8e56dc6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:02.080705 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 110/214] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:02.082055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bbcb8-7d8c-423f-8fc7-0f42d8e56dc6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:02.091584 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822e123d-b282-4aa2-8634-16918064170b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:02.123606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:02.137924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9334e6a-4bf5-4f29-9594-2cfa5e2f48c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:02.139619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9334e6a-4bf5-4f29-9594-2cfa5e2f48c9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:02.140168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9334e6a-4bf5-4f29-9594-2cfa5e2f48c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:02.140622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9334e6a-4bf5-4f29-9594-2cfa5e2f48c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:02.142760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9334e6a-4bf5-4f29-9594-2cfa5e2f48c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:02.145063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9334e6a-4bf5-4f29-9594-2cfa5e2f48c9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:02.147447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 105/215] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:02.155785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9334e6a-4bf5-4f29-9594-2cfa5e2f48c9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:02.207458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bbcb8-7d8c-423f-8fc7-0f42d8e56dc6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:02.214908 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:02.244236 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33f9530-5b4f-4d56-be14-5538db3d487a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:02.245220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f9530-5b4f-4d56-be14-5538db3d487a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:02.245555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f9530-5b4f-4d56-be14-5538db3d487a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:02.245864 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33f9530-5b4f-4d56-be14-5538db3d487a None admin] PATH_INFO: `/v3/users/f7e7efeee8b04063a63219e88355c758` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:02.259935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f9530-5b4f-4d56-be14-5538db3d487a None admin] RBAC: Authorizing `identity:get_user(user_id=f7e7efeee8b04063a63219e88355c758)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:02.261399 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33f9530-5b4f-4d56-be14-5538db3d487a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:02.263686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 111/216] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:02 2022] GET /identity/v3/users/f7e7efeee8b04063a63219e88355c758 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:02.269028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5caeb9-b656-41cb-b2b9-e934b1e34c0f None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:02.269319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5caeb9-b656-41cb-b2b9-e934b1e34c0f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:02.269602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5caeb9-b656-41cb-b2b9-e934b1e34c0f None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:02.275008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 112/217] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:02.275008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5caeb9-b656-41cb-b2b9-e934b1e34c0f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:02.277315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9334e6a-4bf5-4f29-9594-2cfa5e2f48c9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:02.314228 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc6c9e-b247-4248-838d-28cc392d9528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:02.314836 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc6c9e-b247-4248-838d-28cc392d9528 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:02.315119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc6c9e-b247-4248-838d-28cc392d9528 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:02.315398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc6c9e-b247-4248-838d-28cc392d9528 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:02.316150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc6c9e-b247-4248-838d-28cc392d9528 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:02.317639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc6c9e-b247-4248-838d-28cc392d9528 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:02.370372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:02.382948 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5caeb9-b656-41cb-b2b9-e934b1e34c0f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:02.414293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 106/218] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:27:02 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:27:02.415802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc499ce4-be0b-4f1d-81d9-c06845ff0a09 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:02.416438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc499ce4-be0b-4f1d-81d9-c06845ff0a09 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:02.416612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc499ce4-be0b-4f1d-81d9-c06845ff0a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:02.425414 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac3c9a-7eb5-43c1-b072-96ce26293bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:02.426594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac3c9a-7eb5-43c1-b072-96ce26293bfc None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:02.427080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac3c9a-7eb5-43c1-b072-96ce26293bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:02.427629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac3c9a-7eb5-43c1-b072-96ce26293bfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:02.439498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bc499ce4-be0b-4f1d-81d9-c06845ff0a09 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:02.441071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bc499ce4-be0b-4f1d-81d9-c06845ff0a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:02.509140 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac3c9a-7eb5-43c1-b072-96ce26293bfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:02.510834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac3c9a-7eb5-43c1-b072-96ce26293bfc None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:02.526745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 107/219] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:02.555881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc499ce4-be0b-4f1d-81d9-c06845ff0a09 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:02.591946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:02.622232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:02.645318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 113/220] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:02.652585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac3c9a-7eb5-43c1-b072-96ce26293bfc None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:02.679574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc499ce4-be0b-4f1d-81d9-c06845ff0a09 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:02.730375 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07413e1-d869-4c6c-a295-34beefc7ba3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:02.731282 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07413e1-d869-4c6c-a295-34beefc7ba3b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:02.732496 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07413e1-d869-4c6c-a295-34beefc7ba3b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:02.732855 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07413e1-d869-4c6c-a295-34beefc7ba3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:02.746789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07413e1-d869-4c6c-a295-34beefc7ba3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e07413e1-d869-4c6c-a295-34beefc7ba3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:02.754698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:02.756067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:02.756928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:02.756928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:02.756928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:02.756928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:02.756928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:02.756928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:02.756928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:02.756928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:02.756928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:02.756928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:02.756928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:27:02.756928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:02.756928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 108/221] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:27:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:02.763915 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07413e1-d869-4c6c-a295-34beefc7ba3b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:02.795609 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac3c9a-7eb5-43c1-b072-96ce26293bfc None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:02.840752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab3d44-1cae-481b-9843-e5a3be105696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:02.841636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3d44-1cae-481b-9843-e5a3be105696 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:02.842001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3d44-1cae-481b-9843-e5a3be105696 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:02.842237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab3d44-1cae-481b-9843-e5a3be105696 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:02.844904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab3d44-1cae-481b-9843-e5a3be105696 None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:02.846434 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab3d44-1cae-481b-9843-e5a3be105696 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:02.849271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 114/222] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:02 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:02.856563 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab3d44-1cae-481b-9843-e5a3be105696 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:02.887227 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:02.897741 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07413e1-d869-4c6c-a295-34beefc7ba3b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:02.932921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:02.934216 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e0e53-e568-4542-9239-7271a228d90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:02.934977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e0e53-e568-4542-9239-7271a228d90a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:02.935335 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e0e53-e568-4542-9239-7271a228d90a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:02.935695 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e0e53-e568-4542-9239-7271a228d90a None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:02.937101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e0e53-e568-4542-9239-7271a228d90a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:02.937496 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e0e53-e568-4542-9239-7271a228d90a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:02.939007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e0e53-e568-4542-9239-7271a228d90a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:02.948278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 109/223] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:02.955612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26020d-b80b-41e4-8c84-1a9128724ba9 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:02.955913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26020d-b80b-41e4-8c84-1a9128724ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:02.956201 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26020d-b80b-41e4-8c84-1a9128724ba9 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:02.957589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 110/224] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:02.958339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26020d-b80b-41e4-8c84-1a9128724ba9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:02.992908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab3d44-1cae-481b-9843-e5a3be105696 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:03.042692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b69214-6ed3-4d9c-bcf0-b255f9d79c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:03.044310 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b69214-6ed3-4d9c-bcf0-b255f9d79c5f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:03.044796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b69214-6ed3-4d9c-bcf0-b255f9d79c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:03.045281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b69214-6ed3-4d9c-bcf0-b255f9d79c5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:03.047534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b69214-6ed3-4d9c-bcf0-b255f9d79c5f None admin] RBAC: Adding query filter params (role.id=2749d7dcfd844991883fa3f4e90ed75c, scope.project.id=e6537af9fe7a48c5890955b7c03e22c2, user.id=f7e7efeee8b04063a63219e88355c758) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:03.048061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b69214-6ed3-4d9c-bcf0-b255f9d79c5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:03.050379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b69214-6ed3-4d9c-bcf0-b255f9d79c5f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:03.058522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 115/225] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:02 2022] GET /identity/v3/role_assignments?user.id=f7e7efeee8b04063a63219e88355c758&scope.project.id=e6537af9fe7a48c5890955b7c03e22c2&role.id=2749d7dcfd844991883fa3f4e90ed75c => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:03.060915 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8620bf1-8752-4cd5-92d0-0498d12ef3aa None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:03.061970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8620bf1-8752-4cd5-92d0-0498d12ef3aa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:03.063285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8620bf1-8752-4cd5-92d0-0498d12ef3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:03.087256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26020d-b80b-41e4-8c84-1a9128724ba9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:03.092775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f8620bf1-8752-4cd5-92d0-0498d12ef3aa None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:03.094184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f8620bf1-8752-4cd5-92d0-0498d12ef3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:03.143074 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e9ccd-9c6d-4d3a-a016-05335993f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:03.145772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e9ccd-9c6d-4d3a-a016-05335993f90c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:03.147133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e9ccd-9c6d-4d3a-a016-05335993f90c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:03.148193 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e9ccd-9c6d-4d3a-a016-05335993f90c None admin] PATH_INFO: `/v3/users/be627fbeab8e406b84cdc27a2c105f33` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:03.150539 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e9ccd-9c6d-4d3a-a016-05335993f90c None admin] RBAC: Authorizing `identity:get_user(user_id=be627fbeab8e406b84cdc27a2c105f33)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:03.154120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e9ccd-9c6d-4d3a-a016-05335993f90c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:03.164011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 111/226] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:02 2022] GET /identity/v3/users/be627fbeab8e406b84cdc27a2c105f33 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:03.170018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e9ccd-9c6d-4d3a-a016-05335993f90c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:03.249881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 116/227] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:03.258091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:03.268104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8620bf1-8752-4cd5-92d0-0498d12ef3aa None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:03.353524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e9ccd-9c6d-4d3a-a016-05335993f90c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:03.386470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:03.423054 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344124c-f48f-44f6-bdd8-afd9a4fc2a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:03.424084 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344124c-f48f-44f6-bdd8-afd9a4fc2a1d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:03.424376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344124c-f48f-44f6-bdd8-afd9a4fc2a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:03.424692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344124c-f48f-44f6-bdd8-afd9a4fc2a1d None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:03.430520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344124c-f48f-44f6-bdd8-afd9a4fc2a1d None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:03.432034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344124c-f48f-44f6-bdd8-afd9a4fc2a1d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:03.434260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 112/228] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:03 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:03.440242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344124c-f48f-44f6-bdd8-afd9a4fc2a1d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:03.440650 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8620bf1-8752-4cd5-92d0-0498d12ef3aa None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:03.477913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4c7b0-d8e2-46de-9c4b-e1b53a2f7709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:03.478779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4c7b0-d8e2-46de-9c4b-e1b53a2f7709 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:03.479062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4c7b0-d8e2-46de-9c4b-e1b53a2f7709 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:03.479331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4c7b0-d8e2-46de-9c4b-e1b53a2f7709 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:03.491376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb4c7b0-d8e2-46de-9c4b-e1b53a2f7709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-cfb4c7b0-d8e2-46de-9c4b-e1b53a2f7709 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:03.500881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:03.501855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:03.502668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:03.502668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:03.502668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:03.502668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:03.502668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:03.502668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:03.502668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:03.502668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:03.502668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:03.502668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:03.502668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:03.502668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:03.502668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 117/229] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:27:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:03.508905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4c7b0-d8e2-46de-9c4b-e1b53a2f7709 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:03.658607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:03.677971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344124c-f48f-44f6-bdd8-afd9a4fc2a1d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:03.702258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb4c7b0-d8e2-46de-9c4b-e1b53a2f7709 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:03.726609 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:03.753674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9a744-e46e-4edb-87b7-6983eeddc19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:03.754838 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a744-e46e-4edb-87b7-6983eeddc19c None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:03.757267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a744-e46e-4edb-87b7-6983eeddc19c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:03.757696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a744-e46e-4edb-87b7-6983eeddc19c None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2/users/be627fbeab8e406b84cdc27a2c105f33/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:03.761585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9a744-e46e-4edb-87b7-6983eeddc19c None admin] RBAC: Authorizing `identity:create_grant(project_id=e6537af9fe7a48c5890955b7c03e22c2, user_id=be627fbeab8e406b84cdc27a2c105f33, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:03.764838 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9a744-e46e-4edb-87b7-6983eeddc19c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:03.774625 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b5a92-39e8-44b3-8763-4b800c6d9a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:03.775537 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b5a92-39e8-44b3-8763-4b800c6d9a29 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:03.775964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b5a92-39e8-44b3-8763-4b800c6d9a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:03.776404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b5a92-39e8-44b3-8763-4b800c6d9a29 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:03.777343 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b5a92-39e8-44b3-8763-4b800c6d9a29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:03.777832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b5a92-39e8-44b3-8763-4b800c6d9a29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:03.779395 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b5a92-39e8-44b3-8763-4b800c6d9a29 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:03.789098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 118/230] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:03.794817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b5a92-39e8-44b3-8763-4b800c6d9a29 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:03.848744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 113/231] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:27:03 2022] PUT /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2/users/be627fbeab8e406b84cdc27a2c105f33/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:27:03.920706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b5a92-39e8-44b3-8763-4b800c6d9a29 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:03.981371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5551b-f21e-473e-b3fb-b42cdebd1866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:03.982397 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5551b-f21e-473e-b3fb-b42cdebd1866 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:03.982691 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5551b-f21e-473e-b3fb-b42cdebd1866 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:03.982969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5551b-f21e-473e-b3fb-b42cdebd1866 None admin] PATH_INFO: `/v3/users/be627fbeab8e406b84cdc27a2c105f33` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:03.984328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5551b-f21e-473e-b3fb-b42cdebd1866 None admin] RBAC: Authorizing `identity:get_user(user_id=be627fbeab8e406b84cdc27a2c105f33)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:03.985832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5551b-f21e-473e-b3fb-b42cdebd1866 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:03.988868 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 119/232] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:03 2022] GET /identity/v3/users/be627fbeab8e406b84cdc27a2c105f33 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:03.993607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9a744-e46e-4edb-87b7-6983eeddc19c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:04.153806 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9a744-e46e-4edb-87b7-6983eeddc19c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:04.193752 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4a5d0-64ff-4ab4-813a-eabf11e750f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:04.194564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4a5d0-64ff-4ab4-813a-eabf11e750f8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:04.194852 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4a5d0-64ff-4ab4-813a-eabf11e750f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:04.195132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4a5d0-64ff-4ab4-813a-eabf11e750f8 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:04.196401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4a5d0-64ff-4ab4-813a-eabf11e750f8 None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:04.197950 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4a5d0-64ff-4ab4-813a-eabf11e750f8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:04.205007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 114/233] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:03 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:04.206440 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5551b-f21e-473e-b3fb-b42cdebd1866 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:04.253452 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:04.314577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5551b-f21e-473e-b3fb-b42cdebd1866 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:04.367268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf71ee7-7f4f-49cc-9b58-c95a8f16f1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:04.368204 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf71ee7-7f4f-49cc-9b58-c95a8f16f1c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:04.368596 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf71ee7-7f4f-49cc-9b58-c95a8f16f1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:04.369009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf71ee7-7f4f-49cc-9b58-c95a8f16f1c6 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2/users/be627fbeab8e406b84cdc27a2c105f33/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:04.371967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf71ee7-7f4f-49cc-9b58-c95a8f16f1c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6537af9fe7a48c5890955b7c03e22c2, user_id=be627fbeab8e406b84cdc27a2c105f33, role_id=5e5bc4ce5d004cd1bb07ef755bf3bb48)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:04.373477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf71ee7-7f4f-49cc-9b58-c95a8f16f1c6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:04.489973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 120/234] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:27:04 2022] PUT /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2/users/be627fbeab8e406b84cdc27a2c105f33/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:27:04.966033 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20483af-41d2-40ef-8d36-4ac9b24b29f7 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:04.966437 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20483af-41d2-40ef-8d36-4ac9b24b29f7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:04.966616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20483af-41d2-40ef-8d36-4ac9b24b29f7 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:04.968314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 115/235] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:04.974024 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb4478-e809-4c07-8b0a-0dc89e82e41f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:04.974471 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb4478-e809-4c07-8b0a-0dc89e82e41f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:04.974569 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb4478-e809-4c07-8b0a-0dc89e82e41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:04.992432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8ddb4478-e809-4c07-8b0a-0dc89e82e41f None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:04.993627 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8ddb4478-e809-4c07-8b0a-0dc89e82e41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:05.064892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 121/236] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:05.088117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20483af-41d2-40ef-8d36-4ac9b24b29f7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:05.112529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:05.226685 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20483af-41d2-40ef-8d36-4ac9b24b29f7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:05.260895 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad6478-a4a2-492b-97c6-b4906e9c5136 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:05.261235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad6478-a4a2-492b-97c6-b4906e9c5136 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:05.261520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad6478-a4a2-492b-97c6-b4906e9c5136 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:05.263096 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 122/237] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:27:05.268402 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39b39c-f3e8-4603-86e0-918cb5f5c506 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:05.268691 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39b39c-f3e8-4603-86e0-918cb5f5c506 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:05.268975 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39b39c-f3e8-4603-86e0-918cb5f5c506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:05.279693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac1b66-c32d-4cf1-b845-1ae7dc2f7218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:05.281534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac1b66-c32d-4cf1-b845-1ae7dc2f7218 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:05.282058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac1b66-c32d-4cf1-b845-1ae7dc2f7218 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:05.282340 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac1b66-c32d-4cf1-b845-1ae7dc2f7218 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:05.288914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9d39b39c-f3e8-4603-86e0-918cb5f5c506 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:05.290757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9d39b39c-f3e8-4603-86e0-918cb5f5c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:05.304841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac1b66-c32d-4cf1-b845-1ae7dc2f7218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-90ac1b66-c32d-4cf1-b845-1ae7dc2f7218 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:05.314321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:05.315269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:05.316094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:05.316094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:05.316094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:05.316094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:05.316094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:05.316094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:05.316094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:05.316094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:05.316094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:05.316094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:05.316094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:27:05.316094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:05.316094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 116/238] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:05.323959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac1b66-c32d-4cf1-b845-1ae7dc2f7218 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:05.343393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:05.410144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 123/239] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:27:05.439765 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39b39c-f3e8-4603-86e0-918cb5f5c506 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:05.462636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:05.509012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac1b66-c32d-4cf1-b845-1ae7dc2f7218 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:05.572512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271faca-d9f4-495d-8f73-e10ff57dd785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:05.573944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271faca-d9f4-495d-8f73-e10ff57dd785 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:05.573944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271faca-d9f4-495d-8f73-e10ff57dd785 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:05.573944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271faca-d9f4-495d-8f73-e10ff57dd785 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:05.574834 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271faca-d9f4-495d-8f73-e10ff57dd785 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:05.575150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271faca-d9f4-495d-8f73-e10ff57dd785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:05.576550 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271faca-d9f4-495d-8f73-e10ff57dd785 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:05.597498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 117/240] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:05.606871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271faca-d9f4-495d-8f73-e10ff57dd785 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:05.624141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d39b39c-f3e8-4603-86e0-918cb5f5c506 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:05.666615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d9fa4-1cec-4bf1-8161-0603941de7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:05.667424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d9fa4-1cec-4bf1-8161-0603941de7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:05.667708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d9fa4-1cec-4bf1-8161-0603941de7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:05.667985 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d9fa4-1cec-4bf1-8161-0603941de7c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:05.669166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d9fa4-1cec-4bf1-8161-0603941de7c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:05.670729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d9fa4-1cec-4bf1-8161-0603941de7c6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:05.672889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 124/241] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:05.673943 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2b626-b81c-4246-9aa5-5b776993bf5b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:05.674215 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2b626-b81c-4246-9aa5-5b776993bf5b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:05.674555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2b626-b81c-4246-9aa5-5b776993bf5b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:05.679871 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 125/242] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:05.679871 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2b626-b81c-4246-9aa5-5b776993bf5b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:05.719263 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:05.735781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271faca-d9f4-495d-8f73-e10ff57dd785 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:05.774362 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e280fc5-4675-453b-9051-d0dccd0f4aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:05.774917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e280fc5-4675-453b-9051-d0dccd0f4aee None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:05.775245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e280fc5-4675-453b-9051-d0dccd0f4aee None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:05.775528 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e280fc5-4675-453b-9051-d0dccd0f4aee None admin] PATH_INFO: `/v3/users/426e85717ccc49d88336663e65827c5e` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:05.784342 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:05.792651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e280fc5-4675-453b-9051-d0dccd0f4aee None admin] RBAC: Authorizing `identity:get_user(user_id=426e85717ccc49d88336663e65827c5e)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:05.794272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e280fc5-4675-453b-9051-d0dccd0f4aee None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:05.796309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 118/243] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:05 2022] GET /identity/v3/users/426e85717ccc49d88336663e65827c5e => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:05.797839 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d63250-47c0-4fb0-8645-a06e274c0efe None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:05.798131 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d63250-47c0-4fb0-8645-a06e274c0efe None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:05.798409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d63250-47c0-4fb0-8645-a06e274c0efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:05.818460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c3d63250-47c0-4fb0-8645-a06e274c0efe None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:05.819370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2b626-b81c-4246-9aa5-5b776993bf5b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:05.820490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c3d63250-47c0-4fb0-8645-a06e274c0efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:05.862104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf353ae-15de-46d8-9ed8-be452fd44050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:05.862847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf353ae-15de-46d8-9ed8-be452fd44050 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:05.863184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf353ae-15de-46d8-9ed8-be452fd44050 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:05.863467 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf353ae-15de-46d8-9ed8-be452fd44050 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:05.864203 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf353ae-15de-46d8-9ed8-be452fd44050 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:05.865661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf353ae-15de-46d8-9ed8-be452fd44050 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:05.898583 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 119/244] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:05.899803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d63250-47c0-4fb0-8645-a06e274c0efe None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:05.964418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 126/245] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:27:05 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:27:05.965526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf353ae-15de-46d8-9ed8-be452fd44050 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:06.041401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d63250-47c0-4fb0-8645-a06e274c0efe None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:06.073171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:06.089671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e83d15-2eef-4cb5-931b-e8daa180849f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:06.090867 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e83d15-2eef-4cb5-931b-e8daa180849f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:06.091357 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e83d15-2eef-4cb5-931b-e8daa180849f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:06.091854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e83d15-2eef-4cb5-931b-e8daa180849f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:06.179496 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e83d15-2eef-4cb5-931b-e8daa180849f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:06.182205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e83d15-2eef-4cb5-931b-e8daa180849f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:06.204285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:06.223684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf353ae-15de-46d8-9ed8-be452fd44050 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:06.269214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afedb68-12ff-48c6-ad20-9d9913ec4847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:06.270092 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afedb68-12ff-48c6-ad20-9d9913ec4847 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:06.270384 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afedb68-12ff-48c6-ad20-9d9913ec4847 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:06.271379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afedb68-12ff-48c6-ad20-9d9913ec4847 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:06.285299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afedb68-12ff-48c6-ad20-9d9913ec4847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1afedb68-12ff-48c6-ad20-9d9913ec4847 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:06.294702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:06.295661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:06.296997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:06.296997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:06.296997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:06.296997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:06.296997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:06.296997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:06.296997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:06.296997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:06.296997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:06.296997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:06.296997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:06.296997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:06.296997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 127/246] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:06.305883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afedb68-12ff-48c6-ad20-9d9913ec4847 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:06.338451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 120/247] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:06.346597 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e83d15-2eef-4cb5-931b-e8daa180849f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:06.380446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:06.456512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afedb68-12ff-48c6-ad20-9d9913ec4847 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:06.477104 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e83d15-2eef-4cb5-931b-e8daa180849f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:06.503500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88900431-cd51-46d8-b392-aa9b46b96a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:06.504489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88900431-cd51-46d8-b392-aa9b46b96a4e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:06.504963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88900431-cd51-46d8-b392-aa9b46b96a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:06.505517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88900431-cd51-46d8-b392-aa9b46b96a4e None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:06.506560 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88900431-cd51-46d8-b392-aa9b46b96a4e None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:06.507074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88900431-cd51-46d8-b392-aa9b46b96a4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:06.508859 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88900431-cd51-46d8-b392-aa9b46b96a4e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:06.520793 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 128/248] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:06.521428 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7a8be-b37b-4376-965c-0a340e3420d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:06.525794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a8be-b37b-4376-965c-0a340e3420d7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:06.525794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a8be-b37b-4376-965c-0a340e3420d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:06.525794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a8be-b37b-4376-965c-0a340e3420d7 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:06.525794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7a8be-b37b-4376-965c-0a340e3420d7 None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:06.526415 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7a8be-b37b-4376-965c-0a340e3420d7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:06.527395 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88900431-cd51-46d8-b392-aa9b46b96a4e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:06.534622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 121/249] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:06 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:06.535812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c065c0d-3cc6-48f4-a2b4-f27bb449afd4 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:06.536112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c065c0d-3cc6-48f4-a2b4-f27bb449afd4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:06.536398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c065c0d-3cc6-48f4-a2b4-f27bb449afd4 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:06.537814 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 122/250] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:06.538916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c065c0d-3cc6-48f4-a2b4-f27bb449afd4 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:06.540166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:06.689058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88900431-cd51-46d8-b392-aa9b46b96a4e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:06.716568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:06.735978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e90846-dbce-4287-9412-6ae6e87eac9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:06.737217 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e90846-dbce-4287-9412-6ae6e87eac9e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:06.738202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e90846-dbce-4287-9412-6ae6e87eac9e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:06.738674 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e90846-dbce-4287-9412-6ae6e87eac9e None admin] PATH_INFO: `/v3/users/f7e7efeee8b04063a63219e88355c758` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:06.741101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e90846-dbce-4287-9412-6ae6e87eac9e None admin] RBAC: Authorizing `identity:get_user(user_id=f7e7efeee8b04063a63219e88355c758)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:06.741778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c065c0d-3cc6-48f4-a2b4-f27bb449afd4 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:06.745065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e90846-dbce-4287-9412-6ae6e87eac9e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:06.747772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 129/251] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:06 2022] GET /identity/v3/users/f7e7efeee8b04063a63219e88355c758 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:06.751247 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98d7cb-aca3-4035-99a7-0cbd70264f65 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:06.752710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98d7cb-aca3-4035-99a7-0cbd70264f65 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:06.753183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98d7cb-aca3-4035-99a7-0cbd70264f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:06.794270 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-eb98d7cb-aca3-4035-99a7-0cbd70264f65 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:06.798367 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-eb98d7cb-aca3-4035-99a7-0cbd70264f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:06.827987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f32738-02e3-483a-adcb-54415d9f634c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:06.829030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f32738-02e3-483a-adcb-54415d9f634c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:06.829535 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f32738-02e3-483a-adcb-54415d9f634c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:06.830027 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f32738-02e3-483a-adcb-54415d9f634c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:06.831138 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f32738-02e3-483a-adcb-54415d9f634c None admin] RBAC: Adding query filter params (role.id=37c1e273f187464f842780ff08196d0c, scope.project.id=e6537af9fe7a48c5890955b7c03e22c2, user.id=426e85717ccc49d88336663e65827c5e) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:06.831658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f32738-02e3-483a-adcb-54415d9f634c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:06.833380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f32738-02e3-483a-adcb-54415d9f634c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:06.852008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 123/252] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:06 2022] GET /identity/v3/role_assignments?user.id=426e85717ccc49d88336663e65827c5e&scope.project.id=e6537af9fe7a48c5890955b7c03e22c2&role.id=37c1e273f187464f842780ff08196d0c => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:06.854530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f32738-02e3-483a-adcb-54415d9f634c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:06.896719 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 130/253] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:06.938172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98d7cb-aca3-4035-99a7-0cbd70264f65 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:06.941549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:07.119760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f32738-02e3-483a-adcb-54415d9f634c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:07.147501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98d7cb-aca3-4035-99a7-0cbd70264f65 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:07.195171 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce239e-c253-40a7-a7ce-c6eba6ab9051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:07.195906 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce239e-c253-40a7-a7ce-c6eba6ab9051 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:07.196183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce239e-c253-40a7-a7ce-c6eba6ab9051 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:07.196454 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce239e-c253-40a7-a7ce-c6eba6ab9051 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:07.199583 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35f7b3-e040-491d-ad7f-6026f024e501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:07.200462 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35f7b3-e040-491d-ad7f-6026f024e501 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:07.200738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35f7b3-e040-491d-ad7f-6026f024e501 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:07.201010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc35f7b3-e040-491d-ad7f-6026f024e501 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:07.203478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35f7b3-e040-491d-ad7f-6026f024e501 None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:07.204935 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc35f7b3-e040-491d-ad7f-6026f024e501 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:07.207402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 124/254] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:06 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:07.218318 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35f7b3-e040-491d-ad7f-6026f024e501 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:07.221142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce239e-c253-40a7-a7ce-c6eba6ab9051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c8ce239e-c253-40a7-a7ce-c6eba6ab9051 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:07.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:07.231861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:07.232678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:07.232678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:07.232678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:07.232678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:07.232678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:07.232678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:07.232678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:07.232678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:07.232678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:07.232678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:07.232678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:27:07.232678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:07.232678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 131/255] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:27:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:07.239806 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce239e-c253-40a7-a7ce-c6eba6ab9051 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:07.259136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:07.346593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:07.407993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc35f7b3-e040-491d-ad7f-6026f024e501 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:07.419302 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce239e-c253-40a7-a7ce-c6eba6ab9051 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:07.482590 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02920f02-3a5f-447b-9f93-6fbef0dedd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:07.484567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02920f02-3a5f-447b-9f93-6fbef0dedd45 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:07.484853 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02920f02-3a5f-447b-9f93-6fbef0dedd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:07.485129 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02920f02-3a5f-447b-9f93-6fbef0dedd45 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2/users/f7e7efeee8b04063a63219e88355c758/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:07.489059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c6b07-701a-4344-ab88-f607c9703f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:07.489742 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c6b07-701a-4344-ab88-f607c9703f02 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:07.490022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c6b07-701a-4344-ab88-f607c9703f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:07.490293 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c6b07-701a-4344-ab88-f607c9703f02 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:07.491046 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c6b07-701a-4344-ab88-f607c9703f02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:07.491353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c6b07-701a-4344-ab88-f607c9703f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:07.492783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c6b07-701a-4344-ab88-f607c9703f02 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:07.494573 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02920f02-3a5f-447b-9f93-6fbef0dedd45 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6537af9fe7a48c5890955b7c03e22c2, user_id=f7e7efeee8b04063a63219e88355c758, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:07.496423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02920f02-3a5f-447b-9f93-6fbef0dedd45 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:07.505779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 132/256] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:07.508232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140d038-8e94-4af4-ba2b-cd69798d142e None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:07.508526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140d038-8e94-4af4-ba2b-cd69798d142e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:07.510869 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140d038-8e94-4af4-ba2b-cd69798d142e None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:07.512346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 133/257] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:07.513200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140d038-8e94-4af4-ba2b-cd69798d142e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:07.579453 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 125/258] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:27:07 2022] PUT /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2/users/f7e7efeee8b04063a63219e88355c758/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:27:07.580736 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c5796-98e8-4b99-a84e-634f291ce645 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:07.581024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c5796-98e8-4b99-a84e-634f291ce645 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:07.581299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c5796-98e8-4b99-a84e-634f291ce645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:07.631485 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-891c5796-98e8-4b99-a84e-634f291ce645 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:07.632820 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-891c5796-98e8-4b99-a84e-634f291ce645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:07.713574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140d038-8e94-4af4-ba2b-cd69798d142e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:07.757733 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 126/259] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:07.770149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:07.776311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91ab1d-3c9a-41ce-9035-9a08d599eb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:07.777577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ab1d-3c9a-41ce-9035-9a08d599eb44 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:07.778099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ab1d-3c9a-41ce-9035-9a08d599eb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:07.778603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e91ab1d-3c9a-41ce-9035-9a08d599eb44 None admin] PATH_INFO: `/v3/users/be627fbeab8e406b84cdc27a2c105f33` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:07.780792 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91ab1d-3c9a-41ce-9035-9a08d599eb44 None admin] RBAC: Authorizing `identity:get_user(user_id=be627fbeab8e406b84cdc27a2c105f33)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:07.783341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e91ab1d-3c9a-41ce-9035-9a08d599eb44 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:07.787716 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 134/260] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:07 2022] GET /identity/v3/users/be627fbeab8e406b84cdc27a2c105f33 => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:07.791021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c5796-98e8-4b99-a84e-634f291ce645 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:07.801123 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91ab1d-3c9a-41ce-9035-9a08d599eb44 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:07.829406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:07.988009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e91ab1d-3c9a-41ce-9035-9a08d599eb44 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:07.993310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c5796-98e8-4b99-a84e-634f291ce645 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:08.052243 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180a6d6-ffd3-4fe5-8e66-861f7bcf2b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:08.052989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180a6d6-ffd3-4fe5-8e66-861f7bcf2b06 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:08.053271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180a6d6-ffd3-4fe5-8e66-861f7bcf2b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:08.053544 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180a6d6-ffd3-4fe5-8e66-861f7bcf2b06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:08.056617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ebe57-3a37-4abe-841f-16fafd313ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:08.057276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ebe57-3a37-4abe-841f-16fafd313ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:08.057559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ebe57-3a37-4abe-841f-16fafd313ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:08.057864 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ebe57-3a37-4abe-841f-16fafd313ee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:08.081605 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180a6d6-ffd3-4fe5-8e66-861f7bcf2b06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-0180a6d6-ffd3-4fe5-8e66-861f7bcf2b06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:08.091059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:08.091937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:08.092799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:08.092799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:08.092799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:08.092799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:08.092799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:08.092799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:08.092799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:08.092799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:08.092799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:08.092799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:08.092799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:08.092799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:08.092799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 135/261] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:27:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:08.098653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180a6d6-ffd3-4fe5-8e66-861f7bcf2b06 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:08.194350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ebe57-3a37-4abe-841f-16fafd313ee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:08.195826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ebe57-3a37-4abe-841f-16fafd313ee4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:08.226069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:08.245530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:08.322506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180a6d6-ffd3-4fe5-8e66-861f7bcf2b06 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:08.393865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbffaf2-de53-462b-8c48-425cdd66e43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:08.394560 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbffaf2-de53-462b-8c48-425cdd66e43b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:08.394933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbffaf2-de53-462b-8c48-425cdd66e43b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:08.395218 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbffaf2-de53-462b-8c48-425cdd66e43b None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:08.396014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbffaf2-de53-462b-8c48-425cdd66e43b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:08.396329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbffaf2-de53-462b-8c48-425cdd66e43b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:08.403830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbffaf2-de53-462b-8c48-425cdd66e43b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:08.411004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 127/262] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:08.420001 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ebe57-3a37-4abe-841f-16fafd313ee4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:08.432110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 136/263] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:08.433028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbffaf2-de53-462b-8c48-425cdd66e43b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:08.587445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ebe57-3a37-4abe-841f-16fafd313ee4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:08.608935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbffaf2-de53-462b-8c48-425cdd66e43b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:08.626167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:08.629171 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:08.644328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21aacd-0d1a-4561-97f6-2dd859c4b1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:08.645218 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21aacd-0d1a-4561-97f6-2dd859c4b1be None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:08.645503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21aacd-0d1a-4561-97f6-2dd859c4b1be None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:08.645805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21aacd-0d1a-4561-97f6-2dd859c4b1be None admin] PATH_INFO: `/v3/users/be627fbeab8e406b84cdc27a2c105f33` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:08.647022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21aacd-0d1a-4561-97f6-2dd859c4b1be None admin] RBAC: Authorizing `identity:get_user(user_id=be627fbeab8e406b84cdc27a2c105f33)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:08.648475 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21aacd-0d1a-4561-97f6-2dd859c4b1be None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:08.650518 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 137/264] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:08 2022] GET /identity/v3/users/be627fbeab8e406b84cdc27a2c105f33 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:08.657099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21aacd-0d1a-4561-97f6-2dd859c4b1be None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:08.657264 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd04cd-b6bd-43db-87f0-9d006dedb42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:08.658170 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd04cd-b6bd-43db-87f0-9d006dedb42d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:08.658453 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd04cd-b6bd-43db-87f0-9d006dedb42d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:08.662093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd04cd-b6bd-43db-87f0-9d006dedb42d None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:08.663404 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd04cd-b6bd-43db-87f0-9d006dedb42d None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:08.664871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd04cd-b6bd-43db-87f0-9d006dedb42d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:08.666900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 128/265] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:08 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:08.689646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd04cd-b6bd-43db-87f0-9d006dedb42d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:08.772106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21aacd-0d1a-4561-97f6-2dd859c4b1be None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:08.847119 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21a292-8042-4da0-9ea8-f79727d67e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:08.847718 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a292-8042-4da0-9ea8-f79727d67e72 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:08.848004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a292-8042-4da0-9ea8-f79727d67e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:08.848281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21a292-8042-4da0-9ea8-f79727d67e72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:08.979695 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd04cd-b6bd-43db-87f0-9d006dedb42d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:09.000013 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:09.038797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21a292-8042-4da0-9ea8-f79727d67e72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:09.040297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21a292-8042-4da0-9ea8-f79727d67e72 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:09.087447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f479e-3be7-4d8d-96e5-9c9a7edf137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:09.088132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f479e-3be7-4d8d-96e5-9c9a7edf137b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:09.088418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f479e-3be7-4d8d-96e5-9c9a7edf137b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:09.088697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f479e-3be7-4d8d-96e5-9c9a7edf137b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:09.089558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f479e-3be7-4d8d-96e5-9c9a7edf137b None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=e6537af9fe7a48c5890955b7c03e22c2, user.id=be627fbeab8e406b84cdc27a2c105f33) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:09.089916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f479e-3be7-4d8d-96e5-9c9a7edf137b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:09.091548 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f479e-3be7-4d8d-96e5-9c9a7edf137b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:09.109958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 129/266] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:08 2022] GET /identity/v3/role_assignments?user.id=be627fbeab8e406b84cdc27a2c105f33&scope.project.id=e6537af9fe7a48c5890955b7c03e22c2&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 608 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:09.221981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571221f-719e-4232-a06d-c869c511a1ec None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:09.222635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571221f-719e-4232-a06d-c869c511a1ec None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:09.223190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571221f-719e-4232-a06d-c869c511a1ec None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:09.225215 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 130/267] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:27:09.229748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 138/268] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 22:27:09.232048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571221f-719e-4232-a06d-c869c511a1ec None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:09.246697 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98819b9-dc36-4fda-95ab-efce5643ade0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:09.247016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98819b9-dc36-4fda-95ab-efce5643ade0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:09.247277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98819b9-dc36-4fda-95ab-efce5643ade0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:09.277559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f98819b9-dc36-4fda-95ab-efce5643ade0 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:09.279959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f98819b9-dc36-4fda-95ab-efce5643ade0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:09.331891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:09.422518 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 139/269] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 20 22:27:09.424179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5a466-4e4a-4a1d-9890-ec585d6e67bd None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:09.424670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5a466-4e4a-4a1d-9890-ec585d6e67bd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:09.425147 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571221f-719e-4232-a06d-c869c511a1ec None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:09.429976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b5a466-4e4a-4a1d-9890-ec585d6e67bd None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:09.431719 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 140/270] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:09.438797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada43c2-3d31-4509-9e23-7d360722ecbe None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:09.439483 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada43c2-3d31-4509-9e23-7d360722ecbe None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:09.439860 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada43c2-3d31-4509-9e23-7d360722ecbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:09.469618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92218bd9-bcf5-42fe-9dab-143cc2be27d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:09.470777 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92218bd9-bcf5-42fe-9dab-143cc2be27d3 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:09.471207 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92218bd9-bcf5-42fe-9dab-143cc2be27d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:09.471653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92218bd9-bcf5-42fe-9dab-143cc2be27d3 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:09.473041 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92218bd9-bcf5-42fe-9dab-143cc2be27d3 None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:09.475032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92218bd9-bcf5-42fe-9dab-143cc2be27d3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:09.475867 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7ada43c2-3d31-4509-9e23-7d360722ecbe None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:09.477245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7ada43c2-3d31-4509-9e23-7d360722ecbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:09.477826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 131/271] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:09 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:09.478822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92218bd9-bcf5-42fe-9dab-143cc2be27d3 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:09.493667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:09.564664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 141/272] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:27:09.565776 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada43c2-3d31-4509-9e23-7d360722ecbe None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:09.619989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92218bd9-bcf5-42fe-9dab-143cc2be27d3 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:09.642950 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:09.666724 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c14f7-5ccd-48f2-94a3-22d0bea1f98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:09.668005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c14f7-5ccd-48f2-94a3-22d0bea1f98c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:09.669912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c14f7-5ccd-48f2-94a3-22d0bea1f98c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:09.669912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c14f7-5ccd-48f2-94a3-22d0bea1f98c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:09.670474 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c14f7-5ccd-48f2-94a3-22d0bea1f98c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:09.673054 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c14f7-5ccd-48f2-94a3-22d0bea1f98c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:09.675605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 132/273] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:09.676459 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c14f7-5ccd-48f2-94a3-22d0bea1f98c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:09.699585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada43c2-3d31-4509-9e23-7d360722ecbe None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:09.736805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac90df-993f-4322-8869-48c3e190246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:09.737477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac90df-993f-4322-8869-48c3e190246f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:09.737792 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac90df-993f-4322-8869-48c3e190246f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:09.738072 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac90df-993f-4322-8869-48c3e190246f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:09.738922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac90df-993f-4322-8869-48c3e190246f None admin] RBAC: Adding query filter params (role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48, scope.project.id=e6537af9fe7a48c5890955b7c03e22c2, user.id=be627fbeab8e406b84cdc27a2c105f33) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:09.739236 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac90df-993f-4322-8869-48c3e190246f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:09.740680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac90df-993f-4322-8869-48c3e190246f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:09.746938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 142/274] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:09 2022] GET /identity/v3/role_assignments?user.id=be627fbeab8e406b84cdc27a2c105f33&scope.project.id=e6537af9fe7a48c5890955b7c03e22c2&role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:09.747789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac90df-993f-4322-8869-48c3e190246f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:09.768694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:09.811518 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c14f7-5ccd-48f2-94a3-22d0bea1f98c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:09.850995 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baba67-c04e-42b6-862a-b6b91a935aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:09.851819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baba67-c04e-42b6-862a-b6b91a935aec None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:09.852107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baba67-c04e-42b6-862a-b6b91a935aec None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:09.852640 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baba67-c04e-42b6-862a-b6b91a935aec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:09.865494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13baba67-c04e-42b6-862a-b6b91a935aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-13baba67-c04e-42b6-862a-b6b91a935aec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:09.873552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:09.874748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:09.880697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:09.880697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:09.880697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:09.880697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:09.880697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:09.880697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:09.880697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:09.880697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:09.880697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:09.880697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:09.880697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:09.880697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:09.880697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 133/275] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:09.880697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f66319-991c-4baf-8cc9-359c35e7a62f None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:09.881442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f66319-991c-4baf-8cc9-359c35e7a62f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:09.881442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f66319-991c-4baf-8cc9-359c35e7a62f None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:09.881442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 134/276] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:09.881442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f66319-991c-4baf-8cc9-359c35e7a62f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:09.918567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac90df-993f-4322-8869-48c3e190246f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:09.948636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:09.959266 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d16c3-9972-4a1d-a8da-1e03c4ea5b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:09.961855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d16c3-9972-4a1d-a8da-1e03c4ea5b3c None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:09.961855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d16c3-9972-4a1d-a8da-1e03c4ea5b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:09.961855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d16c3-9972-4a1d-a8da-1e03c4ea5b3c None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:09.961855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d16c3-9972-4a1d-a8da-1e03c4ea5b3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:09.962804 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d16c3-9972-4a1d-a8da-1e03c4ea5b3c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:10.016345 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f66319-991c-4baf-8cc9-359c35e7a62f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:10.042405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 143/277] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:27:09 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:27:10.043736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8f778-68df-4d93-8164-d5f21f4355d0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:10.044031 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8f778-68df-4d93-8164-d5f21f4355d0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:10.044314 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8f778-68df-4d93-8164-d5f21f4355d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:10.062294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7f4cc-6131-4ceb-8434-e12e62cdd38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:10.063042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7f4cc-6131-4ceb-8434-e12e62cdd38e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:10.063329 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7f4cc-6131-4ceb-8434-e12e62cdd38e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:10.063748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7f4cc-6131-4ceb-8434-e12e62cdd38e None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:10.065409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7f4cc-6131-4ceb-8434-e12e62cdd38e None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:10.065409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7f4cc-6131-4ceb-8434-e12e62cdd38e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:10.068724 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7f4cc-6131-4ceb-8434-e12e62cdd38e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:10.081527 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 135/278] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:10.090253 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-24c8f778-68df-4d93-8164-d5f21f4355d0 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:10.090840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7f4cc-6131-4ceb-8434-e12e62cdd38e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:10.091505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-24c8f778-68df-4d93-8164-d5f21f4355d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:10.164376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:10.176765 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 144/279] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:10.201184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8f778-68df-4d93-8164-d5f21f4355d0 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:10.231695 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7f4cc-6131-4ceb-8434-e12e62cdd38e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:10.239944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:10.273931 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5109b-56d9-4658-b29f-ad1f2bc9d938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:10.275150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5109b-56d9-4658-b29f-ad1f2bc9d938 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:10.275639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5109b-56d9-4658-b29f-ad1f2bc9d938 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:10.275926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5109b-56d9-4658-b29f-ad1f2bc9d938 None admin] PATH_INFO: `/v3/users/88f0b6fac7d44456adb662015cbde200` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:10.293075 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5109b-56d9-4658-b29f-ad1f2bc9d938 None admin] RBAC: Authorizing `identity:get_user(user_id=88f0b6fac7d44456adb662015cbde200)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:10.293418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5109b-56d9-4658-b29f-ad1f2bc9d938 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:10.300988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 136/280] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:10 2022] GET /identity/v3/users/88f0b6fac7d44456adb662015cbde200 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:10.302480 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5109b-56d9-4658-b29f-ad1f2bc9d938 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:10.346419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8f778-68df-4d93-8164-d5f21f4355d0 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:10.392854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2556b-b825-4fd7-8f31-ed634eac29c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:10.394059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2556b-b825-4fd7-8f31-ed634eac29c7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:10.394546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2556b-b825-4fd7-8f31-ed634eac29c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:10.395020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2556b-b825-4fd7-8f31-ed634eac29c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:10.410183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2556b-b825-4fd7-8f31-ed634eac29c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3ad2556b-b825-4fd7-8f31-ed634eac29c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:10.418407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:10.419346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:10.420187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:10.420187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:10.420187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:10.420187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:10.420187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:10.420187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:10.420187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:10.420187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:10.420187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:10.420187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:10.420187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:27:10.420187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:10.420843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 145/281] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:10.424637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5109b-56d9-4658-b29f-ad1f2bc9d938 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:10.426858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2556b-b825-4fd7-8f31-ed634eac29c7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:10.468187 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e60525-b0b3-4ae4-8cb8-14efb3e15002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:10.468885 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e60525-b0b3-4ae4-8cb8-14efb3e15002 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:10.469314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e60525-b0b3-4ae4-8cb8-14efb3e15002 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:10.469656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e60525-b0b3-4ae4-8cb8-14efb3e15002 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:10.470632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e60525-b0b3-4ae4-8cb8-14efb3e15002 None admin] RBAC: Adding query filter params (role.id=2749d7dcfd844991883fa3f4e90ed75c, user.id=88f0b6fac7d44456adb662015cbde200, scope.system=all) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:10.471013 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e60525-b0b3-4ae4-8cb8-14efb3e15002 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:10.472663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e60525-b0b3-4ae4-8cb8-14efb3e15002 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:10.479717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 137/282] 10.222.0.83 () {56 vars in 1308 bytes} [Wed Jul 20 22:27:10 2022] GET /identity/v3/role_assignments?user.id=88f0b6fac7d44456adb662015cbde200&scope.system=all&role.id=2749d7dcfd844991883fa3f4e90ed75c => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:10.495353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2766c1-7ca6-4e8b-93c9-3966918b5224 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:10.495696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2766c1-7ca6-4e8b-93c9-3966918b5224 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:10.495916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2766c1-7ca6-4e8b-93c9-3966918b5224 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:10.497292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 138/283] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:27:10.505075 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a445f36-ab64-438b-afe2-e34623d29547 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:10.505393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a445f36-ab64-438b-afe2-e34623d29547 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:10.505628 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a445f36-ab64-438b-afe2-e34623d29547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:10.526687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-2a445f36-ab64-438b-afe2-e34623d29547 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:10.527902 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2a445f36-ab64-438b-afe2-e34623d29547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:10.528441 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:10.557006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:10.583658 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2556b-b825-4fd7-8f31-ed634eac29c7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:10.612016 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 139/284] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:10.630899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae535e03-f90a-4860-bce7-805d0b007b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:10.631933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae535e03-f90a-4860-bce7-805d0b007b23 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:10.632371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae535e03-f90a-4860-bce7-805d0b007b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:10.632801 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae535e03-f90a-4860-bce7-805d0b007b23 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:10.633899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae535e03-f90a-4860-bce7-805d0b007b23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:10.634433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae535e03-f90a-4860-bce7-805d0b007b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:10.636087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae535e03-f90a-4860-bce7-805d0b007b23 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:10.643166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a445f36-ab64-438b-afe2-e34623d29547 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:10.663834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 146/285] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:10.669465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae535e03-f90a-4860-bce7-805d0b007b23 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:10.758076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a445f36-ab64-438b-afe2-e34623d29547 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:10.786924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae535e03-f90a-4860-bce7-805d0b007b23 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:10.793657 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d33e7-28ec-4a04-94f4-d3b53f4d65c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:10.794752 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d33e7-28ec-4a04-94f4-d3b53f4d65c5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:10.795230 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d33e7-28ec-4a04-94f4-d3b53f4d65c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:10.796220 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d33e7-28ec-4a04-94f4-d3b53f4d65c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:10.807794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d33e7-28ec-4a04-94f4-d3b53f4d65c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:10.814120 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-5f7d33e7-28ec-4a04-94f4-d3b53f4d65c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:10.816970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:10.817875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:10.818687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:10.818687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:10.818687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:10.818687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:10.818687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:10.818687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:10.818687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:10.818687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:10.818687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:10.818687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:10.818687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:10.818687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:10.821452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 140/286] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:10.827194 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d33e7-28ec-4a04-94f4-d3b53f4d65c5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:10.852359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:10.866450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f036f-f041-4742-9e5c-1f18e9c58f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:10.867356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f036f-f041-4742-9e5c-1f18e9c58f56 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:10.867646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f036f-f041-4742-9e5c-1f18e9c58f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:10.867925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f036f-f041-4742-9e5c-1f18e9c58f56 None admin] PATH_INFO: `/v3/users/426e85717ccc49d88336663e65827c5e` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:10.869201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f036f-f041-4742-9e5c-1f18e9c58f56 None admin] RBAC: Authorizing `identity:get_user(user_id=426e85717ccc49d88336663e65827c5e)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:10.870691 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f036f-f041-4742-9e5c-1f18e9c58f56 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:10.872653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 147/287] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:10 2022] GET /identity/v3/users/426e85717ccc49d88336663e65827c5e => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:10.878274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f036f-f041-4742-9e5c-1f18e9c58f56 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:10.996013 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d33e7-28ec-4a04-94f4-d3b53f4d65c5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:11.057351 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a897b44-c3b9-49e4-813c-d4f601fa5862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:11.057987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a897b44-c3b9-49e4-813c-d4f601fa5862 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:11.058281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a897b44-c3b9-49e4-813c-d4f601fa5862 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:11.058605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a897b44-c3b9-49e4-813c-d4f601fa5862 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:11.059478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a897b44-c3b9-49e4-813c-d4f601fa5862 None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:11.059929 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a897b44-c3b9-49e4-813c-d4f601fa5862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:11.061385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a897b44-c3b9-49e4-813c-d4f601fa5862 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:11.062927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f036f-f041-4742-9e5c-1f18e9c58f56 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:11.089595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 141/288] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:11.090672 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a897b44-c3b9-49e4-813c-d4f601fa5862 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:11.146579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17383fe5-7b30-41f7-b193-34dd7eb9581d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:11.147516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17383fe5-7b30-41f7-b193-34dd7eb9581d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:11.147805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17383fe5-7b30-41f7-b193-34dd7eb9581d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:11.148081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17383fe5-7b30-41f7-b193-34dd7eb9581d None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:11.149417 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17383fe5-7b30-41f7-b193-34dd7eb9581d None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:11.150945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17383fe5-7b30-41f7-b193-34dd7eb9581d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:11.154757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 148/289] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:10 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:11.161835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17383fe5-7b30-41f7-b193-34dd7eb9581d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:11.242081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:11.271083 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:11.280925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a897b44-c3b9-49e4-813c-d4f601fa5862 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:11.355187 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a5298-89c5-4a9c-b53a-a8a9a4d268fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:11.356000 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5298-89c5-4a9c-b53a-a8a9a4d268fc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:11.356281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5298-89c5-4a9c-b53a-a8a9a4d268fc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:11.356557 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a5298-89c5-4a9c-b53a-a8a9a4d268fc None admin] PATH_INFO: `/v3/users/f7e7efeee8b04063a63219e88355c758` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:11.358525 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a5298-89c5-4a9c-b53a-a8a9a4d268fc None admin] RBAC: Authorizing `identity:get_user(user_id=f7e7efeee8b04063a63219e88355c758)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:11.360108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a5298-89c5-4a9c-b53a-a8a9a4d268fc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:11.361793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 142/290] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:11 2022] GET /identity/v3/users/f7e7efeee8b04063a63219e88355c758 => generated 297 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:11.367358 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a5298-89c5-4a9c-b53a-a8a9a4d268fc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:11.368928 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17383fe5-7b30-41f7-b193-34dd7eb9581d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:11.435839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ff791-f55a-4ca1-aa1f-3b25b30c9fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:11.437314 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ff791-f55a-4ca1-aa1f-3b25b30c9fb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:11.437698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ff791-f55a-4ca1-aa1f-3b25b30c9fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:11.438008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ff791-f55a-4ca1-aa1f-3b25b30c9fb9 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2/users/426e85717ccc49d88336663e65827c5e/roles/37c1e273f187464f842780ff08196d0c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:11.443389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ff791-f55a-4ca1-aa1f-3b25b30c9fb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6537af9fe7a48c5890955b7c03e22c2, user_id=426e85717ccc49d88336663e65827c5e, role_id=37c1e273f187464f842780ff08196d0c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:11.444839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ff791-f55a-4ca1-aa1f-3b25b30c9fb9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:11.494058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a5298-89c5-4a9c-b53a-a8a9a4d268fc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:11.521243 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 149/291] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:27:11 2022] PUT /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2/users/426e85717ccc49d88336663e65827c5e/roles/37c1e273f187464f842780ff08196d0c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:27:11.557320 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6315565-1632-4b5a-a2c5-d0dffcc415dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:11.558456 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6315565-1632-4b5a-a2c5-d0dffcc415dc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:11.558936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6315565-1632-4b5a-a2c5-d0dffcc415dc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:11.559479 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6315565-1632-4b5a-a2c5-d0dffcc415dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:11.598143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:11.690911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6315565-1632-4b5a-a2c5-d0dffcc415dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:11.692410 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6315565-1632-4b5a-a2c5-d0dffcc415dc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:11.803392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 143/292] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:11.809008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ff791-f55a-4ca1-aa1f-3b25b30c9fb9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:11.955886 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ff791-f55a-4ca1-aa1f-3b25b30c9fb9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:11.972499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:12.000345 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abef47-01b7-4950-9f0c-38348bb934fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:12.001220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abef47-01b7-4950-9f0c-38348bb934fd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:12.001499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abef47-01b7-4950-9f0c-38348bb934fd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:12.001794 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abef47-01b7-4950-9f0c-38348bb934fd None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:12.003022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abef47-01b7-4950-9f0c-38348bb934fd None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:12.004551 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abef47-01b7-4950-9f0c-38348bb934fd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:12.006684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 150/293] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:11 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:12.012212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6315565-1632-4b5a-a2c5-d0dffcc415dc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:12.073951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:12.147308 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6315565-1632-4b5a-a2c5-d0dffcc415dc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:12.195167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6cefb0-4efa-441b-b977-137c02e51763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:12.195833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cefb0-4efa-441b-b977-137c02e51763 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:12.196119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cefb0-4efa-441b-b977-137c02e51763 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:12.196398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6cefb0-4efa-441b-b977-137c02e51763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:12.197249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cefb0-4efa-441b-b977-137c02e51763 None admin] RBAC: Adding query filter params (role.id=2749d7dcfd844991883fa3f4e90ed75c, scope.project.id=e6537af9fe7a48c5890955b7c03e22c2, user.id=f7e7efeee8b04063a63219e88355c758) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:12.197568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cefb0-4efa-441b-b977-137c02e51763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:12.199042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6cefb0-4efa-441b-b977-137c02e51763 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:12.210360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 144/294] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:12 2022] GET /identity/v3/role_assignments?user.id=f7e7efeee8b04063a63219e88355c758&scope.project.id=e6537af9fe7a48c5890955b7c03e22c2&role.id=2749d7dcfd844991883fa3f4e90ed75c => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:12.695595 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c3d2e-661f-4576-bd4b-561add8c3fdd None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:12.696106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c3d2e-661f-4576-bd4b-561add8c3fdd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:12.696181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c3d2e-661f-4576-bd4b-561add8c3fdd None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:12.697543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 151/295] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:12.703093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5983f4-5b09-4838-9659-cd6b06de89be None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:12.703528 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5983f4-5b09-4838-9659-cd6b06de89be None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:12.703698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5983f4-5b09-4838-9659-cd6b06de89be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:12.721643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-2c5983f4-5b09-4838-9659-cd6b06de89be None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:12.722873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2c5983f4-5b09-4838-9659-cd6b06de89be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:12.807435 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 145/296] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:12.831106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c3d2e-661f-4576-bd4b-561add8c3fdd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:12.948462 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c3d2e-661f-4576-bd4b-561add8c3fdd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:12.952537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e237c9-eb0e-42d8-a20a-4f7bb58fa747 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:12.952825 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e237c9-eb0e-42d8-a20a-4f7bb58fa747 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:12.953107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e237c9-eb0e-42d8-a20a-4f7bb58fa747 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:12.954773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 146/297] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:27:12.961146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008718-0458-4ba8-9cfa-fed3044bc431 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:12.961436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008718-0458-4ba8-9cfa-fed3044bc431 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:12.961715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e008718-0458-4ba8-9cfa-fed3044bc431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:12.980489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0e008718-0458-4ba8-9cfa-fed3044bc431 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:12.981908 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0e008718-0458-4ba8-9cfa-fed3044bc431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:12.987267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f2520-4024-4744-b94b-99a67c5dad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:12.988084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f2520-4024-4744-b94b-99a67c5dad14 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:12.988412 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f2520-4024-4744-b94b-99a67c5dad14 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:12.988695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f2520-4024-4744-b94b-99a67c5dad14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:13.000535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f2520-4024-4744-b94b-99a67c5dad14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d65f2520-4024-4744-b94b-99a67c5dad14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:13.009049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:13.010045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:13.010894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:13.010894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:13.010894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:13.010894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:13.010894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:13.010894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:13.010894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:13.010894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:13.010894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:13.010894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:13.010894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:27:13.010894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:13.010894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 152/298] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:13.012207 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff446-cd1b-4172-9f39-7f6e6ab5fab2 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:13.012207 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff446-cd1b-4172-9f39-7f6e6ab5fab2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:13.013831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeff446-cd1b-4172-9f39-7f6e6ab5fab2 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:13.015354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 153/299] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:13.018027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeff446-cd1b-4172-9f39-7f6e6ab5fab2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:13.024076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:13.058078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 147/300] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:27:13.065971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989804f-3b50-4d85-a68d-07dcc6ba7f02 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:13.065971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989804f-3b50-4d85-a68d-07dcc6ba7f02 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:13.065971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989804f-3b50-4d85-a68d-07dcc6ba7f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:13.078126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:13.083623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f989804f-3b50-4d85-a68d-07dcc6ba7f02 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:13.084824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f989804f-3b50-4d85-a68d-07dcc6ba7f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:13.133417 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeff446-cd1b-4172-9f39-7f6e6ab5fab2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:13.156136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 148/301] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:13.156983 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989804f-3b50-4d85-a68d-07dcc6ba7f02 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:13.185941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785c062-a57f-418b-a2d9-951e64223eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:13.187291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785c062-a57f-418b-a2d9-951e64223eff None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:13.187645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785c062-a57f-418b-a2d9-951e64223eff None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:13.187925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a785c062-a57f-418b-a2d9-951e64223eff None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:13.188694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785c062-a57f-418b-a2d9-951e64223eff None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:13.189002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785c062-a57f-418b-a2d9-951e64223eff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:13.190404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a785c062-a57f-418b-a2d9-951e64223eff None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:13.201841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 154/302] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:13.201841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785c062-a57f-418b-a2d9-951e64223eff None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:13.268228 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989804f-3b50-4d85-a68d-07dcc6ba7f02 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:13.270013 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:13.304946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59778fc-5264-45ea-933c-cb093021c732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:13.305548 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a785c062-a57f-418b-a2d9-951e64223eff None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:13.305818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59778fc-5264-45ea-933c-cb093021c732 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:13.306133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59778fc-5264-45ea-933c-cb093021c732 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:13.306412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59778fc-5264-45ea-933c-cb093021c732 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:13.307174 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:13.317888 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59778fc-5264-45ea-933c-cb093021c732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-d59778fc-5264-45ea-933c-cb093021c732 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:13.326018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:13.326959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:13.328241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:13.328241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:13.328241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:13.328241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:13.328241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:13.328241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:13.328241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:13.328241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:13.328241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:13.328241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:13.328241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:13.328241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:13.328241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 149/303] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:13.328241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59778fc-5264-45ea-933c-cb093021c732 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:13.348264 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323fe9b-ad33-442c-9554-6b71dbd38d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:13.349343 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323fe9b-ad33-442c-9554-6b71dbd38d2b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:13.349854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323fe9b-ad33-442c-9554-6b71dbd38d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:13.350267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323fe9b-ad33-442c-9554-6b71dbd38d2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:13.351609 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323fe9b-ad33-442c-9554-6b71dbd38d2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:13.353455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323fe9b-ad33-442c-9554-6b71dbd38d2b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:13.355251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 155/304] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:13.356158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323fe9b-ad33-442c-9554-6b71dbd38d2b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:13.447028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59778fc-5264-45ea-933c-cb093021c732 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:13.465664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323fe9b-ad33-442c-9554-6b71dbd38d2b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:13.485185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d80863-048b-455f-9795-83e4bfc8e82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:13.486397 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d80863-048b-455f-9795-83e4bfc8e82d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:13.486684 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d80863-048b-455f-9795-83e4bfc8e82d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:13.486964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d80863-048b-455f-9795-83e4bfc8e82d None admin] PATH_INFO: `/v3/users/ac7ce4c44fec464c83db337cc0bdda4a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:13.502460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d80863-048b-455f-9795-83e4bfc8e82d None admin] RBAC: Authorizing `identity:get_user(user_id=ac7ce4c44fec464c83db337cc0bdda4a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:13.502936 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80455b-0841-44cd-b547-f9cc4da1ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:13.503618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80455b-0841-44cd-b547-f9cc4da1ff86 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:13.503903 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80455b-0841-44cd-b547-f9cc4da1ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:13.504015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d80863-048b-455f-9795-83e4bfc8e82d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:13.504175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80455b-0841-44cd-b547-f9cc4da1ff86 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:13.504936 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80455b-0841-44cd-b547-f9cc4da1ff86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:13.505254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80455b-0841-44cd-b547-f9cc4da1ff86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:13.510407 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 150/305] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:13 2022] GET /identity/v3/users/ac7ce4c44fec464c83db337cc0bdda4a => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:13.510407 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d80863-048b-455f-9795-83e4bfc8e82d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:13.510610 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80455b-0841-44cd-b547-f9cc4da1ff86 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:13.518651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 156/306] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:13.519483 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80455b-0841-44cd-b547-f9cc4da1ff86 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:13.537790 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:13.552721 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:13.623759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d80863-048b-455f-9795-83e4bfc8e82d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:13.623983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80455b-0841-44cd-b547-f9cc4da1ff86 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:13.662960 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d61bcf-9c4e-48ff-9c13-2dd0237b5cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:13.663622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61bcf-9c4e-48ff-9c13-2dd0237b5cdc None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:13.663999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61bcf-9c4e-48ff-9c13-2dd0237b5cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:13.664241 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d61bcf-9c4e-48ff-9c13-2dd0237b5cdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:13.665114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d61bcf-9c4e-48ff-9c13-2dd0237b5cdc None admin] RBAC: Adding query filter params (role.id=37c1e273f187464f842780ff08196d0c, user.id=ac7ce4c44fec464c83db337cc0bdda4a, scope.system=all) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:13.665431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d61bcf-9c4e-48ff-9c13-2dd0237b5cdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:13.666093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc4c29-fe37-408c-80b2-8fd600d14baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:13.666773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc4c29-fe37-408c-80b2-8fd600d14baf None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:13.667004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d61bcf-9c4e-48ff-9c13-2dd0237b5cdc None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:13.667099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc4c29-fe37-408c-80b2-8fd600d14baf None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:13.667315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc4c29-fe37-408c-80b2-8fd600d14baf None admin] PATH_INFO: `/v3/groups` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:13.668010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc4c29-fe37-408c-80b2-8fd600d14baf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:13.670302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc4c29-fe37-408c-80b2-8fd600d14baf None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:13.682009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 157/307] 10.222.0.83 () {56 vars in 1308 bytes} [Wed Jul 20 22:27:13 2022] GET /identity/v3/role_assignments?user.id=ac7ce4c44fec464c83db337cc0bdda4a&scope.system=all&role.id=37c1e273f187464f842780ff08196d0c => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:13.682009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d61bcf-9c4e-48ff-9c13-2dd0237b5cdc None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:13.775302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 151/308] 10.222.0.83 () {60 vars in 1134 bytes} [Wed Jul 20 22:27:13 2022] POST /identity/v3/groups => generated 229 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:27:13.801192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:13.808068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d61bcf-9c4e-48ff-9c13-2dd0237b5cdc None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:13.827811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ddd1e-6c2f-4fa4-a548-0b9c6bdd8482 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:13.828233 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ddd1e-6c2f-4fa4-a548-0b9c6bdd8482 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:13.828678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ddd1e-6c2f-4fa4-a548-0b9c6bdd8482 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:13.830188 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 152/309] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:27:13.836476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047f028-d618-4b57-9c7d-13bb1417c056 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:13.837023 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047f028-d618-4b57-9c7d-13bb1417c056 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:13.837475 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047f028-d618-4b57-9c7d-13bb1417c056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:13.858244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bd78b-4f38-49eb-bfd7-e589f6b85ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:13.859561 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bd78b-4f38-49eb-bfd7-e589f6b85ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:13.860039 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bd78b-4f38-49eb-bfd7-e589f6b85ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:13.860502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bd78b-4f38-49eb-bfd7-e589f6b85ba0 None admin] PATH_INFO: `/v3/users/88f0b6fac7d44456adb662015cbde200` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:13.861941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3047f028-d618-4b57-9c7d-13bb1417c056 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:13.862368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bd78b-4f38-49eb-bfd7-e589f6b85ba0 None admin] RBAC: Authorizing `identity:get_user(user_id=88f0b6fac7d44456adb662015cbde200)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:13.863191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3047f028-d618-4b57-9c7d-13bb1417c056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:13.864265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3bd78b-4f38-49eb-bfd7-e589f6b85ba0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:13.866449 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 158/310] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:13 2022] GET /identity/v3/users/88f0b6fac7d44456adb662015cbde200 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:13.872239 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bd78b-4f38-49eb-bfd7-e589f6b85ba0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:13.957673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 153/311] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:13.981313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047f028-d618-4b57-9c7d-13bb1417c056 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:13.994521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3bd78b-4f38-49eb-bfd7-e589f6b85ba0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:13.995175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:14.038940 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98994ddf-b33c-4e25-8d9d-0b49f1b9525f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:14.039743 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994ddf-b33c-4e25-8d9d-0b49f1b9525f None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:14.040042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994ddf-b33c-4e25-8d9d-0b49f1b9525f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:14.040308 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98994ddf-b33c-4e25-8d9d-0b49f1b9525f None admin] PATH_INFO: `/v3/system/users/88f0b6fac7d44456adb662015cbde200/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:14.041854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98994ddf-b33c-4e25-8d9d-0b49f1b9525f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=88f0b6fac7d44456adb662015cbde200, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:14.043244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98994ddf-b33c-4e25-8d9d-0b49f1b9525f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:14.101361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047f028-d618-4b57-9c7d-13bb1417c056 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:14.137614 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535669e1-904d-4e50-8e3a-5cca7abeaaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:14.138465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535669e1-904d-4e50-8e3a-5cca7abeaaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:14.138749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535669e1-904d-4e50-8e3a-5cca7abeaaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:14.139023 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535669e1-904d-4e50-8e3a-5cca7abeaaf1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:14.157752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 159/312] 10.222.0.83 () {58 vars in 1334 bytes} [Wed Jul 20 22:27:13 2022] PUT /identity/v3/system/users/88f0b6fac7d44456adb662015cbde200/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:27:14.159656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535669e1-904d-4e50-8e3a-5cca7abeaaf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-535669e1-904d-4e50-8e3a-5cca7abeaaf1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:14.167924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:14.172644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:14.173460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:14.173460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:14.173460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:14.173460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:14.173460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:14.173460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:14.173460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:14.173460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:14.173460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:14.173460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:14.173460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:27:14.173460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:14.173460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 154/313] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:14.176289 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98994ddf-b33c-4e25-8d9d-0b49f1b9525f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:14.210257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:14.302378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98994ddf-b33c-4e25-8d9d-0b49f1b9525f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:14.339218 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2466c-b0cf-4ccc-8b39-ca0b7054cb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:14.339909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2466c-b0cf-4ccc-8b39-ca0b7054cb8e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:14.340200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2466c-b0cf-4ccc-8b39-ca0b7054cb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:14.340481 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2466c-b0cf-4ccc-8b39-ca0b7054cb8e None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:14.341256 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2466c-b0cf-4ccc-8b39-ca0b7054cb8e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:14.341569 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2466c-b0cf-4ccc-8b39-ca0b7054cb8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:14.343599 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec2466c-b0cf-4ccc-8b39-ca0b7054cb8e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:14.353122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 160/314] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:14.359997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535669e1-904d-4e50-8e3a-5cca7abeaaf1 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:14.439152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:14.474386 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535669e1-904d-4e50-8e3a-5cca7abeaaf1 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:14.511985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe72685-1e20-4b65-9302-736d5fadaab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:14.513241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe72685-1e20-4b65-9302-736d5fadaab4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:14.513707 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe72685-1e20-4b65-9302-736d5fadaab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:14.514189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe72685-1e20-4b65-9302-736d5fadaab4 None admin] PATH_INFO: `/v3/users/426e85717ccc49d88336663e65827c5e` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:14.515632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe72685-1e20-4b65-9302-736d5fadaab4 None admin] RBAC: Authorizing `identity:get_user(user_id=426e85717ccc49d88336663e65827c5e)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:14.517300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe72685-1e20-4b65-9302-736d5fadaab4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:14.519519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 155/315] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:14 2022] GET /identity/v3/users/426e85717ccc49d88336663e65827c5e => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:14.525088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2466c-b0cf-4ccc-8b39-ca0b7054cb8e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:14.622390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:14.633815 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2466c-b0cf-4ccc-8b39-ca0b7054cb8e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:14.674316 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3de2b-8c22-4c26-9da2-80e0158bd748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:14.674991 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3de2b-8c22-4c26-9da2-80e0158bd748 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:14.675276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3de2b-8c22-4c26-9da2-80e0158bd748 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:14.675551 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3de2b-8c22-4c26-9da2-80e0158bd748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:14.747889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3de2b-8c22-4c26-9da2-80e0158bd748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:14.749956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3de2b-8c22-4c26-9da2-80e0158bd748 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:14.840429 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:14.855437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 161/316] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:14.861928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe72685-1e20-4b65-9302-736d5fadaab4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:14.974248 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe72685-1e20-4b65-9302-736d5fadaab4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:15.011871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8288c-7cd1-447b-8da3-e2fe8570b8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:15.013110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8288c-7cd1-447b-8da3-e2fe8570b8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:15.013596 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8288c-7cd1-447b-8da3-e2fe8570b8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:15.014096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8288c-7cd1-447b-8da3-e2fe8570b8e8 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:15.015536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8288c-7cd1-447b-8da3-e2fe8570b8e8 None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:15.017199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8288c-7cd1-447b-8da3-e2fe8570b8e8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:15.019170 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 156/317] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:14 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:15.026964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3de2b-8c22-4c26-9da2-80e0158bd748 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:15.130098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3de2b-8c22-4c26-9da2-80e0158bd748 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:15.164315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d580b2-bf0e-473b-8512-428361d32c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:15.164979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d580b2-bf0e-473b-8512-428361d32c0f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:15.165261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d580b2-bf0e-473b-8512-428361d32c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:15.165542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d580b2-bf0e-473b-8512-428361d32c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:15.166423 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d580b2-bf0e-473b-8512-428361d32c0f None admin] RBAC: Adding query filter params (role.id=37c1e273f187464f842780ff08196d0c, scope.project.id=e6537af9fe7a48c5890955b7c03e22c2, user.id=426e85717ccc49d88336663e65827c5e) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:15.166744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d580b2-bf0e-473b-8512-428361d32c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:15.168250 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d580b2-bf0e-473b-8512-428361d32c0f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:15.175245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 162/318] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:15 2022] GET /identity/v3/role_assignments?user.id=426e85717ccc49d88336663e65827c5e&scope.project.id=e6537af9fe7a48c5890955b7c03e22c2&role.id=37c1e273f187464f842780ff08196d0c => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:15.867794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551c411-311f-4d85-8696-3d950b4b6c1a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:15.868312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551c411-311f-4d85-8696-3d950b4b6c1a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:15.868389 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551c411-311f-4d85-8696-3d950b4b6c1a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:15.869920 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 157/319] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:15.875840 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548fa44-7b48-4710-8ddf-e9d125b3d7de None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:15.876292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548fa44-7b48-4710-8ddf-e9d125b3d7de None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:15.876440 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548fa44-7b48-4710-8ddf-e9d125b3d7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:15.894030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8548fa44-7b48-4710-8ddf-e9d125b3d7de None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:15.895230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8548fa44-7b48-4710-8ddf-e9d125b3d7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:15.946923 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:15.964072 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 163/320] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:15.987004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551c411-311f-4d85-8696-3d950b4b6c1a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:15.996841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:16.019701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f990ff8-ec5a-4252-a63c-f9d48e89ef93 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:16.020329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f990ff8-ec5a-4252-a63c-f9d48e89ef93 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:16.020617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f990ff8-ec5a-4252-a63c-f9d48e89ef93 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:16.022396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 164/321] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:27:16.028531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3e3cc-ca89-4aa8-bd98-e936771059d8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:16.028817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3e3cc-ca89-4aa8-bd98-e936771059d8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:16.029095 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3e3cc-ca89-4aa8-bd98-e936771059d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:16.046114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-bca3e3cc-ca89-4aa8-bd98-e936771059d8 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:16.047378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bca3e3cc-ca89-4aa8-bd98-e936771059d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:16.101685 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551c411-311f-4d85-8696-3d950b4b6c1a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:16.127141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 165/322] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:27:16.138501 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d160eba-c3a9-4a5c-b4b3-26b7feae3c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:16.139875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d160eba-c3a9-4a5c-b4b3-26b7feae3c87 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:16.139875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d160eba-c3a9-4a5c-b4b3-26b7feae3c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:16.140206 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d160eba-c3a9-4a5c-b4b3-26b7feae3c87 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:16.149244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3e3cc-ca89-4aa8-bd98-e936771059d8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:16.151185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d160eba-c3a9-4a5c-b4b3-26b7feae3c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-8d160eba-c3a9-4a5c-b4b3-26b7feae3c87 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:16.159370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:16.160418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:16.161289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:16.161289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:16.161289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:16.161289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:16.161289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:16.161289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:16.161289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:16.161289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:16.161289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:16.161289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:16.161289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:27:16.161289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:16.161289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 158/323] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:16.166306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d160eba-c3a9-4a5c-b4b3-26b7feae3c87 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:16.236948 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:16.266803 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3e3cc-ca89-4aa8-bd98-e936771059d8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:16.274964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d160eba-c3a9-4a5c-b4b3-26b7feae3c87 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:16.282262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:16.302208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28bb7c-debb-44e4-823e-d0fa262a52d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:16.303057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28bb7c-debb-44e4-823e-d0fa262a52d5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:16.303382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28bb7c-debb-44e4-823e-d0fa262a52d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:16.303667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28bb7c-debb-44e4-823e-d0fa262a52d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:16.304842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28bb7c-debb-44e4-823e-d0fa262a52d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:16.306323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28bb7c-debb-44e4-823e-d0fa262a52d5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:16.307935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 166/324] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:16.309240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682a71d-c549-40bd-ab61-e6887786fa0b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:16.309534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682a71d-c549-40bd-ab61-e6887786fa0b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:16.310319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682a71d-c549-40bd-ab61-e6887786fa0b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:16.311123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69447da-5ac0-412a-bf3b-3cfeba363ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:16.311796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69447da-5ac0-412a-bf3b-3cfeba363ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:16.312081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69447da-5ac0-412a-bf3b-3cfeba363ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:16.312356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69447da-5ac0-412a-bf3b-3cfeba363ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:16.312750 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 167/325] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:16.313144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69447da-5ac0-412a-bf3b-3cfeba363ab7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:16.313454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69447da-5ac0-412a-bf3b-3cfeba363ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:16.314892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69447da-5ac0-412a-bf3b-3cfeba363ab7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:16.315249 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682a71d-c549-40bd-ab61-e6887786fa0b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:16.323461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 159/326] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:16.325374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d622b-7b78-499e-bc8e-18bc8bc4cc82 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:16.326084 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d622b-7b78-499e-bc8e-18bc8bc4cc82 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:16.326376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d622b-7b78-499e-bc8e-18bc8bc4cc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:16.343832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3b1d622b-7b78-499e-bc8e-18bc8bc4cc82 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:16.345041 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3b1d622b-7b78-499e-bc8e-18bc8bc4cc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:16.412465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 160/327] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:16.413280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d622b-7b78-499e-bc8e-18bc8bc4cc82 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:16.423443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682a71d-c549-40bd-ab61-e6887786fa0b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:16.458089 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1ad27-945e-4649-9500-fd8b4db25914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:16.458789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1ad27-945e-4649-9500-fd8b4db25914 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:16.459068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1ad27-945e-4649-9500-fd8b4db25914 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:16.459344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1ad27-945e-4649-9500-fd8b4db25914 None admin] PATH_INFO: `/v3/groups` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:16.460037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1ad27-945e-4649-9500-fd8b4db25914 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:16.461491 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1ad27-945e-4649-9500-fd8b4db25914 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:16.473254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:16.513939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d622b-7b78-499e-bc8e-18bc8bc4cc82 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:16.546975 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fadb7-1629-4b06-b022-d0d77a10b5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:16.547846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fadb7-1629-4b06-b022-d0d77a10b5fb None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:16.548128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fadb7-1629-4b06-b022-d0d77a10b5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:16.548406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fadb7-1629-4b06-b022-d0d77a10b5fb None admin] PATH_INFO: `/v3/users/ac7ce4c44fec464c83db337cc0bdda4a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:16.549599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fadb7-1629-4b06-b022-d0d77a10b5fb None admin] RBAC: Authorizing `identity:get_user(user_id=ac7ce4c44fec464c83db337cc0bdda4a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:16.551626 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fadb7-1629-4b06-b022-d0d77a10b5fb None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:16.553578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 161/328] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:16 2022] GET /identity/v3/users/ac7ce4c44fec464c83db337cc0bdda4a => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:16.554372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fadb7-1629-4b06-b022-d0d77a10b5fb None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:16.561281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 168/329] 10.222.0.83 () {60 vars in 1134 bytes} [Wed Jul 20 22:27:16 2022] POST /identity/v3/groups => generated 226 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:27:16.562408 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1ad27-945e-4649-9500-fd8b4db25914 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:16.627520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:16.698623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fadb7-1629-4b06-b022-d0d77a10b5fb None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:16.699929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1ad27-945e-4649-9500-fd8b4db25914 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:16.735595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:16.742633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66a06-afa4-41b7-9c3d-71f408dd6204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:16.743505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66a06-afa4-41b7-9c3d-71f408dd6204 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:16.743776 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66a06-afa4-41b7-9c3d-71f408dd6204 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:16.750402 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d66a06-afa4-41b7-9c3d-71f408dd6204 None admin] PATH_INFO: `/v3/system/users/ac7ce4c44fec464c83db337cc0bdda4a/roles/37c1e273f187464f842780ff08196d0c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:16.750402 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d66a06-afa4-41b7-9c3d-71f408dd6204 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ac7ce4c44fec464c83db337cc0bdda4a, role_id=37c1e273f187464f842780ff08196d0c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:16.750653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b538ef-5dd2-4044-a675-8c4d09a67cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:16.750653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b538ef-5dd2-4044-a675-8c4d09a67cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:16.750827 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d66a06-afa4-41b7-9c3d-71f408dd6204 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:16.750925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b538ef-5dd2-4044-a675-8c4d09a67cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:16.750925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b538ef-5dd2-4044-a675-8c4d09a67cb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:16.759466 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b538ef-5dd2-4044-a675-8c4d09a67cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-f0b538ef-5dd2-4044-a675-8c4d09a67cb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:16.768594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:16.769683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:16.770634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:16.770634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:16.770634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:16.770634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:16.770634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:16.770634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:16.770634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:16.770634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:16.770634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:16.770634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:16.770634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:16.770634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:16.770634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 162/330] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:16.775835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b538ef-5dd2-4044-a675-8c4d09a67cb2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:16.825975 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 169/331] 10.222.0.83 () {58 vars in 1334 bytes} [Wed Jul 20 22:27:16 2022] PUT /identity/v3/system/users/ac7ce4c44fec464c83db337cc0bdda4a/roles/37c1e273f187464f842780ff08196d0c => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:27:16.894546 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b538ef-5dd2-4044-a675-8c4d09a67cb2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:16.934688 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b40df-5f64-49f7-a005-73c541468077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:16.935442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b40df-5f64-49f7-a005-73c541468077 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:16.935731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b40df-5f64-49f7-a005-73c541468077 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:16.936010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b40df-5f64-49f7-a005-73c541468077 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:16.937032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b40df-5f64-49f7-a005-73c541468077 None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:16.937394 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b40df-5f64-49f7-a005-73c541468077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:16.939093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9b40df-5f64-49f7-a005-73c541468077 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:16.949056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 163/332] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:16.955409 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66a06-afa4-41b7-9c3d-71f408dd6204 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:17.070135 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d66a06-afa4-41b7-9c3d-71f408dd6204 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:17.078671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:17.110205 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316d0b3-ddcb-49cd-bf2c-6d696d39c590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:17.111120 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316d0b3-ddcb-49cd-bf2c-6d696d39c590 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:17.111455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316d0b3-ddcb-49cd-bf2c-6d696d39c590 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:17.111737 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316d0b3-ddcb-49cd-bf2c-6d696d39c590 None admin] PATH_INFO: `/v3/users/88f0b6fac7d44456adb662015cbde200` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:17.112979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316d0b3-ddcb-49cd-bf2c-6d696d39c590 None admin] RBAC: Authorizing `identity:get_user(user_id=88f0b6fac7d44456adb662015cbde200)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:17.114495 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316d0b3-ddcb-49cd-bf2c-6d696d39c590 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:17.116162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 170/333] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:16 2022] GET /identity/v3/users/88f0b6fac7d44456adb662015cbde200 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:17.122306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b40df-5f64-49f7-a005-73c541468077 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:17.179978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:17.243830 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b40df-5f64-49f7-a005-73c541468077 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:17.288263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed05410-bd7f-4b07-9cb2-d5f12c257d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:17.288934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed05410-bd7f-4b07-9cb2-d5f12c257d31 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:17.289224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed05410-bd7f-4b07-9cb2-d5f12c257d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:17.289503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed05410-bd7f-4b07-9cb2-d5f12c257d31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:17.290438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed05410-bd7f-4b07-9cb2-d5f12c257d31 None admin] RBAC: Adding query filter params (role.id=2749d7dcfd844991883fa3f4e90ed75c, user.id=88f0b6fac7d44456adb662015cbde200, scope.system=all) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:17.290761 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed05410-bd7f-4b07-9cb2-d5f12c257d31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:17.292209 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed05410-bd7f-4b07-9cb2-d5f12c257d31 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:17.307346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 164/334] 10.222.0.83 () {56 vars in 1308 bytes} [Wed Jul 20 22:27:17 2022] GET /identity/v3/role_assignments?user.id=88f0b6fac7d44456adb662015cbde200&scope.system=all&role.id=2749d7dcfd844991883fa3f4e90ed75c => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:19.085812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaa27c-79f1-4fa1-9b8d-4a5a63f1e97b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:19.086279 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaa27c-79f1-4fa1-9b8d-4a5a63f1e97b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:19.086405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaa27c-79f1-4fa1-9b8d-4a5a63f1e97b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:19.088656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 171/335] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:19.094092 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7c4fb-01c3-4b47-94c9-44885bedf57b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:19.095004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7c4fb-01c3-4b47-94c9-44885bedf57b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:19.095486 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7c4fb-01c3-4b47-94c9-44885bedf57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:19.122746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4ae7c4fb-01c3-4b47-94c9-44885bedf57b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:19.124964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4ae7c4fb-01c3-4b47-94c9-44885bedf57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:19.157925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77888f2c-0a56-4b39-aa86-2e31c5a83715 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:19.158557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77888f2c-0a56-4b39-aa86-2e31c5a83715 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:19.159050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77888f2c-0a56-4b39-aa86-2e31c5a83715 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:19.160902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 172/336] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:19.171512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d80ec-6f14-4962-95b3-6ae54a239b25 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:19.172104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d80ec-6f14-4962-95b3-6ae54a239b25 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:19.172578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d80ec-6f14-4962-95b3-6ae54a239b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:19.206787 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-817d80ec-6f14-4962-95b3-6ae54a239b25 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:19.208344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-817d80ec-6f14-4962-95b3-6ae54a239b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:19.213443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 165/337] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:19.245324 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7c4fb-01c3-4b47-94c9-44885bedf57b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:19.298942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:19.315300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 173/338] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 20 22:27:19.336675 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53b241-beec-4346-9ee8-5e617b151cdb None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:19.336875 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53b241-beec-4346-9ee8-5e617b151cdb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:19.337316 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53b241-beec-4346-9ee8-5e617b151cdb None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:19.339180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 174/339] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:27:19.350489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53b241-beec-4346-9ee8-5e617b151cdb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:19.407940 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7c4fb-01c3-4b47-94c9-44885bedf57b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:19.478042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7ffc1c-d494-4ee4-8184-3fc739558272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:19.479161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ffc1c-d494-4ee4-8184-3fc739558272 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:19.479621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ffc1c-d494-4ee4-8184-3fc739558272 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:19.480095 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ffc1c-d494-4ee4-8184-3fc739558272 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:19.506026 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7ffc1c-d494-4ee4-8184-3fc739558272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-be7ffc1c-d494-4ee4-8184-3fc739558272 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:19.514112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:19.515090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:19.515916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:19.515916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:19.515916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:19.515916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:19.515916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:19.515916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:19.515916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:19.515916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:19.515916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:19.515916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:19.515916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 22:27:19.515916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:19.518509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 166/340] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:19.520418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d51bdb-cc80-40fd-be6c-83da88565005 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:19.520929 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d51bdb-cc80-40fd-be6c-83da88565005 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:19.521402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d51bdb-cc80-40fd-be6c-83da88565005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:19.543902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53b241-beec-4346-9ee8-5e617b151cdb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:19.547190 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:19.560703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-36d51bdb-cc80-40fd-be6c-83da88565005 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:19.562281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-36d51bdb-cc80-40fd-be6c-83da88565005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:19.616760 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3856408-e394-4c90-bb30-f5ca66d19cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:19.617463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3856408-e394-4c90-bb30-f5ca66d19cce None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:19.617754 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3856408-e394-4c90-bb30-f5ca66d19cce None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:19.618485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3856408-e394-4c90-bb30-f5ca66d19cce None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:19.631331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3856408-e394-4c90-bb30-f5ca66d19cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c3856408-e394-4c90-bb30-f5ca66d19cce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:19.641252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:19.643319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:19.645373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:19.645373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:19.645373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:19.645373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:19.645373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:19.645373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:19.645373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:19.645373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:19.645373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:19.645373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:19.645373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:19.645373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:19.645373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 175/341] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:19.648416 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3856408-e394-4c90-bb30-f5ca66d19cce None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:19.754188 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 167/342] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:19.756391 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d51bdb-cc80-40fd-be6c-83da88565005 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:19.770121 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3856408-e394-4c90-bb30-f5ca66d19cce None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:19.804848 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:19.832814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4411b-5a50-439d-95c1-53dc4c61ccab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:19.834466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4411b-5a50-439d-95c1-53dc4c61ccab None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:19.835276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4411b-5a50-439d-95c1-53dc4c61ccab None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:19.836037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b4411b-5a50-439d-95c1-53dc4c61ccab None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:19.837710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4411b-5a50-439d-95c1-53dc4c61ccab None admin] RBAC: Adding query filter params (name=reader) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:19.838545 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4411b-5a50-439d-95c1-53dc4c61ccab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:19.841452 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b4411b-5a50-439d-95c1-53dc4c61ccab None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:19.860078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 176/343] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:19.862055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4411b-5a50-439d-95c1-53dc4c61ccab None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:19.901628 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d51bdb-cc80-40fd-be6c-83da88565005 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:19.916749 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:19.945125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee0b04-8137-4266-9869-58eaea3d89ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:19.946276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee0b04-8137-4266-9869-58eaea3d89ed None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:19.946632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee0b04-8137-4266-9869-58eaea3d89ed None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:19.946981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee0b04-8137-4266-9869-58eaea3d89ed None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:19.947875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee0b04-8137-4266-9869-58eaea3d89ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:19.948498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee0b04-8137-4266-9869-58eaea3d89ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:19.949992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee0b04-8137-4266-9869-58eaea3d89ed None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:19.960655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 168/344] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:19.961780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee0b04-8137-4266-9869-58eaea3d89ed None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:20.058315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b4411b-5a50-439d-95c1-53dc4c61ccab None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:20.111392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb969ae1-d769-41fb-a300-7f2d7bf08719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:20.112281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb969ae1-d769-41fb-a300-7f2d7bf08719 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:20.112567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb969ae1-d769-41fb-a300-7f2d7bf08719 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:20.112848 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb969ae1-d769-41fb-a300-7f2d7bf08719 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:20.115265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:20.126154 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb969ae1-d769-41fb-a300-7f2d7bf08719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:20.130600 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee0b04-8137-4266-9869-58eaea3d89ed None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-fb969ae1-d769-41fb-a300-7f2d7bf08719 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:20.134822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:20.146616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:20.147474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:20.147474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:20.147474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:20.147474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:20.147474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:20.147474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:20.147474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:20.147474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:20.147474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:20.147474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:20.147474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:20.147474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:20.147474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 177/345] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:27:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:20.147474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36da77c-ab97-437b-bbd9-406203f1a9db None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:20.148297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36da77c-ab97-437b-bbd9-406203f1a9db None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:20.148297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36da77c-ab97-437b-bbd9-406203f1a9db None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:20.148297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 178/346] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:20.148297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36da77c-ab97-437b-bbd9-406203f1a9db None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:20.187809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c733b-4e19-4c69-b1a9-caf783f1890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:20.188705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c733b-4e19-4c69-b1a9-caf783f1890c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:20.188986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c733b-4e19-4c69-b1a9-caf783f1890c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:20.189263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c733b-4e19-4c69-b1a9-caf783f1890c None admin] PATH_INFO: `/v3/users/ac7ce4c44fec464c83db337cc0bdda4a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:20.191683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c733b-4e19-4c69-b1a9-caf783f1890c None admin] RBAC: Authorizing `identity:get_user(user_id=ac7ce4c44fec464c83db337cc0bdda4a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:20.193166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c733b-4e19-4c69-b1a9-caf783f1890c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:20.195030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 169/347] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:27:19 2022] GET /identity/v3/users/ac7ce4c44fec464c83db337cc0bdda4a => generated 293 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:20.196034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eba14a-34f1-45e1-b91d-565be59edef0 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:20.196321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eba14a-34f1-45e1-b91d-565be59edef0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:20.196600 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eba14a-34f1-45e1-b91d-565be59edef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:20.223449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-61eba14a-34f1-45e1-b91d-565be59edef0 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:20.224966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-61eba14a-34f1-45e1-b91d-565be59edef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:20.264947 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:20.284997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36da77c-ab97-437b-bbd9-406203f1a9db None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:20.316457 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 170/348] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:20.317488 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eba14a-34f1-45e1-b91d-565be59edef0 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:20.331396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7e5cf-6130-4dbb-9627-2f58e4f8285f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:20.332068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7e5cf-6130-4dbb-9627-2f58e4f8285f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:20.332355 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7e5cf-6130-4dbb-9627-2f58e4f8285f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:20.332633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7e5cf-6130-4dbb-9627-2f58e4f8285f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:20.412390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:20.423937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7e5cf-6130-4dbb-9627-2f58e4f8285f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:20.425412 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7e5cf-6130-4dbb-9627-2f58e4f8285f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:20.430828 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eba14a-34f1-45e1-b91d-565be59edef0 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:20.470075 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a23847-1db0-4760-9c18-090a98bc852f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:20.470681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a23847-1db0-4760-9c18-090a98bc852f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:20.470968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a23847-1db0-4760-9c18-090a98bc852f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:20.471365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a23847-1db0-4760-9c18-090a98bc852f None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:20.472144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a23847-1db0-4760-9c18-090a98bc852f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:20.472456 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a23847-1db0-4760-9c18-090a98bc852f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:20.473995 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a23847-1db0-4760-9c18-090a98bc852f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:20.484355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 171/349] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:20.485226 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a23847-1db0-4760-9c18-090a98bc852f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:20.518962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:20.535602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 179/350] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:20.536579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7e5cf-6130-4dbb-9627-2f58e4f8285f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:20.600831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a23847-1db0-4760-9c18-090a98bc852f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:20.641260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b797b-0da5-422f-9b96-14f41e12499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:20.642070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b797b-0da5-422f-9b96-14f41e12499d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:20.642459 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b797b-0da5-422f-9b96-14f41e12499d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:20.642747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56b797b-0da5-422f-9b96-14f41e12499d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:20.643598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b797b-0da5-422f-9b96-14f41e12499d None admin] RBAC: Adding query filter params (role.id=37c1e273f187464f842780ff08196d0c, user.id=ac7ce4c44fec464c83db337cc0bdda4a, scope.system=all) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:20.643919 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b797b-0da5-422f-9b96-14f41e12499d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:20.645283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7e5cf-6130-4dbb-9627-2f58e4f8285f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:20.645486 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56b797b-0da5-422f-9b96-14f41e12499d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:20.659256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 172/351] 10.222.0.83 () {56 vars in 1308 bytes} [Wed Jul 20 22:27:20 2022] GET /identity/v3/role_assignments?user.id=ac7ce4c44fec464c83db337cc0bdda4a&scope.system=all&role.id=37c1e273f187464f842780ff08196d0c => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:20.660250 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b797b-0da5-422f-9b96-14f41e12499d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:20.689398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:20.689947 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251aae4-8f9a-4f09-a7f3-5e55ec7b9b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:20.691813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251aae4-8f9a-4f09-a7f3-5e55ec7b9b57 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:20.692097 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251aae4-8f9a-4f09-a7f3-5e55ec7b9b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:20.692379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251aae4-8f9a-4f09-a7f3-5e55ec7b9b57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:20.722814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251aae4-8f9a-4f09-a7f3-5e55ec7b9b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-2251aae4-8f9a-4f09-a7f3-5e55ec7b9b57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:20.731431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:20.732401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:20.738237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:20.738237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:20.738237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:20.738237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:20.738237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:20.738237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:20.738237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:20.738237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:20.738237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:20.738237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:20.738237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:20.738237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:20.740546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 180/352] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:20.741611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251aae4-8f9a-4f09-a7f3-5e55ec7b9b57 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:20.824038 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56b797b-0da5-422f-9b96-14f41e12499d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:20.840675 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:20.872944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26edbb-9f18-4a28-8796-374534836054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:20.874414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26edbb-9f18-4a28-8796-374534836054 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:20.874717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26edbb-9f18-4a28-8796-374534836054 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:20.875091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26edbb-9f18-4a28-8796-374534836054 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:20.965164 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26edbb-9f18-4a28-8796-374534836054 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:20.966697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26edbb-9f18-4a28-8796-374534836054 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:20.973614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251aae4-8f9a-4f09-a7f3-5e55ec7b9b57 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:20.978097 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:21.029172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0c24b-afb9-49f6-8c6f-724558a20e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:21.030206 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0c24b-afb9-49f6-8c6f-724558a20e26 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:21.030502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0c24b-afb9-49f6-8c6f-724558a20e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:21.031009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0c24b-afb9-49f6-8c6f-724558a20e26 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:21.032271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0c24b-afb9-49f6-8c6f-724558a20e26 None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:21.033914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0c24b-afb9-49f6-8c6f-724558a20e26 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:21.036057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 181/353] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:20 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:21.036941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0c24b-afb9-49f6-8c6f-724558a20e26 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:21.111554 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 173/354] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:21.112259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26edbb-9f18-4a28-8796-374534836054 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:21.152797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0c24b-afb9-49f6-8c6f-724558a20e26 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:21.168070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:21.191400 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b46ce0-fc0c-4c48-8a52-9e5310c32ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:21.192096 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b46ce0-fc0c-4c48-8a52-9e5310c32ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:21.192390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b46ce0-fc0c-4c48-8a52-9e5310c32ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:21.192672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b46ce0-fc0c-4c48-8a52-9e5310c32ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:21.193624 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b46ce0-fc0c-4c48-8a52-9e5310c32ed9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:21.194145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b46ce0-fc0c-4c48-8a52-9e5310c32ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:21.195843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b46ce0-fc0c-4c48-8a52-9e5310c32ed9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:21.207725 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 182/355] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:21.208908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b46ce0-fc0c-4c48-8a52-9e5310c32ed9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:21.226515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26edbb-9f18-4a28-8796-374534836054 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:21.236354 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:21.273297 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964c4a56-f008-4b73-989c-b5c12af9c221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:21.274594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c4a56-f008-4b73-989c-b5c12af9c221 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:21.275478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c4a56-f008-4b73-989c-b5c12af9c221 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:21.275938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964c4a56-f008-4b73-989c-b5c12af9c221 None admin] PATH_INFO: `/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:21.284653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c4a56-f008-4b73-989c-b5c12af9c221 None admin] RBAC: Authorizing `identity:get_group(group_id=1ccd95c5d9ca4835a5292437e10d59c8)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:21.287042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964c4a56-f008-4b73-989c-b5c12af9c221 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:21.289407 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 174/356] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:21 2022] GET /identity/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:21.291753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d909a-3e0d-4185-980f-cd19535d3c04 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:21.292242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d909a-3e0d-4185-980f-cd19535d3c04 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:21.292818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d909a-3e0d-4185-980f-cd19535d3c04 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:21.295177 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 175/357] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:21.296881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d909a-3e0d-4185-980f-cd19535d3c04 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:21.348922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b46ce0-fc0c-4c48-8a52-9e5310c32ed9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:21.393753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627f47e-99df-411b-983f-b3405c84e420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:21.394979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627f47e-99df-411b-983f-b3405c84e420 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:21.395285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627f47e-99df-411b-983f-b3405c84e420 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:21.395789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627f47e-99df-411b-983f-b3405c84e420 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:21.397059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627f47e-99df-411b-983f-b3405c84e420 None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:21.399127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627f47e-99df-411b-983f-b3405c84e420 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:21.401922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 183/358] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:21 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:21.401922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627f47e-99df-411b-983f-b3405c84e420 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:21.421573 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d909a-3e0d-4185-980f-cd19535d3c04 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:21.462958 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:21.466860 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87158a48-fb93-40a2-be4a-a8e642e58a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:21.467998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158a48-fb93-40a2-be4a-a8e642e58a44 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:21.468545 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158a48-fb93-40a2-be4a-a8e642e58a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:21.468990 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87158a48-fb93-40a2-be4a-a8e642e58a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:21.517665 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:21.539073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627f47e-99df-411b-983f-b3405c84e420 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:21.555523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87158a48-fb93-40a2-be4a-a8e642e58a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:21.557409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87158a48-fb93-40a2-be4a-a8e642e58a44 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:21.584527 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d17a6-1e7b-4d65-b80a-2462c36f40c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:21.585196 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d17a6-1e7b-4d65-b80a-2462c36f40c3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:21.585480 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d17a6-1e7b-4d65-b80a-2462c36f40c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:21.585791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d17a6-1e7b-4d65-b80a-2462c36f40c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:21.586634 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d17a6-1e7b-4d65-b80a-2462c36f40c3 None admin] RBAC: Adding query filter params (group.id=1ccd95c5d9ca4835a5292437e10d59c8, role.id=2749d7dcfd844991883fa3f4e90ed75c, scope.project.id=6020d15ded71492c8adbc59366b3f07d) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:21.586950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d17a6-1e7b-4d65-b80a-2462c36f40c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:21.588486 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d17a6-1e7b-4d65-b80a-2462c36f40c3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:21.599843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 184/359] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 20 22:27:21 2022] GET /identity/v3/role_assignments?group.id=1ccd95c5d9ca4835a5292437e10d59c8&scope.project.id=6020d15ded71492c8adbc59366b3f07d&role.id=2749d7dcfd844991883fa3f4e90ed75c => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:21.601146 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48c7d2-694c-42f1-b241-10c0abf30954 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:21.601439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48c7d2-694c-42f1-b241-10c0abf30954 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:21.602094 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae48c7d2-694c-42f1-b241-10c0abf30954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:21.621299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ae48c7d2-694c-42f1-b241-10c0abf30954 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:21.622680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ae48c7d2-694c-42f1-b241-10c0abf30954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:21.702667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 176/360] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:21.703376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87158a48-fb93-40a2-be4a-a8e642e58a44 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:21.722789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 185/361] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:21.724122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48c7d2-694c-42f1-b241-10c0abf30954 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:21.770897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:21.781985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:21.827977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87158a48-fb93-40a2-be4a-a8e642e58a44 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:21.848832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae48c7d2-694c-42f1-b241-10c0abf30954 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:21.873695 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf00f90-6f39-4dba-9104-c1b03756a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:21.874690 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf00f90-6f39-4dba-9104-c1b03756a532 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:21.874977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf00f90-6f39-4dba-9104-c1b03756a532 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:21.875258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf00f90-6f39-4dba-9104-c1b03756a532 None admin] PATH_INFO: `/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:21.876449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf00f90-6f39-4dba-9104-c1b03756a532 None admin] RBAC: Authorizing `identity:get_group(group_id=1ccd95c5d9ca4835a5292437e10d59c8)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:21.878011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf00f90-6f39-4dba-9104-c1b03756a532 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:21.879830 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 177/362] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:21 2022] GET /identity/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:21.881123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf00f90-6f39-4dba-9104-c1b03756a532 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:21.898398 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdf930-b6c0-459d-b98e-278b4b8765af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:21.899280 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdf930-b6c0-459d-b98e-278b4b8765af None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:21.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdf930-b6c0-459d-b98e-278b4b8765af None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:21.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdf930-b6c0-459d-b98e-278b4b8765af None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:21.902282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdf930-b6c0-459d-b98e-278b4b8765af None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:21.903736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdf930-b6c0-459d-b98e-278b4b8765af None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:21.909792 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 186/363] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:21 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:21.909792 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17e61b-a598-4657-ae37-b8d67d6461b4 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:21.909792 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17e61b-a598-4657-ae37-b8d67d6461b4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:21.909792 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17e61b-a598-4657-ae37-b8d67d6461b4 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:21.910948 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 187/364] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:21.911738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17e61b-a598-4657-ae37-b8d67d6461b4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:22.015526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf00f90-6f39-4dba-9104-c1b03756a532 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:22.045221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17e61b-a598-4657-ae37-b8d67d6461b4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:22.056528 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:22.062525 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b67bd-9f92-47b6-9bba-835c47520d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:22.063420 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b67bd-9f92-47b6-9bba-835c47520d44 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:22.069056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b67bd-9f92-47b6-9bba-835c47520d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:22.069056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b67bd-9f92-47b6-9bba-835c47520d44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:22.073468 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:22.081055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b67bd-9f92-47b6-9bba-835c47520d44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-185b67bd-9f92-47b6-9bba-835c47520d44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:22.090574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:22.091512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:22.093007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:22.093007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:22.093007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:22.093007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:22.093007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:22.093007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:22.093007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:22.093007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:22.093007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:22.093007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:22.093007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:22.093007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:22.093007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 178/365] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:27:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:22.093697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b67bd-9f92-47b6-9bba-835c47520d44 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:22.108060 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6501ec7-ab04-418d-ab91-21fc8e6f194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:22.108905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6501ec7-ab04-418d-ab91-21fc8e6f194c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:22.109194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6501ec7-ab04-418d-ab91-21fc8e6f194c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:22.110360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6501ec7-ab04-418d-ab91-21fc8e6f194c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:22.110360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6501ec7-ab04-418d-ab91-21fc8e6f194c None admin] RBAC: Adding query filter params (group.id=1ccd95c5d9ca4835a5292437e10d59c8, role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48, scope.project.id=6020d15ded71492c8adbc59366b3f07d) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:22.110729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6501ec7-ab04-418d-ab91-21fc8e6f194c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:22.112184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6501ec7-ab04-418d-ab91-21fc8e6f194c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:22.119175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 188/366] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 20 22:27:21 2022] GET /identity/v3/role_assignments?group.id=1ccd95c5d9ca4835a5292437e10d59c8&scope.project.id=6020d15ded71492c8adbc59366b3f07d&role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:22.120276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ec071-1321-4469-8fd0-8fcd1a9c9300 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:22.120554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ec071-1321-4469-8fd0-8fcd1a9c9300 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:22.121104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243ec071-1321-4469-8fd0-8fcd1a9c9300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:22.141931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-243ec071-1321-4469-8fd0-8fcd1a9c9300 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:22.143230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-243ec071-1321-4469-8fd0-8fcd1a9c9300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:22.237208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 189/367] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:22.239092 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ec071-1321-4469-8fd0-8fcd1a9c9300 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:22.244782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b67bd-9f92-47b6-9bba-835c47520d44 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:22.289005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208979b8-6d4d-4e6c-8e62-5b9ca10cc362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:22.290516 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208979b8-6d4d-4e6c-8e62-5b9ca10cc362 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:22.290835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208979b8-6d4d-4e6c-8e62-5b9ca10cc362 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:22.291325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208979b8-6d4d-4e6c-8e62-5b9ca10cc362 None admin] PATH_INFO: `/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:22.292644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208979b8-6d4d-4e6c-8e62-5b9ca10cc362 None admin] RBAC: Authorizing `identity:get_group(group_id=1ccd95c5d9ca4835a5292437e10d59c8)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:22.294139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208979b8-6d4d-4e6c-8e62-5b9ca10cc362 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:22.296454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 179/368] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:22 2022] GET /identity/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:22.296988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208979b8-6d4d-4e6c-8e62-5b9ca10cc362 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:22.372241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:22.390399 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:22.393756 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243ec071-1321-4469-8fd0-8fcd1a9c9300 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:22.409284 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208979b8-6d4d-4e6c-8e62-5b9ca10cc362 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:22.430782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b06ca0-e1f1-4545-88f8-4fca16833aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:22.431468 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b06ca0-e1f1-4545-88f8-4fca16833aaa None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:22.431756 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b06ca0-e1f1-4545-88f8-4fca16833aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:22.432032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b06ca0-e1f1-4545-88f8-4fca16833aaa None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:22.432788 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b06ca0-e1f1-4545-88f8-4fca16833aaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:22.433152 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b06ca0-e1f1-4545-88f8-4fca16833aaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:22.434673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b06ca0-e1f1-4545-88f8-4fca16833aaa None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:22.444605 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 190/369] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:22.445575 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b06ca0-e1f1-4545-88f8-4fca16833aaa None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:22.447136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6f0e4-35c2-48e4-956f-0ac048197e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:22.447947 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6f0e4-35c2-48e4-956f-0ac048197e21 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:22.448233 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6f0e4-35c2-48e4-956f-0ac048197e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:22.448511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6f0e4-35c2-48e4-956f-0ac048197e21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:22.460883 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6f0e4-35c2-48e4-956f-0ac048197e21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-2be6f0e4-35c2-48e4-956f-0ac048197e21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:22.469992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:22.470921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:22.471731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:22.471731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:22.471731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:22.471731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:22.471731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:22.471731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:22.471731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:22.471731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:22.471731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:22.471731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:22.471731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:27:22.471731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:22.471731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 180/370] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:27:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:22.472391 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6f0e4-35c2-48e4-956f-0ac048197e21 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:22.565574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b06ca0-e1f1-4545-88f8-4fca16833aaa None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:22.596461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6f0e4-35c2-48e4-956f-0ac048197e21 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:22.612226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420fa46-b8d9-481e-889e-7142e2f0be7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:22.613281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420fa46-b8d9-481e-889e-7142e2f0be7c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:22.613574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420fa46-b8d9-481e-889e-7142e2f0be7c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:22.613894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420fa46-b8d9-481e-889e-7142e2f0be7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:22.615025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420fa46-b8d9-481e-889e-7142e2f0be7c None admin] RBAC: Adding query filter params (group.id=1ccd95c5d9ca4835a5292437e10d59c8, role.id=2749d7dcfd844991883fa3f4e90ed75c, scope.project.id=e6537af9fe7a48c5890955b7c03e22c2) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:22.615344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420fa46-b8d9-481e-889e-7142e2f0be7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:22.617253 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3420fa46-b8d9-481e-889e-7142e2f0be7c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:22.626802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 191/371] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 20 22:27:22 2022] GET /identity/v3/role_assignments?group.id=1ccd95c5d9ca4835a5292437e10d59c8&scope.project.id=e6537af9fe7a48c5890955b7c03e22c2&role.id=2749d7dcfd844991883fa3f4e90ed75c => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:22.627002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:22.627652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420fa46-b8d9-481e-889e-7142e2f0be7c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:22.649007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87930fc-49d4-4e7d-aa2f-4bd183e15b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:22.650058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87930fc-49d4-4e7d-aa2f-4bd183e15b85 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:22.650526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87930fc-49d4-4e7d-aa2f-4bd183e15b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:22.651012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87930fc-49d4-4e7d-aa2f-4bd183e15b85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:22.694123 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:22.804224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87930fc-49d4-4e7d-aa2f-4bd183e15b85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:22.807992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87930fc-49d4-4e7d-aa2f-4bd183e15b85 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:22.831580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420fa46-b8d9-481e-889e-7142e2f0be7c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:22.869802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9805c7-0d7b-47ef-b7de-eddc7ca118ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:22.870994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9805c7-0d7b-47ef-b7de-eddc7ca118ea None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:22.871461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9805c7-0d7b-47ef-b7de-eddc7ca118ea None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:22.871919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9805c7-0d7b-47ef-b7de-eddc7ca118ea None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:22.872984 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9805c7-0d7b-47ef-b7de-eddc7ca118ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:22.873524 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9805c7-0d7b-47ef-b7de-eddc7ca118ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:22.875825 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9805c7-0d7b-47ef-b7de-eddc7ca118ea None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:22.886176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 192/372] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:22.891798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9805c7-0d7b-47ef-b7de-eddc7ca118ea None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:22.982757 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 181/373] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:22.989270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87930fc-49d4-4e7d-aa2f-4bd183e15b85 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:23.001360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:23.015595 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9805c7-0d7b-47ef-b7de-eddc7ca118ea None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:23.056440 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab84503-18ea-408b-9c4b-99be55fa3355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:23.057117 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab84503-18ea-408b-9c4b-99be55fa3355 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:23.057405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab84503-18ea-408b-9c4b-99be55fa3355 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:23.057686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab84503-18ea-408b-9c4b-99be55fa3355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:23.063628 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:23.137618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab84503-18ea-408b-9c4b-99be55fa3355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:23.139305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab84503-18ea-408b-9c4b-99be55fa3355 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:23.216312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87930fc-49d4-4e7d-aa2f-4bd183e15b85 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:23.259665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:23.260329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 193/374] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:23.266932 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab84503-18ea-408b-9c4b-99be55fa3355 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:23.294967 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1a97f-f66b-42a7-a57c-ff51f201ded4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:23.295905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1a97f-f66b-42a7-a57c-ff51f201ded4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:23.296199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1a97f-f66b-42a7-a57c-ff51f201ded4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:23.296471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1a97f-f66b-42a7-a57c-ff51f201ded4 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:23.302477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1a97f-f66b-42a7-a57c-ff51f201ded4 None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:23.303974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1a97f-f66b-42a7-a57c-ff51f201ded4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:23.305749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 182/375] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:22 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:23.313892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1a97f-f66b-42a7-a57c-ff51f201ded4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:23.378119 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab84503-18ea-408b-9c4b-99be55fa3355 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:23.417193 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288544f5-6f79-48d6-b1ab-068e53bdcf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:23.418055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288544f5-6f79-48d6-b1ab-068e53bdcf21 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:23.418349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288544f5-6f79-48d6-b1ab-068e53bdcf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:23.418645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288544f5-6f79-48d6-b1ab-068e53bdcf21 None admin] PATH_INFO: `/v3/projects/63d2e7ee31ba4d05b54d5a20dae7a17b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:23.420017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288544f5-6f79-48d6-b1ab-068e53bdcf21 None admin] RBAC: Authorizing `identity:get_project(project_id=63d2e7ee31ba4d05b54d5a20dae7a17b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:23.422189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288544f5-6f79-48d6-b1ab-068e53bdcf21 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:23.424334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 194/376] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:23 2022] GET /identity/v3/projects/63d2e7ee31ba4d05b54d5a20dae7a17b => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:23.429695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288544f5-6f79-48d6-b1ab-068e53bdcf21 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:23.484946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:23.492082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1a97f-f66b-42a7-a57c-ff51f201ded4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:23.493691 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:23.532975 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac0faa-2e13-4010-8159-fab80e8c3298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:23.533936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac0faa-2e13-4010-8159-fab80e8c3298 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:23.534224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac0faa-2e13-4010-8159-fab80e8c3298 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:23.534502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ac0faa-2e13-4010-8159-fab80e8c3298 None admin] PATH_INFO: `/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:23.536772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac0faa-2e13-4010-8159-fab80e8c3298 None admin] RBAC: Authorizing `identity:get_group(group_id=1ccd95c5d9ca4835a5292437e10d59c8)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:23.538340 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ac0faa-2e13-4010-8159-fab80e8c3298 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:23.543062 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 183/377] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:23 2022] GET /identity/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:23.543634 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288544f5-6f79-48d6-b1ab-068e53bdcf21 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:23.547242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac0faa-2e13-4010-8159-fab80e8c3298 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:23.585166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be607e81-20e2-4266-b5ee-177a6d29f6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:23.586388 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be607e81-20e2-4266-b5ee-177a6d29f6af None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:23.586865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be607e81-20e2-4266-b5ee-177a6d29f6af None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:23.587405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be607e81-20e2-4266-b5ee-177a6d29f6af None admin] PATH_INFO: `/v3/groups/1b76b83585f84d9f8fdc0afb283b8c5f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:23.596872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be607e81-20e2-4266-b5ee-177a6d29f6af None admin] RBAC: Authorizing `identity:get_group(group_id=1b76b83585f84d9f8fdc0afb283b8c5f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:23.598778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be607e81-20e2-4266-b5ee-177a6d29f6af None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:23.601098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 195/378] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:23 2022] GET /identity/v3/groups/1b76b83585f84d9f8fdc0afb283b8c5f => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:23.607397 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be607e81-20e2-4266-b5ee-177a6d29f6af None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:23.671033 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ac0faa-2e13-4010-8159-fab80e8c3298 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:23.715812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea3201-87c9-4f31-9a7f-d0dfa860e06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:23.716506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea3201-87c9-4f31-9a7f-d0dfa860e06d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:23.716793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea3201-87c9-4f31-9a7f-d0dfa860e06d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:23.717075 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea3201-87c9-4f31-9a7f-d0dfa860e06d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:23.718811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea3201-87c9-4f31-9a7f-d0dfa860e06d None admin] RBAC: Adding query filter params (group.id=1ccd95c5d9ca4835a5292437e10d59c8, role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48, scope.project.id=e6537af9fe7a48c5890955b7c03e22c2) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:23.719202 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea3201-87c9-4f31-9a7f-d0dfa860e06d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:23.720750 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea3201-87c9-4f31-9a7f-d0dfa860e06d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:23.732069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 184/379] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 20 22:27:23 2022] GET /identity/v3/role_assignments?group.id=1ccd95c5d9ca4835a5292437e10d59c8&scope.project.id=e6537af9fe7a48c5890955b7c03e22c2&role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:23.744239 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be607e81-20e2-4266-b5ee-177a6d29f6af None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:23.769834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:23.785867 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99ff8e-8e69-484a-859d-8844f5cedc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:23.786541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99ff8e-8e69-484a-859d-8844f5cedc4a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:23.786828 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99ff8e-8e69-484a-859d-8844f5cedc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:23.787106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99ff8e-8e69-484a-859d-8844f5cedc4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:23.787963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99ff8e-8e69-484a-859d-8844f5cedc4a None admin] RBAC: Adding query filter params (group.id=1b76b83585f84d9f8fdc0afb283b8c5f, role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=63d2e7ee31ba4d05b54d5a20dae7a17b) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:23.788277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99ff8e-8e69-484a-859d-8844f5cedc4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:23.789889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99ff8e-8e69-484a-859d-8844f5cedc4a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:23.796236 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 196/380] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 20 22:27:23 2022] GET /identity/v3/role_assignments?group.id=1b76b83585f84d9f8fdc0afb283b8c5f&scope.project.id=63d2e7ee31ba4d05b54d5a20dae7a17b&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:24.180759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197a760-356a-47df-83bb-0c8178665149 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:24.181110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197a760-356a-47df-83bb-0c8178665149 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:24.181323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197a760-356a-47df-83bb-0c8178665149 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:24.182865 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 185/381] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:24.189131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082feb10-6f7d-4b7e-adb9-2a8f0ab06f18 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:24.189422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082feb10-6f7d-4b7e-adb9-2a8f0ab06f18 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:24.189701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082feb10-6f7d-4b7e-adb9-2a8f0ab06f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:24.211162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-082feb10-6f7d-4b7e-adb9-2a8f0ab06f18 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:24.212368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-082feb10-6f7d-4b7e-adb9-2a8f0ab06f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:24.302246 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 197/382] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:24.337057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197a760-356a-47df-83bb-0c8178665149 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:24.371961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:24.472897 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197a760-356a-47df-83bb-0c8178665149 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:24.511509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a0f1e-d6d3-4d86-ba16-5d302c3cffc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:24.512506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a0f1e-d6d3-4d86-ba16-5d302c3cffc8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:24.512790 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a0f1e-d6d3-4d86-ba16-5d302c3cffc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:24.513069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a0f1e-d6d3-4d86-ba16-5d302c3cffc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:24.526649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a0f1e-d6d3-4d86-ba16-5d302c3cffc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ad3a0f1e-d6d3-4d86-ba16-5d302c3cffc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:24.535197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:24.536151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:24.537009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:24.537009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:24.537009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:24.537009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:24.537009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:24.537009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:24.537009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:24.537009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:24.537009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:24.537009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:24.537009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:24.537009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:24.537009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 186/383] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:24.542482 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082feb10-6f7d-4b7e-adb9-2a8f0ab06f18 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:24.664685 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082feb10-6f7d-4b7e-adb9-2a8f0ab06f18 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:24.683540 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:24.704944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397e4bb-8375-494d-b61c-b50c89cdc850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:24.705625 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397e4bb-8375-494d-b61c-b50c89cdc850 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:24.705943 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397e4bb-8375-494d-b61c-b50c89cdc850 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:24.706208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397e4bb-8375-494d-b61c-b50c89cdc850 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:24.706982 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397e4bb-8375-494d-b61c-b50c89cdc850 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:24.707302 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397e4bb-8375-494d-b61c-b50c89cdc850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:24.708696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6397e4bb-8375-494d-b61c-b50c89cdc850 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:24.710992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198ebf3-f730-4a7e-9350-76ae7368975c None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:24.711275 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198ebf3-f730-4a7e-9350-76ae7368975c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:24.711555 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198ebf3-f730-4a7e-9350-76ae7368975c None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:24.712980 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 187/384] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:27:24.718846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760e49d-d07a-48fd-90fa-e4b07d76d57a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:24.719146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760e49d-d07a-48fd-90fa-e4b07d76d57a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:24.719400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760e49d-d07a-48fd-90fa-e4b07d76d57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:24.739520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 198/385] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:24.746669 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397e4bb-8375-494d-b61c-b50c89cdc850 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:24.747948 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7760e49d-d07a-48fd-90fa-e4b07d76d57a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:24.751845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7760e49d-d07a-48fd-90fa-e4b07d76d57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:24.894567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 188/386] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:27:24.928222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6397e4bb-8375-494d-b61c-b50c89cdc850 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:24.965520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760e49d-d07a-48fd-90fa-e4b07d76d57a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:24.987602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab1bb5-6bbc-4f81-b8f5-0af34c3fecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:24.989025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab1bb5-6bbc-4f81-b8f5-0af34c3fecf9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:24.990359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab1bb5-6bbc-4f81-b8f5-0af34c3fecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:24.991020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab1bb5-6bbc-4f81-b8f5-0af34c3fecf9 None admin] PATH_INFO: `/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:24.993310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:24.994953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab1bb5-6bbc-4f81-b8f5-0af34c3fecf9 None admin] RBAC: Authorizing `identity:get_group(group_id=1ccd95c5d9ca4835a5292437e10d59c8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:24.997547 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab1bb5-6bbc-4f81-b8f5-0af34c3fecf9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:25.002195 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 199/387] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:24 2022] GET /identity/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:25.017788 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab1bb5-6bbc-4f81-b8f5-0af34c3fecf9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:25.090540 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:25.161584 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760e49d-d07a-48fd-90fa-e4b07d76d57a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:25.196250 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab1bb5-6bbc-4f81-b8f5-0af34c3fecf9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:25.231595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139fdf4-6cac-4f60-9756-57513d9a64a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:25.232412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139fdf4-6cac-4f60-9756-57513d9a64a0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:25.232700 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139fdf4-6cac-4f60-9756-57513d9a64a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:25.233859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139fdf4-6cac-4f60-9756-57513d9a64a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:25.254074 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139fdf4-6cac-4f60-9756-57513d9a64a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-2139fdf4-6cac-4f60-9756-57513d9a64a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:25.262349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:25.263259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:25.264113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:25.264113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:25.264113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:25.264113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:25.264113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:25.264113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:25.264113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:25.264113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:25.264113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:25.264113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:25.264113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:25.264113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:25.264113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 189/388] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:27:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:25.268758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6894f-0c1a-4321-aeb9-50e39688e563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:25.269911 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6894f-0c1a-4321-aeb9-50e39688e563 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:25.270392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6894f-0c1a-4321-aeb9-50e39688e563 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:25.270661 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139fdf4-6cac-4f60-9756-57513d9a64a0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:25.271199 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6894f-0c1a-4321-aeb9-50e39688e563 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:25.272609 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6894f-0c1a-4321-aeb9-50e39688e563 None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:25.274314 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6894f-0c1a-4321-aeb9-50e39688e563 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:25.276249 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 200/389] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:25 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:25.282859 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6894f-0c1a-4321-aeb9-50e39688e563 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:25.395173 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:25.421782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139fdf4-6cac-4f60-9756-57513d9a64a0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:25.444350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6894f-0c1a-4321-aeb9-50e39688e563 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:25.459078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:25.463534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca6246-638d-4f35-8004-5443f54a5046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:25.464488 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca6246-638d-4f35-8004-5443f54a5046 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:25.464961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca6246-638d-4f35-8004-5443f54a5046 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:25.465425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca6246-638d-4f35-8004-5443f54a5046 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:25.466524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca6246-638d-4f35-8004-5443f54a5046 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:25.467041 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca6246-638d-4f35-8004-5443f54a5046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:25.468747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca6246-638d-4f35-8004-5443f54a5046 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:25.477569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 190/390] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:25.477569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9cb94-113c-40cd-9d16-0db39e9cd168 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:25.477569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9cb94-113c-40cd-9d16-0db39e9cd168 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:25.477569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c9cb94-113c-40cd-9d16-0db39e9cd168 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:25.477569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 191/391] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:25.486048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9cb94-113c-40cd-9d16-0db39e9cd168 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:25.489576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4fdf1-2258-4cef-80f1-ec17884adf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:25.490845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4fdf1-2258-4cef-80f1-ec17884adf7a None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:25.491131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4fdf1-2258-4cef-80f1-ec17884adf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:25.491412 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4fdf1-2258-4cef-80f1-ec17884adf7a None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d/groups/1ccd95c5d9ca4835a5292437e10d59c8/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:25.493488 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4fdf1-2258-4cef-80f1-ec17884adf7a None admin] RBAC: Authorizing `identity:create_grant(project_id=6020d15ded71492c8adbc59366b3f07d, group_id=1ccd95c5d9ca4835a5292437e10d59c8, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:25.495026 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4fdf1-2258-4cef-80f1-ec17884adf7a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:25.614277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c9cb94-113c-40cd-9d16-0db39e9cd168 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:25.615322 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 201/392] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Jul 20 22:27:25 2022] PUT /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d/groups/1ccd95c5d9ca4835a5292437e10d59c8/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:27:25.616838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc94a0-8666-4355-8bb7-f2de96672eff None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:25.617138 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc94a0-8666-4355-8bb7-f2de96672eff None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:25.617475 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc94a0-8666-4355-8bb7-f2de96672eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:25.655951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c346c22-44ba-43ad-9790-3e94cde874d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:25.657242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c346c22-44ba-43ad-9790-3e94cde874d4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:25.657602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c6dc94a0-8666-4355-8bb7-f2de96672eff None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:25.658037 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c346c22-44ba-43ad-9790-3e94cde874d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:25.658538 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c346c22-44ba-43ad-9790-3e94cde874d4 None admin] PATH_INFO: `/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:25.658946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c6dc94a0-8666-4355-8bb7-f2de96672eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:25.660186 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c346c22-44ba-43ad-9790-3e94cde874d4 None admin] RBAC: Authorizing `identity:get_group(group_id=1ccd95c5d9ca4835a5292437e10d59c8)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:25.662080 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c346c22-44ba-43ad-9790-3e94cde874d4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:25.664351 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 192/393] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:25 2022] GET /identity/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:25.672046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c346c22-44ba-43ad-9790-3e94cde874d4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:25.691451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:25.785533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 202/394] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:25.830677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc94a0-8666-4355-8bb7-f2de96672eff None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:25.850647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c346c22-44ba-43ad-9790-3e94cde874d4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:25.917184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9d38f-7eeb-4401-ad07-f36cc2094043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:25.918889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9d38f-7eeb-4401-ad07-f36cc2094043 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:25.919400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9d38f-7eeb-4401-ad07-f36cc2094043 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:25.919882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9d38f-7eeb-4401-ad07-f36cc2094043 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:25.922366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9d38f-7eeb-4401-ad07-f36cc2094043 None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:25.924845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9d38f-7eeb-4401-ad07-f36cc2094043 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:25.928133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 193/395] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:25 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:25.933847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9d38f-7eeb-4401-ad07-f36cc2094043 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:25.992316 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc94a0-8666-4355-8bb7-f2de96672eff None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:25.994680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:26.072388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:26.077959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc57f-123f-4e7f-a7ec-0f3239bd36a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:26.078989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc57f-123f-4e7f-a7ec-0f3239bd36a8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:26.079499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc57f-123f-4e7f-a7ec-0f3239bd36a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:26.079918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffc57f-123f-4e7f-a7ec-0f3239bd36a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:26.106587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ffc57f-123f-4e7f-a7ec-0f3239bd36a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-48ffc57f-123f-4e7f-a7ec-0f3239bd36a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:26.116701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:26.117661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:26.118509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:26.118509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:26.118509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:26.118509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:26.118509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:26.118509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:26.118509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:26.118509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:26.118509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:26.118509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:26.118509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:26.118509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:26.118509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 203/396] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:26.127602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc57f-123f-4e7f-a7ec-0f3239bd36a8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:26.138587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9d38f-7eeb-4401-ad07-f36cc2094043 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:26.226373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c38bd-a59d-4300-a1be-eaf5f12657af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:26.227345 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c38bd-a59d-4300-a1be-eaf5f12657af None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:26.227884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c38bd-a59d-4300-a1be-eaf5f12657af None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:26.229833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c38bd-a59d-4300-a1be-eaf5f12657af None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d/groups/1ccd95c5d9ca4835a5292437e10d59c8/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:26.236431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c38bd-a59d-4300-a1be-eaf5f12657af None admin] RBAC: Authorizing `identity:create_grant(project_id=6020d15ded71492c8adbc59366b3f07d, group_id=1ccd95c5d9ca4835a5292437e10d59c8, role_id=5e5bc4ce5d004cd1bb07ef755bf3bb48)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:26.237939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c38bd-a59d-4300-a1be-eaf5f12657af None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:26.271884 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ffc57f-123f-4e7f-a7ec-0f3239bd36a8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:26.308061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7729f7-3bd0-43ad-b83e-bb85c2d51aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:26.308761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7729f7-3bd0-43ad-b83e-bb85c2d51aef None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:26.309279 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7729f7-3bd0-43ad-b83e-bb85c2d51aef None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:26.313017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7729f7-3bd0-43ad-b83e-bb85c2d51aef None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:26.317077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 194/397] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Jul 20 22:27:25 2022] PUT /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d/groups/1ccd95c5d9ca4835a5292437e10d59c8/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:27:26.317622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7729f7-3bd0-43ad-b83e-bb85c2d51aef None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:26.318054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7729f7-3bd0-43ad-b83e-bb85c2d51aef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:26.319539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7729f7-3bd0-43ad-b83e-bb85c2d51aef None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:26.335523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 204/398] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:26.337332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c38bd-a59d-4300-a1be-eaf5f12657af None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:26.477346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcba67f-1a23-4453-8736-a7d587f5a403 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:26.478140 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcba67f-1a23-4453-8736-a7d587f5a403 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:26.478218 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcba67f-1a23-4453-8736-a7d587f5a403 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:26.479594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 205/399] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:26.486196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c38bd-a59d-4300-a1be-eaf5f12657af None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:26.493761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aba3df-f9ad-4bb9-82c9-17a46f4b89a8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:26.494533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aba3df-f9ad-4bb9-82c9-17a46f4b89a8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:26.494533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aba3df-f9ad-4bb9-82c9-17a46f4b89a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:26.521016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-24aba3df-f9ad-4bb9-82c9-17a46f4b89a8 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:26.522583 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-24aba3df-f9ad-4bb9-82c9-17a46f4b89a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:26.546571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67da8ce-0131-4eb6-8fb0-764d8dbc15c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:26.548095 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da8ce-0131-4eb6-8fb0-764d8dbc15c5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:26.548593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da8ce-0131-4eb6-8fb0-764d8dbc15c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:26.549077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da8ce-0131-4eb6-8fb0-764d8dbc15c5 None admin] PATH_INFO: `/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:26.551172 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67da8ce-0131-4eb6-8fb0-764d8dbc15c5 None admin] RBAC: Authorizing `identity:get_group(group_id=1ccd95c5d9ca4835a5292437e10d59c8)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:26.552993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67da8ce-0131-4eb6-8fb0-764d8dbc15c5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:26.556306 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:26.557096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 195/400] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:26 2022] GET /identity/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:26.561599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67da8ce-0131-4eb6-8fb0-764d8dbc15c5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:26.565125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:26.628762 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 206/401] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:26.675160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aba3df-f9ad-4bb9-82c9-17a46f4b89a8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:26.719680 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67da8ce-0131-4eb6-8fb0-764d8dbc15c5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:26.756044 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a3ae40-b8ce-4d79-9ff9-08d86cc76f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:26.757452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ae40-b8ce-4d79-9ff9-08d86cc76f41 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:26.757776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ae40-b8ce-4d79-9ff9-08d86cc76f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:26.758325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a3ae40-b8ce-4d79-9ff9-08d86cc76f41 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:26.759729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3ae40-b8ce-4d79-9ff9-08d86cc76f41 None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:26.762034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a3ae40-b8ce-4d79-9ff9-08d86cc76f41 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:26.764968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 196/402] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:26 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:26.766349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70038f0e-6b20-4d99-9976-497e9b222365 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:26.766650 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70038f0e-6b20-4d99-9976-497e9b222365 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:26.766904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70038f0e-6b20-4d99-9976-497e9b222365 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:26.768421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 197/403] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:26.772537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70038f0e-6b20-4d99-9976-497e9b222365 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:26.826371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aba3df-f9ad-4bb9-82c9-17a46f4b89a8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:26.856214 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:26.867679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca7fa5-f97e-47dd-9625-3c3dac09292a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:26.868590 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca7fa5-f97e-47dd-9625-3c3dac09292a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:26.868944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca7fa5-f97e-47dd-9625-3c3dac09292a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:26.869294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca7fa5-f97e-47dd-9625-3c3dac09292a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:26.881030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca7fa5-f97e-47dd-9625-3c3dac09292a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b1ca7fa5-f97e-47dd-9625-3c3dac09292a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:26.890085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:26.890997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:26.891842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:26.891842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:26.891842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:26.891842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:26.891842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:26.891842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:26.891842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:26.891842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:26.891842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:26.891842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:26.891842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:26.891842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:26.891842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 207/404] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:27:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:26.893076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275c408-00b5-4f48-8f57-6332718408de None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:26.895449 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275c408-00b5-4f48-8f57-6332718408de None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:26.895449 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275c408-00b5-4f48-8f57-6332718408de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:26.897693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70038f0e-6b20-4d99-9976-497e9b222365 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:26.914638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a275c408-00b5-4f48-8f57-6332718408de None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:26.916128 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a275c408-00b5-4f48-8f57-6332718408de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:26.927072 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:26.933260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f0c60-cd8d-4bbf-ad5f-0454b70ff390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:26.933974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f0c60-cd8d-4bbf-ad5f-0454b70ff390 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:26.934313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f0c60-cd8d-4bbf-ad5f-0454b70ff390 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:26.934593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f0c60-cd8d-4bbf-ad5f-0454b70ff390 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2/groups/1ccd95c5d9ca4835a5292437e10d59c8/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:26.937966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f0c60-cd8d-4bbf-ad5f-0454b70ff390 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6537af9fe7a48c5890955b7c03e22c2, group_id=1ccd95c5d9ca4835a5292437e10d59c8, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:26.939408 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f0c60-cd8d-4bbf-ad5f-0454b70ff390 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:26.991355 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 208/405] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:26.992520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275c408-00b5-4f48-8f57-6332718408de None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:27.033421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 198/406] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Jul 20 22:27:26 2022] PUT /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2/groups/1ccd95c5d9ca4835a5292437e10d59c8/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:27:27.034061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f0c60-cd8d-4bbf-ad5f-0454b70ff390 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:27.187703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275c408-00b5-4f48-8f57-6332718408de None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:27.244187 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f0c60-cd8d-4bbf-ad5f-0454b70ff390 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:27.272151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c0c93-b83c-4b60-afd5-7571edb5f4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:27.273237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c0c93-b83c-4b60-afd5-7571edb5f4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:27.275093 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c0c93-b83c-4b60-afd5-7571edb5f4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:27.275862 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:27.276046 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c0c93-b83c-4b60-afd5-7571edb5f4d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:27.277312 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c0c93-b83c-4b60-afd5-7571edb5f4d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:27.277834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c0c93-b83c-4b60-afd5-7571edb5f4d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:27.279913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c0c93-b83c-4b60-afd5-7571edb5f4d3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:27.281945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c69120-db58-4f38-a01a-7874f26cbb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:27.282693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c69120-db58-4f38-a01a-7874f26cbb21 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:27.282983 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c69120-db58-4f38-a01a-7874f26cbb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:27.284865 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c69120-db58-4f38-a01a-7874f26cbb21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:27.290844 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 209/407] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:27.295115 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c69120-db58-4f38-a01a-7874f26cbb21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:27.296918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c0c93-b83c-4b60-afd5-7571edb5f4d3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-63c69120-db58-4f38-a01a-7874f26cbb21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:27.303849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:27.304924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:27.305798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:27.305798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:27.305798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:27.305798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:27.305798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:27.305798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:27.305798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:27.305798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:27.305798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:27.305798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:27.305798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:27:27.305798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:27.310180 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 199/408] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:27:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:27.315342 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:27.316047 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c69120-db58-4f38-a01a-7874f26cbb21 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:27.436356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c69120-db58-4f38-a01a-7874f26cbb21 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:27.475099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b4284-0986-4436-9144-fdbc337ed970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:27.476105 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b4284-0986-4436-9144-fdbc337ed970 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:27.476602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b4284-0986-4436-9144-fdbc337ed970 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:27.477071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b4284-0986-4436-9144-fdbc337ed970 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:27.478329 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b4284-0986-4436-9144-fdbc337ed970 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:27.478851 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b4284-0986-4436-9144-fdbc337ed970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:27.480452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b4284-0986-4436-9144-fdbc337ed970 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:27.490851 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 200/409] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:27.497366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b4284-0986-4436-9144-fdbc337ed970 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:27.539686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c0c93-b83c-4b60-afd5-7571edb5f4d3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:27.586476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:27.610504 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b4284-0986-4436-9144-fdbc337ed970 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:27.651960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab7be4-0c46-4f4c-a478-997680b25872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:27.653298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab7be4-0c46-4f4c-a478-997680b25872 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:27.653836 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab7be4-0c46-4f4c-a478-997680b25872 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:27.654316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab7be4-0c46-4f4c-a478-997680b25872 None admin] PATH_INFO: `/v3/groups/1b76b83585f84d9f8fdc0afb283b8c5f` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:27.656680 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab7be4-0c46-4f4c-a478-997680b25872 None admin] RBAC: Authorizing `identity:get_group(group_id=1b76b83585f84d9f8fdc0afb283b8c5f)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:27.658757 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab7be4-0c46-4f4c-a478-997680b25872 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:27.658868 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92280aa-da6c-4ce2-b7f6-86aa2c280a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:27.659708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92280aa-da6c-4ce2-b7f6-86aa2c280a24 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:27.659994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92280aa-da6c-4ce2-b7f6-86aa2c280a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:27.660276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92280aa-da6c-4ce2-b7f6-86aa2c280a24 None admin] PATH_INFO: `/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:27.661571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 201/410] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:27 2022] GET /identity/v3/groups/1b76b83585f84d9f8fdc0afb283b8c5f => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:27.666331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92280aa-da6c-4ce2-b7f6-86aa2c280a24 None admin] RBAC: Authorizing `identity:get_group(group_id=1ccd95c5d9ca4835a5292437e10d59c8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:27.667345 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab7be4-0c46-4f4c-a478-997680b25872 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:27.667777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92280aa-da6c-4ce2-b7f6-86aa2c280a24 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:27.669705 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 210/411] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:27 2022] GET /identity/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8 => generated 226 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:27.675535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92280aa-da6c-4ce2-b7f6-86aa2c280a24 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:27.785689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab7be4-0c46-4f4c-a478-997680b25872 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:27.825774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:27.836057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e75dc-f90b-43be-84f2-971ea7666e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:27.837130 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e75dc-f90b-43be-84f2-971ea7666e71 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:27.838210 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e75dc-f90b-43be-84f2-971ea7666e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:27.838783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e75dc-f90b-43be-84f2-971ea7666e71 None admin] PATH_INFO: `/v3/projects/63d2e7ee31ba4d05b54d5a20dae7a17b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:27.841293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e75dc-f90b-43be-84f2-971ea7666e71 None admin] RBAC: Authorizing `identity:get_project(project_id=63d2e7ee31ba4d05b54d5a20dae7a17b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:27.845226 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8e75dc-f90b-43be-84f2-971ea7666e71 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:27.850032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 202/412] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:27 2022] GET /identity/v3/projects/63d2e7ee31ba4d05b54d5a20dae7a17b => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:27.859411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e75dc-f90b-43be-84f2-971ea7666e71 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:27.863954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:27.891022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92280aa-da6c-4ce2-b7f6-86aa2c280a24 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:27.928158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb8943-7f17-434a-8323-140ed29185ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:27.929411 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb8943-7f17-434a-8323-140ed29185ba None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:27.929937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb8943-7f17-434a-8323-140ed29185ba None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:27.930438 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb8943-7f17-434a-8323-140ed29185ba None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:27.931817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb8943-7f17-434a-8323-140ed29185ba None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:27.933460 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb8943-7f17-434a-8323-140ed29185ba None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:27.935718 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 211/413] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:27 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:27.948463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb8943-7f17-434a-8323-140ed29185ba None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:28.014501 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e75dc-f90b-43be-84f2-971ea7666e71 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:28.095644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378e3e5-e884-475d-95a9-5c354762bd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:28.096655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378e3e5-e884-475d-95a9-5c354762bd57 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:28.096943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378e3e5-e884-475d-95a9-5c354762bd57 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:28.097221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378e3e5-e884-475d-95a9-5c354762bd57 None admin] PATH_INFO: `/v3/projects/63d2e7ee31ba4d05b54d5a20dae7a17b/groups/1b76b83585f84d9f8fdc0afb283b8c5f/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:28.101882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb8943-7f17-434a-8323-140ed29185ba None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:28.103650 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378e3e5-e884-475d-95a9-5c354762bd57 None admin] RBAC: Authorizing `identity:create_grant(project_id=63d2e7ee31ba4d05b54d5a20dae7a17b, group_id=1b76b83585f84d9f8fdc0afb283b8c5f, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:28.105369 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378e3e5-e884-475d-95a9-5c354762bd57 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:28.140754 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06b818-4065-4517-9b20-2339b67b09ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:28.141654 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06b818-4065-4517-9b20-2339b67b09ee None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:28.141971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06b818-4065-4517-9b20-2339b67b09ee None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:28.142248 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06b818-4065-4517-9b20-2339b67b09ee None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2/groups/1ccd95c5d9ca4835a5292437e10d59c8/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:28.144575 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06b818-4065-4517-9b20-2339b67b09ee None admin] RBAC: Authorizing `identity:create_grant(project_id=e6537af9fe7a48c5890955b7c03e22c2, group_id=1ccd95c5d9ca4835a5292437e10d59c8, role_id=5e5bc4ce5d004cd1bb07ef755bf3bb48)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:28.146057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06b818-4065-4517-9b20-2339b67b09ee None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:28.199614 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 203/414] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Jul 20 22:27:27 2022] PUT /identity/v3/projects/63d2e7ee31ba4d05b54d5a20dae7a17b/groups/1b76b83585f84d9f8fdc0afb283b8c5f/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:27:28.251868 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 212/415] 10.222.0.83 () {58 vars in 1442 bytes} [Wed Jul 20 22:27:27 2022] PUT /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2/groups/1ccd95c5d9ca4835a5292437e10d59c8/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:27:28.380115 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fe307-fc58-4b06-b626-783c5deec002 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:28.380416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fe307-fc58-4b06-b626-783c5deec002 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:28.380611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fe307-fc58-4b06-b626-783c5deec002 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:28.382071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 204/416] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:28.389101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674faf3-0448-4d8c-91e5-482dadde855e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:28.389595 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674faf3-0448-4d8c-91e5-482dadde855e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:28.390095 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674faf3-0448-4d8c-91e5-482dadde855e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:28.403385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:28.425877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f674faf3-0448-4d8c-91e5-482dadde855e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:28.427587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f674faf3-0448-4d8c-91e5-482dadde855e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:28.557201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 213/417] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:28.586692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fe307-fc58-4b06-b626-783c5deec002 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:28.649090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:28.660269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f8e9e-a96d-4249-b6e9-7745b268557b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:28.660559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f8e9e-a96d-4249-b6e9-7745b268557b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:28.664227 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f8e9e-a96d-4249-b6e9-7745b268557b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:28.664227 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 214/418] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:28.667960 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c6a1-959c-4f7c-aa2e-d5bf52eeeb08 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:28.668246 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c6a1-959c-4f7c-aa2e-d5bf52eeeb08 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:28.668521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14c6a1-959c-4f7c-aa2e-d5bf52eeeb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:28.706163 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-da14c6a1-959c-4f7c-aa2e-d5bf52eeeb08 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:28.707215 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fe307-fc58-4b06-b626-783c5deec002 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:28.707349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-da14c6a1-959c-4f7c-aa2e-d5bf52eeeb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:28.748302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11ff76-82a3-46ed-9104-79057bbfb87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:28.749698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11ff76-82a3-46ed-9104-79057bbfb87d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:28.750066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11ff76-82a3-46ed-9104-79057bbfb87d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:28.750325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11ff76-82a3-46ed-9104-79057bbfb87d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:28.762230 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11ff76-82a3-46ed-9104-79057bbfb87d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-2f11ff76-82a3-46ed-9104-79057bbfb87d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:28.770968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:28.771886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:28.772706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:28.772706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:28.772706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:28.772706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:28.772706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:28.772706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:28.772706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:28.772706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:28.772706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:28.772706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:28.772706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:28.772706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:28.777371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 205/419] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:28.778804 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11ff76-82a3-46ed-9104-79057bbfb87d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:28.898509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11ff76-82a3-46ed-9104-79057bbfb87d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:28.910183 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:28.943101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774d059-47fa-46cc-9121-e75f72bc188d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:28.943805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774d059-47fa-46cc-9121-e75f72bc188d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:28.944084 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774d059-47fa-46cc-9121-e75f72bc188d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:28.944361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774d059-47fa-46cc-9121-e75f72bc188d None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:28.945131 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774d059-47fa-46cc-9121-e75f72bc188d None admin] RBAC: Adding query filter params (name=member) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:28.945443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774d059-47fa-46cc-9121-e75f72bc188d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:28.946863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7774d059-47fa-46cc-9121-e75f72bc188d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:28.959614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 215/420] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:27:28.967144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 206/421] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:28.968749 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14c6a1-959c-4f7c-aa2e-d5bf52eeeb08 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:28.997633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774d059-47fa-46cc-9121-e75f72bc188d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:29.078397 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:29.122996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14c6a1-959c-4f7c-aa2e-d5bf52eeeb08 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:29.162547 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0435719-43f5-4ab8-b829-ef4031a67910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:29.163127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0435719-43f5-4ab8-b829-ef4031a67910 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:29.163411 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0435719-43f5-4ab8-b829-ef4031a67910 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:29.163688 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0435719-43f5-4ab8-b829-ef4031a67910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:29.206760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774d059-47fa-46cc-9121-e75f72bc188d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:29.247796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ae2c6-1ced-41dc-ade8-c9a7e72a069f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:29.248662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ae2c6-1ced-41dc-ade8-c9a7e72a069f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:29.248946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ae2c6-1ced-41dc-ade8-c9a7e72a069f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:29.249223 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ae2c6-1ced-41dc-ade8-c9a7e72a069f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:29.260773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ae2c6-1ced-41dc-ade8-c9a7e72a069f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-4f3ae2c6-1ced-41dc-ade8-c9a7e72a069f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:29.269429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:29.270379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:29.271185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:29.271185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:29.271185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:29.271185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:29.271185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:29.271185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:29.271185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:29.271185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:29.271185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:29.271185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:29.271185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:29.271185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:29.271185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 207/422] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:27:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:29.278153 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ae2c6-1ced-41dc-ade8-c9a7e72a069f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:29.315204 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:29.344603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0435719-43f5-4ab8-b829-ef4031a67910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:29.346118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0435719-43f5-4ab8-b829-ef4031a67910 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:29.396479 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ae2c6-1ced-41dc-ade8-c9a7e72a069f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:29.442769 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd3d89-f1af-440a-abe9-a4a6e1698c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:29.443461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd3d89-f1af-440a-abe9-a4a6e1698c87 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:29.443749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd3d89-f1af-440a-abe9-a4a6e1698c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:29.444145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd3d89-f1af-440a-abe9-a4a6e1698c87 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:29.444919 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd3d89-f1af-440a-abe9-a4a6e1698c87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:29.445231 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd3d89-f1af-440a-abe9-a4a6e1698c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:29.446741 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd3d89-f1af-440a-abe9-a4a6e1698c87 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:29.469868 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 208/423] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:29.472611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:29.474365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd3d89-f1af-440a-abe9-a4a6e1698c87 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:29.550593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 216/424] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:29.562113 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0435719-43f5-4ab8-b829-ef4031a67910 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:29.578102 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:29.589423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd3d89-f1af-440a-abe9-a4a6e1698c87 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:29.629342 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f20228-ece9-479b-a8f3-7faed12743aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:29.630483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f20228-ece9-479b-a8f3-7faed12743aa None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:29.630760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f20228-ece9-479b-a8f3-7faed12743aa None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:29.631044 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f20228-ece9-479b-a8f3-7faed12743aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:29.706622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f20228-ece9-479b-a8f3-7faed12743aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:29.708138 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f20228-ece9-479b-a8f3-7faed12743aa None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:29.755172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0435719-43f5-4ab8-b829-ef4031a67910 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:29.790887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90828c-6348-4939-b8b8-543d5989c9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:29.791862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90828c-6348-4939-b8b8-543d5989c9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:29.792148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90828c-6348-4939-b8b8-543d5989c9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:29.792422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90828c-6348-4939-b8b8-543d5989c9a0 None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:29.793672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90828c-6348-4939-b8b8-543d5989c9a0 None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:29.795346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90828c-6348-4939-b8b8-543d5989c9a0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:29.797356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 217/425] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:29 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:29.798598 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9081628-4dce-496d-9bfc-3d8d417b33aa None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:29.798880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9081628-4dce-496d-9bfc-3d8d417b33aa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:29.799164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9081628-4dce-496d-9bfc-3d8d417b33aa None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:29.804559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 218/426] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:29.805880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd61ed-e156-47d1-a5b6-a60096b50079 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:29.806168 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd61ed-e156-47d1-a5b6-a60096b50079 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:29.806553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd61ed-e156-47d1-a5b6-a60096b50079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:29.818780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:29.828629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2efd61ed-e156-47d1-a5b6-a60096b50079 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:29.831993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2efd61ed-e156-47d1-a5b6-a60096b50079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:29.832110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 209/427] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:29.832393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f20228-ece9-479b-a8f3-7faed12743aa None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:29.879476 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:29.929066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 219/428] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:29.930503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd61ed-e156-47d1-a5b6-a60096b50079 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:29.976254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f20228-ece9-479b-a8f3-7faed12743aa None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:30.018726 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efcdab-f722-442a-9778-57b6d4bbc0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:30.019597 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efcdab-f722-442a-9778-57b6d4bbc0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:30.019979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efcdab-f722-442a-9778-57b6d4bbc0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:30.020309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efcdab-f722-442a-9778-57b6d4bbc0e9 None admin] PATH_INFO: `/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:30.021607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efcdab-f722-442a-9778-57b6d4bbc0e9 None admin] RBAC: Authorizing `identity:get_group(group_id=1ccd95c5d9ca4835a5292437e10d59c8)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:30.023200 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efcdab-f722-442a-9778-57b6d4bbc0e9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:30.025144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 210/429] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:29 2022] GET /identity/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:30.026133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efcdab-f722-442a-9778-57b6d4bbc0e9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:30.052962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd61ed-e156-47d1-a5b6-a60096b50079 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:30.095781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:30.103714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678ce94-5b8b-46c2-9549-b68de8dc00ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:30.104599 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678ce94-5b8b-46c2-9549-b68de8dc00ef None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:30.106751 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678ce94-5b8b-46c2-9549-b68de8dc00ef None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:30.106751 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6678ce94-5b8b-46c2-9549-b68de8dc00ef None admin] PATH_INFO: `/v3/projects/6020d15ded71492c8adbc59366b3f07d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:30.107077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678ce94-5b8b-46c2-9549-b68de8dc00ef None admin] RBAC: Authorizing `identity:get_project(project_id=6020d15ded71492c8adbc59366b3f07d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:30.109645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6678ce94-5b8b-46c2-9549-b68de8dc00ef None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:30.113007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 220/430] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:29 2022] GET /identity/v3/projects/6020d15ded71492c8adbc59366b3f07d => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:30.113007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678ce94-5b8b-46c2-9549-b68de8dc00ef None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:30.146538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:30.161615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efcdab-f722-442a-9778-57b6d4bbc0e9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:30.203276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a4465-1fc5-4f7a-a53c-5e62869db6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:30.204251 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a4465-1fc5-4f7a-a53c-5e62869db6ad None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:30.204738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a4465-1fc5-4f7a-a53c-5e62869db6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:30.205112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a4465-1fc5-4f7a-a53c-5e62869db6ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:30.218353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a4465-1fc5-4f7a-a53c-5e62869db6ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:30.225824 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6678ce94-5b8b-46c2-9549-b68de8dc00ef None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-013a4465-1fc5-4f7a-a53c-5e62869db6ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:30.227146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:30.228511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:30.229511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:30.229511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:30.229511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:30.229511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:30.229511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:30.229511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:30.229511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:30.229511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:30.229511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:30.229511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:30.229511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 22:27:30.229511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:30.237521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 211/431] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:30.238956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a4465-1fc5-4f7a-a53c-5e62869db6ad None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:30.268031 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10d6f1-5e8a-4088-b31d-210b2ed597f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:30.269033 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10d6f1-5e8a-4088-b31d-210b2ed597f3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:30.269530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10d6f1-5e8a-4088-b31d-210b2ed597f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:30.270217 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10d6f1-5e8a-4088-b31d-210b2ed597f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:30.271348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10d6f1-5e8a-4088-b31d-210b2ed597f3 None admin] RBAC: Adding query filter params (group.id=1ccd95c5d9ca4835a5292437e10d59c8, role.id=2749d7dcfd844991883fa3f4e90ed75c, scope.project.id=6020d15ded71492c8adbc59366b3f07d) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:30.271844 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10d6f1-5e8a-4088-b31d-210b2ed597f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:30.273515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10d6f1-5e8a-4088-b31d-210b2ed597f3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:30.280311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 221/432] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 20 22:27:30 2022] GET /identity/v3/role_assignments?group.id=1ccd95c5d9ca4835a5292437e10d59c8&scope.project.id=6020d15ded71492c8adbc59366b3f07d&role.id=2749d7dcfd844991883fa3f4e90ed75c => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:30.281424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10d6f1-5e8a-4088-b31d-210b2ed597f3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:30.363197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a4465-1fc5-4f7a-a53c-5e62869db6ad None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:30.386863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:30.390623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:30.396560 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10d6f1-5e8a-4088-b31d-210b2ed597f3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:30.407539 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126ec8a-ca87-4881-b923-c6e0986198eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:30.408737 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126ec8a-ca87-4881-b923-c6e0986198eb None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:30.409204 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126ec8a-ca87-4881-b923-c6e0986198eb None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:30.409763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126ec8a-ca87-4881-b923-c6e0986198eb None admin] PATH_INFO: `/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:30.411274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126ec8a-ca87-4881-b923-c6e0986198eb None admin] RBAC: Authorizing `identity:get_group(group_id=1ccd95c5d9ca4835a5292437e10d59c8)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:30.413024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126ec8a-ca87-4881-b923-c6e0986198eb None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:30.415432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 212/433] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:30 2022] GET /identity/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:30.423759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126ec8a-ca87-4881-b923-c6e0986198eb None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:30.434865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cfd71-1ae1-4637-9db7-65220f9b15f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:30.435567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cfd71-1ae1-4637-9db7-65220f9b15f3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:30.436649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cfd71-1ae1-4637-9db7-65220f9b15f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:30.436813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206cfd71-1ae1-4637-9db7-65220f9b15f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:30.437757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cfd71-1ae1-4637-9db7-65220f9b15f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:30.437984 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cfd71-1ae1-4637-9db7-65220f9b15f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:30.439385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206cfd71-1ae1-4637-9db7-65220f9b15f3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:30.449438 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 222/434] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:27:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:30.460861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cfd71-1ae1-4637-9db7-65220f9b15f3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:30.553110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126ec8a-ca87-4881-b923-c6e0986198eb None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:30.590714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206cfd71-1ae1-4637-9db7-65220f9b15f3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:30.594070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8203a-c8c2-41a3-9ab0-b577ba227fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:30.595633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8203a-c8c2-41a3-9ab0-b577ba227fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:30.596091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8203a-c8c2-41a3-9ab0-b577ba227fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:30.596528 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8203a-c8c2-41a3-9ab0-b577ba227fd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:30.597529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8203a-c8c2-41a3-9ab0-b577ba227fd4 None admin] RBAC: Adding query filter params (group.id=1ccd95c5d9ca4835a5292437e10d59c8, role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48, scope.project.id=6020d15ded71492c8adbc59366b3f07d) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:30.598022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8203a-c8c2-41a3-9ab0-b577ba227fd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:30.599621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8203a-c8c2-41a3-9ab0-b577ba227fd4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:30.608369 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 213/435] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 20 22:27:30 2022] GET /identity/v3/role_assignments?group.id=1ccd95c5d9ca4835a5292437e10d59c8&scope.project.id=6020d15ded71492c8adbc59366b3f07d&role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:30.632899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92390dff-9b28-4922-b85e-55ddd7fcab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:30.633774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92390dff-9b28-4922-b85e-55ddd7fcab62 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:30.634215 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92390dff-9b28-4922-b85e-55ddd7fcab62 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:30.634615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92390dff-9b28-4922-b85e-55ddd7fcab62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:30.666212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:30.717987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92390dff-9b28-4922-b85e-55ddd7fcab62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:30.719636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92390dff-9b28-4922-b85e-55ddd7fcab62 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:30.792755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f8272-1d25-4dcf-a32c-1ce3e76aca46 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:30.792944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f8272-1d25-4dcf-a32c-1ce3e76aca46 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:30.793213 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f8272-1d25-4dcf-a32c-1ce3e76aca46 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:30.796782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 214/436] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:27:30.801299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a65b6b-63e9-4f93-a52a-affcaedf047a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:30.801590 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a65b6b-63e9-4f93-a52a-affcaedf047a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:30.801947 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a65b6b-63e9-4f93-a52a-affcaedf047a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:30.824235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-16a65b6b-63e9-4f93-a52a-affcaedf047a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:30.825365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-16a65b6b-63e9-4f93-a52a-affcaedf047a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:30.830205 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 223/437] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 22:27:30.837075 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92390dff-9b28-4922-b85e-55ddd7fcab62 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:30.883925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:30.897862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:30.916222 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 215/438] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:27:30.940326 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a65b6b-63e9-4f93-a52a-affcaedf047a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:30.954348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92390dff-9b28-4922-b85e-55ddd7fcab62 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:31.000333 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd48a0-a30e-4ec9-8a70-36cc09f05009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:31.001215 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd48a0-a30e-4ec9-8a70-36cc09f05009 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:31.001497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd48a0-a30e-4ec9-8a70-36cc09f05009 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:31.003779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd48a0-a30e-4ec9-8a70-36cc09f05009 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:31.005002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd48a0-a30e-4ec9-8a70-36cc09f05009 None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:31.007102 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd48a0-a30e-4ec9-8a70-36cc09f05009 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:31.009754 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 224/439] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:30 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:31.017945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd48a0-a30e-4ec9-8a70-36cc09f05009 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:31.065812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a65b6b-63e9-4f93-a52a-affcaedf047a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:31.112072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c557c-a048-46ea-8502-adfcb409a484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:31.113822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c557c-a048-46ea-8502-adfcb409a484 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:31.113822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c557c-a048-46ea-8502-adfcb409a484 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:31.114038 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c557c-a048-46ea-8502-adfcb409a484 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:31.126736 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c557c-a048-46ea-8502-adfcb409a484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-703c557c-a048-46ea-8502-adfcb409a484 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:31.134809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:31.135730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:31.136536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:31.136536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:31.136536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:31.136536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:31.136536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:31.136536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:31.136536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:31.136536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:31.136536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:31.136536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:31.136536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:27:31.136536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:31.139272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 216/440] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:27:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:31.140585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad909317-4276-4c8b-a7a4-1fecd55664f9 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:31.140875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad909317-4276-4c8b-a7a4-1fecd55664f9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:31.141155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad909317-4276-4c8b-a7a4-1fecd55664f9 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:31.142639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 217/441] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:31.146763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad909317-4276-4c8b-a7a4-1fecd55664f9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:31.150702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd48a0-a30e-4ec9-8a70-36cc09f05009 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:31.175889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:31.192696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58d606-708d-43f9-87fa-defa9060f27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:31.193571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58d606-708d-43f9-87fa-defa9060f27a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:31.193886 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58d606-708d-43f9-87fa-defa9060f27a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:31.194164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58d606-708d-43f9-87fa-defa9060f27a None admin] PATH_INFO: `/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:31.195950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58d606-708d-43f9-87fa-defa9060f27a None admin] RBAC: Authorizing `identity:get_group(group_id=1ccd95c5d9ca4835a5292437e10d59c8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:31.196873 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b58d606-708d-43f9-87fa-defa9060f27a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:31.199299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:31.199819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 225/442] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:31 2022] GET /identity/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:31.201005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff34e1-b1d5-41c5-8528-7644fa4d8409 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:31.201389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff34e1-b1d5-41c5-8528-7644fa4d8409 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:31.201652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff34e1-b1d5-41c5-8528-7644fa4d8409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:31.221635 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d9ff34e1-b1d5-41c5-8528-7644fa4d8409 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:31.222913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d9ff34e1-b1d5-41c5-8528-7644fa4d8409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:31.264576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad909317-4276-4c8b-a7a4-1fecd55664f9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:31.293633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 226/443] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:31.294727 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff34e1-b1d5-41c5-8528-7644fa4d8409 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:31.309407 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3cdfd-1020-42af-9d0f-b9da0516733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:31.310565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3cdfd-1020-42af-9d0f-b9da0516733a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:31.311140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3cdfd-1020-42af-9d0f-b9da0516733a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:31.311528 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3cdfd-1020-42af-9d0f-b9da0516733a None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:31.312298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3cdfd-1020-42af-9d0f-b9da0516733a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:31.312860 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3cdfd-1020-42af-9d0f-b9da0516733a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:31.314689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3cdfd-1020-42af-9d0f-b9da0516733a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:31.324085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 218/444] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:31.325531 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3cdfd-1020-42af-9d0f-b9da0516733a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:31.398820 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff34e1-b1d5-41c5-8528-7644fa4d8409 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:31.418441 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:31.427286 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3cdfd-1020-42af-9d0f-b9da0516733a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:31.429577 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:31.432732 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ffc54-9ed5-4efe-b64f-a93ac8d59c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:31.433461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ffc54-9ed5-4efe-b64f-a93ac8d59c3c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:31.433766 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ffc54-9ed5-4efe-b64f-a93ac8d59c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:31.434044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ffc54-9ed5-4efe-b64f-a93ac8d59c3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:31.434877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ffc54-9ed5-4efe-b64f-a93ac8d59c3c None admin] RBAC: Adding query filter params (group.id=1ccd95c5d9ca4835a5292437e10d59c8, role.id=2749d7dcfd844991883fa3f4e90ed75c, scope.project.id=e6537af9fe7a48c5890955b7c03e22c2) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:31.438211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ffc54-9ed5-4efe-b64f-a93ac8d59c3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:31.438211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ffc54-9ed5-4efe-b64f-a93ac8d59c3c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:31.442925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 227/445] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 20 22:27:31 2022] GET /identity/v3/role_assignments?group.id=1ccd95c5d9ca4835a5292437e10d59c8&scope.project.id=e6537af9fe7a48c5890955b7c03e22c2&role.id=2749d7dcfd844991883fa3f4e90ed75c => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:31.456717 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ffc54-9ed5-4efe-b64f-a93ac8d59c3c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:31.463921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe004d1-992a-443d-85ee-1ffe0fc2740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:31.467103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe004d1-992a-443d-85ee-1ffe0fc2740f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:31.467103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe004d1-992a-443d-85ee-1ffe0fc2740f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:31.467103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe004d1-992a-443d-85ee-1ffe0fc2740f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:31.478206 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe004d1-992a-443d-85ee-1ffe0fc2740f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-cfe004d1-992a-443d-85ee-1ffe0fc2740f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:31.490442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:31.491447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:31.492289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:31.492289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:31.492289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:31.492289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:31.492289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:31.492289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:31.492289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:31.492289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:31.492289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:31.492289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:31.492289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:31.492289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:31.496917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 219/446] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:27:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:31.497936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe004d1-992a-443d-85ee-1ffe0fc2740f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:31.564165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ffc54-9ed5-4efe-b64f-a93ac8d59c3c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:31.605511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917c0ad-480c-49d7-a921-92690776339b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:31.606264 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c0ad-480c-49d7-a921-92690776339b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:31.606572 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c0ad-480c-49d7-a921-92690776339b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:31.606759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917c0ad-480c-49d7-a921-92690776339b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:31.621676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe004d1-992a-443d-85ee-1ffe0fc2740f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:31.668099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1e194-bf12-481d-aecd-1779433efe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:31.668824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1e194-bf12-481d-aecd-1779433efe2d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:31.669212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1e194-bf12-481d-aecd-1779433efe2d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:31.669526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1e194-bf12-481d-aecd-1779433efe2d None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:31.670772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:31.671860 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1e194-bf12-481d-aecd-1779433efe2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:31.672177 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1e194-bf12-481d-aecd-1779433efe2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:31.673592 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1e194-bf12-481d-aecd-1779433efe2d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:31.684159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 220/447] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:31.689163 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917c0ad-480c-49d7-a921-92690776339b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:31.690764 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1e194-bf12-481d-aecd-1779433efe2d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:31.692077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917c0ad-480c-49d7-a921-92690776339b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:31.723653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:31.803722 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1e194-bf12-481d-aecd-1779433efe2d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:31.812226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 228/448] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:31.814813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917c0ad-480c-49d7-a921-92690776339b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:31.840632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93827008-b3f0-4eac-977a-5392b1d3d453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:31.841323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93827008-b3f0-4eac-977a-5392b1d3d453 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:31.841615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93827008-b3f0-4eac-977a-5392b1d3d453 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:31.841997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93827008-b3f0-4eac-977a-5392b1d3d453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:31.899554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:31.909538 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93827008-b3f0-4eac-977a-5392b1d3d453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:31.915950 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93827008-b3f0-4eac-977a-5392b1d3d453 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:31.916070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917c0ad-480c-49d7-a921-92690776339b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:31.937759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:31.950285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43140ff5-cf65-480b-b100-7e672c9cbbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:31.951151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43140ff5-cf65-480b-b100-7e672c9cbbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:31.951953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43140ff5-cf65-480b-b100-7e672c9cbbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:31.952225 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43140ff5-cf65-480b-b100-7e672c9cbbe4 None admin] PATH_INFO: `/v3/projects/63d2e7ee31ba4d05b54d5a20dae7a17b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:31.953418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43140ff5-cf65-480b-b100-7e672c9cbbe4 None admin] RBAC: Authorizing `identity:get_project(project_id=63d2e7ee31ba4d05b54d5a20dae7a17b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:31.954924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43140ff5-cf65-480b-b100-7e672c9cbbe4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:31.956612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 229/449] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:31 2022] GET /identity/v3/projects/63d2e7ee31ba4d05b54d5a20dae7a17b => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:31.962066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43140ff5-cf65-480b-b100-7e672c9cbbe4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:32.011015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 221/450] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 22:27:32.017298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93827008-b3f0-4eac-977a-5392b1d3d453 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:32.059635 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43140ff5-cf65-480b-b100-7e672c9cbbe4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:32.097831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8394bc-3391-437d-97b8-844c8ce58a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:32.098699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8394bc-3391-437d-97b8-844c8ce58a40 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:32.098982 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8394bc-3391-437d-97b8-844c8ce58a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:32.099260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8394bc-3391-437d-97b8-844c8ce58a40 None admin] PATH_INFO: `/v3/groups/1b76b83585f84d9f8fdc0afb283b8c5f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:32.100451 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8394bc-3391-437d-97b8-844c8ce58a40 None admin] RBAC: Authorizing `identity:get_group(group_id=1b76b83585f84d9f8fdc0afb283b8c5f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:32.101924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8394bc-3391-437d-97b8-844c8ce58a40 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:32.103995 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 230/451] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:31 2022] GET /identity/v3/groups/1b76b83585f84d9f8fdc0afb283b8c5f => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:32.110026 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8394bc-3391-437d-97b8-844c8ce58a40 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:32.120019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93827008-b3f0-4eac-977a-5392b1d3d453 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:32.131465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:32.147550 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:32.156330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb4405-8f6f-430f-bd6b-bb40312ec914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:32.157679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb4405-8f6f-430f-bd6b-bb40312ec914 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:32.158012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb4405-8f6f-430f-bd6b-bb40312ec914 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:32.158291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb4405-8f6f-430f-bd6b-bb40312ec914 None admin] PATH_INFO: `/v3/projects/e6537af9fe7a48c5890955b7c03e22c2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:32.159571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb4405-8f6f-430f-bd6b-bb40312ec914 None admin] RBAC: Authorizing `identity:get_project(project_id=e6537af9fe7a48c5890955b7c03e22c2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:32.161052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb4405-8f6f-430f-bd6b-bb40312ec914 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:32.162889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 222/452] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:27:32 2022] GET /identity/v3/projects/e6537af9fe7a48c5890955b7c03e22c2 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:32.168543 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb4405-8f6f-430f-bd6b-bb40312ec914 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:32.211771 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8394bc-3391-437d-97b8-844c8ce58a40 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:32.247839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210511b-92bd-41d9-be61-89f7c1fb6d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:32.249033 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210511b-92bd-41d9-be61-89f7c1fb6d3a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:32.249316 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210511b-92bd-41d9-be61-89f7c1fb6d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:32.249592 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1210511b-92bd-41d9-be61-89f7c1fb6d3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:32.250467 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210511b-92bd-41d9-be61-89f7c1fb6d3a None admin] RBAC: Adding query filter params (group.id=1b76b83585f84d9f8fdc0afb283b8c5f, role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=63d2e7ee31ba4d05b54d5a20dae7a17b) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:32.250784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210511b-92bd-41d9-be61-89f7c1fb6d3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:32.252223 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1210511b-92bd-41d9-be61-89f7c1fb6d3a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:32.258056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 231/453] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 20 22:27:32 2022] GET /identity/v3/role_assignments?group.id=1b76b83585f84d9f8fdc0afb283b8c5f&scope.project.id=63d2e7ee31ba4d05b54d5a20dae7a17b&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:32.271919 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb4405-8f6f-430f-bd6b-bb40312ec914 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:32.309834 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78df8a-abed-41db-b6bc-dc14fadc03fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:32.310715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78df8a-abed-41db-b6bc-dc14fadc03fd None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:32.311518 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78df8a-abed-41db-b6bc-dc14fadc03fd None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:32.312511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78df8a-abed-41db-b6bc-dc14fadc03fd None admin] PATH_INFO: `/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:32.313906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78df8a-abed-41db-b6bc-dc14fadc03fd None admin] RBAC: Authorizing `identity:get_group(group_id=1ccd95c5d9ca4835a5292437e10d59c8)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:32.315425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78df8a-abed-41db-b6bc-dc14fadc03fd None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:32.317163 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 223/454] 10.222.0.83 () {56 vars in 1180 bytes} [Wed Jul 20 22:27:32 2022] GET /identity/v3/groups/1ccd95c5d9ca4835a5292437e10d59c8 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:32.323220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210511b-92bd-41d9-be61-89f7c1fb6d3a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:32.414296 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:32.431337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1210511b-92bd-41d9-be61-89f7c1fb6d3a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:32.466276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36c69c-b238-429d-abb7-3bf5369f74e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:32.466889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36c69c-b238-429d-abb7-3bf5369f74e6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:32.467275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36c69c-b238-429d-abb7-3bf5369f74e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:32.467557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36c69c-b238-429d-abb7-3bf5369f74e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:32.468410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36c69c-b238-429d-abb7-3bf5369f74e6 None admin] RBAC: Adding query filter params (group.id=1ccd95c5d9ca4835a5292437e10d59c8, role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48, scope.project.id=e6537af9fe7a48c5890955b7c03e22c2) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:32.468729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36c69c-b238-429d-abb7-3bf5369f74e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:32.470219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36c69c-b238-429d-abb7-3bf5369f74e6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:32.476113 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 232/455] 10.222.0.83 () {56 vars in 1376 bytes} [Wed Jul 20 22:27:32 2022] GET /identity/v3/role_assignments?group.id=1ccd95c5d9ca4835a5292437e10d59c8&scope.project.id=e6537af9fe7a48c5890955b7c03e22c2&role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:35.090182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f900fb-f4e3-4a93-97de-f166b8721cfd None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:35.090182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f900fb-f4e3-4a93-97de-f166b8721cfd None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:35.090182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f900fb-f4e3-4a93-97de-f166b8721cfd None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:35.091052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 224/456] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:35.097431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca4223-24b4-4bb8-a917-d70b69c6b058 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:35.098236 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca4223-24b4-4bb8-a917-d70b69c6b058 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:35.098692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca4223-24b4-4bb8-a917-d70b69c6b058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:35.117926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-10ca4223-24b4-4bb8-a917-d70b69c6b058 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:35.119356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-10ca4223-24b4-4bb8-a917-d70b69c6b058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:35.207244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 233/457] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:27:35.232487 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f900fb-f4e3-4a93-97de-f166b8721cfd None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:35.326439 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:35.375299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919af6da-eed4-4e60-8a56-03abc18705a1 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:35.375793 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919af6da-eed4-4e60-8a56-03abc18705a1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:35.376216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919af6da-eed4-4e60-8a56-03abc18705a1 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:35.381621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 234/458] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:35.381770 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f900fb-f4e3-4a93-97de-f166b8721cfd None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:35.383423 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173aeb19-660b-4192-99d8-d7eef9e2f39b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:35.383877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173aeb19-660b-4192-99d8-d7eef9e2f39b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:35.384298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173aeb19-660b-4192-99d8-d7eef9e2f39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:35.422814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-173aeb19-660b-4192-99d8-d7eef9e2f39b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:35.424050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-173aeb19-660b-4192-99d8-d7eef9e2f39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:35.434642 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27167e-7b86-4fdd-94cb-9d28334b7781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:35.435566 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27167e-7b86-4fdd-94cb-9d28334b7781 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:35.436416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27167e-7b86-4fdd-94cb-9d28334b7781 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:35.436769 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27167e-7b86-4fdd-94cb-9d28334b7781 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:35.456866 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27167e-7b86-4fdd-94cb-9d28334b7781 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:35.458407 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27167e-7b86-4fdd-94cb-9d28334b7781 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-7c27167e-7b86-4fdd-94cb-9d28334b7781 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:35.479926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:35.480845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:35.482167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:35.482167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:35.482167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:35.482167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:35.482167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 225/459] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:35.483745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59d30-20bf-477d-aa21-d0c2fb065f92 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:35.483745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59d30-20bf-477d-aa21-d0c2fb065f92 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:35.484069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59d30-20bf-477d-aa21-d0c2fb065f92 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:35.485567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 226/460] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:35.489437 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59d30-20bf-477d-aa21-d0c2fb065f92 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:35.518072 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 235/461] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:27:35.519145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53efea2-ecc0-4371-9e63-3b33500c75bb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:35.519440 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53efea2-ecc0-4371-9e63-3b33500c75bb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:35.519782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53efea2-ecc0-4371-9e63-3b33500c75bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:35.536419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a53efea2-ecc0-4371-9e63-3b33500c75bb None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:35.537632 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a53efea2-ecc0-4371-9e63-3b33500c75bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:35.539884 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:35.611150 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 236/462] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:35.612083 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53efea2-ecc0-4371-9e63-3b33500c75bb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:35.634325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59d30-20bf-477d-aa21-d0c2fb065f92 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:35.656902 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:35.680943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2cb40-f968-4b59-aa68-88861bbeaff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:35.681759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2cb40-f968-4b59-aa68-88861bbeaff4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:35.682055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2cb40-f968-4b59-aa68-88861bbeaff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:35.682451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2cb40-f968-4b59-aa68-88861bbeaff4 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:35.683211 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2cb40-f968-4b59-aa68-88861bbeaff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:35.683524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2cb40-f968-4b59-aa68-88861bbeaff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:35.685093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2cb40-f968-4b59-aa68-88861bbeaff4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:35.699660 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 227/463] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:35.700549 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2cb40-f968-4b59-aa68-88861bbeaff4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:35.742715 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53efea2-ecc0-4371-9e63-3b33500c75bb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:35.782011 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28f654-a02c-49bd-9a4a-68b7c95de189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:35.782921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28f654-a02c-49bd-9a4a-68b7c95de189 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:35.783210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28f654-a02c-49bd-9a4a-68b7c95de189 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:35.783488 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd28f654-a02c-49bd-9a4a-68b7c95de189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:35.790507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:35.794502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28f654-a02c-49bd-9a4a-68b7c95de189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:35.802693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd28f654-a02c-49bd-9a4a-68b7c95de189 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:35.816102 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2cb40-f968-4b59-aa68-88861bbeaff4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-cd28f654-a02c-49bd-9a4a-68b7c95de189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:35.816681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:35.822909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:35.823923 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:35.823923 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:35.823923 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:35.823923 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:35.823923 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 237/464] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:35.823923 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28f654-a02c-49bd-9a4a-68b7c95de189 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:35.857320 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88d45c-ac7e-4555-961c-b18f9994f2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:35.858298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88d45c-ac7e-4555-961c-b18f9994f2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:35.858586 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88d45c-ac7e-4555-961c-b18f9994f2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:35.858864 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88d45c-ac7e-4555-961c-b18f9994f2d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:35.869714 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88d45c-ac7e-4555-961c-b18f9994f2d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:35.871223 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea88d45c-ac7e-4555-961c-b18f9994f2d3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ea88d45c-ac7e-4555-961c-b18f9994f2d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:35.888890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:35.890429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:35.891292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:35.891292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:35.891292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:35.891292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:35.891292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 228/465] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:35.892154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61236a6-3c73-478a-9bff-d6138c6bf2ad None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:35.892154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61236a6-3c73-478a-9bff-d6138c6bf2ad None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:35.892310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61236a6-3c73-478a-9bff-d6138c6bf2ad None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:35.893707 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 229/466] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:35.894293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61236a6-3c73-478a-9bff-d6138c6bf2ad None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:35.923382 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:35.936433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd28f654-a02c-49bd-9a4a-68b7c95de189 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:35.972424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafd81b-c06f-4faa-9786-92584470511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:35.973109 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafd81b-c06f-4faa-9786-92584470511d None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:35.973390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafd81b-c06f-4faa-9786-92584470511d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:35.973667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafd81b-c06f-4faa-9786-92584470511d None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:35.974407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafd81b-c06f-4faa-9786-92584470511d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:35.975856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafd81b-c06f-4faa-9786-92584470511d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:35.999981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61236a6-3c73-478a-9bff-d6138c6bf2ad None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:36.033009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dc92a-4c84-46ed-9183-5c670c2b1024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:36.033668 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dc92a-4c84-46ed-9183-5c670c2b1024 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:36.033981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dc92a-4c84-46ed-9183-5c670c2b1024 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:36.034261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086dc92a-4c84-46ed-9183-5c670c2b1024 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:36.034988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dc92a-4c84-46ed-9183-5c670c2b1024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:36.035298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dc92a-4c84-46ed-9183-5c670c2b1024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:36.036670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086dc92a-4c84-46ed-9183-5c670c2b1024 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:36.048442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 230/467] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:36.049229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dc92a-4c84-46ed-9183-5c670c2b1024 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:36.103938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 238/468] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:27:35 2022] POST /identity/v3/users => generated 246 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:27:36.103938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90eb6f-a8f6-41c2-a0c7-fbeacd65ad69 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:36.103938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90eb6f-a8f6-41c2-a0c7-fbeacd65ad69 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:36.103938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90eb6f-a8f6-41c2-a0c7-fbeacd65ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:36.119027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2c90eb6f-a8f6-41c2-a0c7-fbeacd65ad69 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:36.120487 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2c90eb6f-a8f6-41c2-a0c7-fbeacd65ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:36.160182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:36.178063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086dc92a-4c84-46ed-9183-5c670c2b1024 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:36.190129 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:36.222903 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 239/469] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:36.223567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90eb6f-a8f6-41c2-a0c7-fbeacd65ad69 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:36.237242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1959ef-cfde-4473-a9e8-dcc0f0c652e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:36.238592 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1959ef-cfde-4473-a9e8-dcc0f0c652e2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:36.238592 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1959ef-cfde-4473-a9e8-dcc0f0c652e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:36.238592 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1959ef-cfde-4473-a9e8-dcc0f0c652e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:36.240694 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1959ef-cfde-4473-a9e8-dcc0f0c652e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:36.240694 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1959ef-cfde-4473-a9e8-dcc0f0c652e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:36.242864 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1959ef-cfde-4473-a9e8-dcc0f0c652e2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:36.261264 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 231/470] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:36.268660 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1959ef-cfde-4473-a9e8-dcc0f0c652e2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:36.374805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90eb6f-a8f6-41c2-a0c7-fbeacd65ad69 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:36.402369 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1959ef-cfde-4473-a9e8-dcc0f0c652e2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:36.422009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe42fd5-75df-4b45-a72c-ae8f8b9b2037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:36.423327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42fd5-75df-4b45-a72c-ae8f8b9b2037 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:36.423770 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42fd5-75df-4b45-a72c-ae8f8b9b2037 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:36.424195 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe42fd5-75df-4b45-a72c-ae8f8b9b2037 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:36.425047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe42fd5-75df-4b45-a72c-ae8f8b9b2037 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:36.427512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe42fd5-75df-4b45-a72c-ae8f8b9b2037 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:36.440552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0205a47-0d8e-4070-8239-7caec8260254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:36.441235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0205a47-0d8e-4070-8239-7caec8260254 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:36.441516 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0205a47-0d8e-4070-8239-7caec8260254 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:36.441821 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0205a47-0d8e-4070-8239-7caec8260254 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:36.442605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0205a47-0d8e-4070-8239-7caec8260254 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:36.443971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0205a47-0d8e-4070-8239-7caec8260254 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:36.528748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 240/471] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:27:36 2022] POST /identity/v3/users => generated 248 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:27:36.531035 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe42fd5-75df-4b45-a72c-ae8f8b9b2037 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:36.563168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 232/472] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:27:36 2022] POST /identity/v3/users => generated 248 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:27:36.590918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:36.672210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe42fd5-75df-4b45-a72c-ae8f8b9b2037 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:36.706019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cd9b9-18dc-4549-bd3b-1bc015c0b347 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:36.706313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cd9b9-18dc-4549-bd3b-1bc015c0b347 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:36.706599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cd9b9-18dc-4549-bd3b-1bc015c0b347 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:36.708514 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 233/473] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:27:36.713319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d817bc6-657e-43ad-91b0-8a89f2fd7ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:36.714056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243b04-92f9-4269-9f87-dc3af8aa5dc7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:36.714354 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243b04-92f9-4269-9f87-dc3af8aa5dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:36.714641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243b04-92f9-4269-9f87-dc3af8aa5dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:36.714912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d817bc6-657e-43ad-91b0-8a89f2fd7ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:36.715335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d817bc6-657e-43ad-91b0-8a89f2fd7ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:36.715764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d817bc6-657e-43ad-91b0-8a89f2fd7ab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:36.722099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:36.729377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d817bc6-657e-43ad-91b0-8a89f2fd7ab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:36.731294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d817bc6-657e-43ad-91b0-8a89f2fd7ab8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-9d817bc6-657e-43ad-91b0-8a89f2fd7ab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:36.752764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:36.753950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:36.755050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:36.755050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:36.755050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:36.755050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:36.757169 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 241/474] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:36.758990 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8f243b04-92f9-4269-9f87-dc3af8aa5dc7 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:36.760320 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8f243b04-92f9-4269-9f87-dc3af8aa5dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:36.766743 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d817bc6-657e-43ad-91b0-8a89f2fd7ab8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:36.851788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 234/475] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:27:36.875443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:36.877588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f243b04-92f9-4269-9f87-dc3af8aa5dc7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:36.896288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d817bc6-657e-43ad-91b0-8a89f2fd7ab8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:36.951847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41378e4-b758-4df8-8d2e-d24edd1be68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:36.954337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41378e4-b758-4df8-8d2e-d24edd1be68b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:36.954800 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41378e4-b758-4df8-8d2e-d24edd1be68b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:36.956365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41378e4-b758-4df8-8d2e-d24edd1be68b None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:36.958295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41378e4-b758-4df8-8d2e-d24edd1be68b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:36.958786 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41378e4-b758-4df8-8d2e-d24edd1be68b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:36.962354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41378e4-b758-4df8-8d2e-d24edd1be68b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:36.981670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 242/476] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:36.988373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41378e4-b758-4df8-8d2e-d24edd1be68b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:37.027155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f243b04-92f9-4269-9f87-dc3af8aa5dc7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:37.087759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:37.096946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa781c-1782-4609-8806-8393fed1aa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:37.097637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa781c-1782-4609-8806-8393fed1aa60 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:37.097960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa781c-1782-4609-8806-8393fed1aa60 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:37.098239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffa781c-1782-4609-8806-8393fed1aa60 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:37.104709 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa781c-1782-4609-8806-8393fed1aa60 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:37.104709 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffa781c-1782-4609-8806-8393fed1aa60 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:37.112214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41378e4-b758-4df8-8d2e-d24edd1be68b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:37.148733 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfa5f6-149e-442b-b98b-a639e7f3e2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:37.149554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfa5f6-149e-442b-b98b-a639e7f3e2e1 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:37.150014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfa5f6-149e-442b-b98b-a639e7f3e2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:37.150300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfa5f6-149e-442b-b98b-a639e7f3e2e1 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:37.150497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.sql.core [None req-8ffa781c-1782-4609-8806-8393fed1aa60 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 22:27:37.150497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 22:27:37.150497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [parameters: {'id': 'dcb5de6a312b43a5ba201fa799fb5a43', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 22:27:37.150497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80615) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 22:27:37.151030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfa5f6-149e-442b-b98b-a639e7f3e2e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:37.152576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dfa5f6-149e-442b-b98b-a639e7f3e2e1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-8ffa781c-1782-4609-8806-8393fed1aa60 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application conn.query(q) Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application result.read() Jul 20 22:27:37.177333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return ref.to_dict() Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 22:27:37.178727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application next(self.gen) Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application yield resource Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application next(self.gen) Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise self.value Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application session.commit() Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 22:27:37.179678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self.session.flush() Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application compat.raise_( Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 22:27:37.180576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 22:27:37.181506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application conn.query(q) Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application result.read() Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 22:27:37.186629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [parameters: {'id': 'dcb5de6a312b43a5ba201fa799fb5a43', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:37.188641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 22:27:37.190367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:37.192107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 235/477] 10.222.0.83 () {60 vars in 1131 bytes} [Wed Jul 20 22:27:36 2022] POST /identity/v3/roles => generated 144 bytes in 302 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:37.192107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa781c-1782-4609-8806-8393fed1aa60 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:37.232898 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 243/478] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:27:36 2022] POST /identity/v3/users => generated 249 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:27:37.233382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:37.312418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffa781c-1782-4609-8806-8393fed1aa60 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:37.362842 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0511ea9-21c4-44f0-9efe-dd14021bd385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:37.362842 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0511ea9-21c4-44f0-9efe-dd14021bd385 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:37.362842 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0511ea9-21c4-44f0-9efe-dd14021bd385 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:37.362842 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0511ea9-21c4-44f0-9efe-dd14021bd385 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:37.379945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0511ea9-21c4-44f0-9efe-dd14021bd385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-d0511ea9-21c4-44f0-9efe-dd14021bd385 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:37.393150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:37.394189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:37.395017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:37.395017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:37.395017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:37.395017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:37.395017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:37.395017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:37.395017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:37.395017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:37.395017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:37.395017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:37.395017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 22:27:37.395017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:37.397610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 236/479] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:27:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:37.406899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfa5f6-149e-442b-b98b-a639e7f3e2e1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:37.542512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfa5f6-149e-442b-b98b-a639e7f3e2e1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:37.578584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e93671-29c8-4e75-9eb9-9d06af00124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:37.589665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e93671-29c8-4e75-9eb9-9d06af00124e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:37.589665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e93671-29c8-4e75-9eb9-9d06af00124e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:37.589665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e93671-29c8-4e75-9eb9-9d06af00124e None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:37.589665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e93671-29c8-4e75-9eb9-9d06af00124e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:37.589665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e93671-29c8-4e75-9eb9-9d06af00124e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:37.589665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e93671-29c8-4e75-9eb9-9d06af00124e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:37.592539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 244/480] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:38.630968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817ab6b-1d81-42e5-a1a4-e1cf8ffb73ec None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:38.631490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817ab6b-1d81-42e5-a1a4-e1cf8ffb73ec None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:38.631490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817ab6b-1d81-42e5-a1a4-e1cf8ffb73ec None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:38.633138 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 237/481] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:38.638597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf00c58-dcb0-4984-9df6-a84789be1c57 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:38.639560 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf00c58-dcb0-4984-9df6-a84789be1c57 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:38.639903 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf00c58-dcb0-4984-9df6-a84789be1c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:38.657178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-daf00c58-dcb0-4984-9df6-a84789be1c57 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:38.658393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-daf00c58-dcb0-4984-9df6-a84789be1c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:38.717841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:38.732032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 245/482] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:38.780300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817ab6b-1d81-42e5-a1a4-e1cf8ffb73ec None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:38.865145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:38.926849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817ab6b-1d81-42e5-a1a4-e1cf8ffb73ec None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:38.975827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce5fa4-19ba-4ab1-8731-17af2244d2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:38.976643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce5fa4-19ba-4ab1-8731-17af2244d2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:38.976927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce5fa4-19ba-4ab1-8731-17af2244d2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:38.977206 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce5fa4-19ba-4ab1-8731-17af2244d2a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:38.989414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ce5fa4-19ba-4ab1-8731-17af2244d2a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-73ce5fa4-19ba-4ab1-8731-17af2244d2a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:38.997154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:38.998061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:38.999132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:38.999132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:38.999132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:38.999132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:38.999132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:38.999132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:38.999132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:38.999132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:38.999132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:38.999132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:38.999132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:38.999132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:38.999132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 238/483] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:39.004185 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf00c58-dcb0-4984-9df6-a84789be1c57 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:39.136313 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf00c58-dcb0-4984-9df6-a84789be1c57 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:39.181356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd328d-2820-4f4d-8380-2c0b205e2002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:39.182014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd328d-2820-4f4d-8380-2c0b205e2002 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:39.182301 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd328d-2820-4f4d-8380-2c0b205e2002 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:39.182575 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd328d-2820-4f4d-8380-2c0b205e2002 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:39.183339 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd328d-2820-4f4d-8380-2c0b205e2002 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:39.183650 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd328d-2820-4f4d-8380-2c0b205e2002 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:39.185023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd328d-2820-4f4d-8380-2c0b205e2002 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:39.194266 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 246/484] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:39.199417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce5fa4-19ba-4ab1-8731-17af2244d2a8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:39.253995 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0df6fd-0ac7-4ef1-91c6-61eac3e90a4b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:39.254320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0df6fd-0ac7-4ef1-91c6-61eac3e90a4b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:39.254561 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0df6fd-0ac7-4ef1-91c6-61eac3e90a4b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:39.256373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 247/485] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:39.271655 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972c02c-13ee-489d-a277-87a3aaae6945 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:39.271968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972c02c-13ee-489d-a277-87a3aaae6945 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:39.272246 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972c02c-13ee-489d-a277-87a3aaae6945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:39.303143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0972c02c-13ee-489d-a277-87a3aaae6945 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:39.304335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0972c02c-13ee-489d-a277-87a3aaae6945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:39.365356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce5fa4-19ba-4ab1-8731-17af2244d2a8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:39.375484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:39.393331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 248/486] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 20 22:27:39.397877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8102-a7c2-43fe-8aac-e623494bcd3f None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:39.397877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8102-a7c2-43fe-8aac-e623494bcd3f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:39.397877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8102-a7c2-43fe-8aac-e623494bcd3f None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:39.397877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 249/487] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:39.402098 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:39.410053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16000ca6-b2b5-4dd2-acb7-664d87cbb0a5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:39.410342 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16000ca6-b2b5-4dd2-acb7-664d87cbb0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:39.410617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16000ca6-b2b5-4dd2-acb7-664d87cbb0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:39.423961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e526f22-a070-45e8-a933-10e6c6626c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:39.430666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e526f22-a070-45e8-a933-10e6c6626c43 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:39.430666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e526f22-a070-45e8-a933-10e6c6626c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:39.430666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e526f22-a070-45e8-a933-10e6c6626c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:39.435828 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-16000ca6-b2b5-4dd2-acb7-664d87cbb0a5 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:39.436954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-16000ca6-b2b5-4dd2-acb7-664d87cbb0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:39.440156 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e526f22-a070-45e8-a933-10e6c6626c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:39.441946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e526f22-a070-45e8-a933-10e6c6626c43 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-2e526f22-a070-45e8-a933-10e6c6626c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:39.462562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:39.463493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:39.464515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:39.464515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:39.464515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:39.464515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:39.467600 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 239/488] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:39.468708 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e526f22-a070-45e8-a933-10e6c6626c43 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:39.514481 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 250/489] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 20 22:27:39.515443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16000ca6-b2b5-4dd2-acb7-664d87cbb0a5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:39.583242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e526f22-a070-45e8-a933-10e6c6626c43 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:39.621926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb76a6-87aa-40fe-912f-0b4ec98a5299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:39.623804 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb76a6-87aa-40fe-912f-0b4ec98a5299 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:39.624350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb76a6-87aa-40fe-912f-0b4ec98a5299 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:39.624877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb76a6-87aa-40fe-912f-0b4ec98a5299 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:39.636652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb76a6-87aa-40fe-912f-0b4ec98a5299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-09eb76a6-87aa-40fe-912f-0b4ec98a5299 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:39.647024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:39.647945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:39.648801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:39.648801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:39.648801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:39.648801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:39.648801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:39.648801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:39.648801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:39.648801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:39.648801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:39.648801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:39.648801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:39.648801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:39.649420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16000ca6-b2b5-4dd2-acb7-664d87cbb0a5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:39.651772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 240/490] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:39.652764 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb76a6-87aa-40fe-912f-0b4ec98a5299 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:39.663578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:39.685304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f4149-5594-47e5-80e2-73bbcc834534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:39.686670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:39.687674 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f4149-5594-47e5-80e2-73bbcc834534 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:39.687962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f4149-5594-47e5-80e2-73bbcc834534 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:39.688232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f4149-5594-47e5-80e2-73bbcc834534 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:39.689009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f4149-5594-47e5-80e2-73bbcc834534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:39.689275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f4149-5594-47e5-80e2-73bbcc834534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:39.692446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f4149-5594-47e5-80e2-73bbcc834534 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:39.706123 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 251/491] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:39.707088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f4149-5594-47e5-80e2-73bbcc834534 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:39.770976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb76a6-87aa-40fe-912f-0b4ec98a5299 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:39.808341 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1943dc-2014-4e5f-8c33-d5c10c31ebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:39.809450 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1943dc-2014-4e5f-8c33-d5c10c31ebfa None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:39.810034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1943dc-2014-4e5f-8c33-d5c10c31ebfa None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:39.811102 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1943dc-2014-4e5f-8c33-d5c10c31ebfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:39.817789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f4149-5594-47e5-80e2-73bbcc834534 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:39.823314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1943dc-2014-4e5f-8c33-d5c10c31ebfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-1a1943dc-2014-4e5f-8c33-d5c10c31ebfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:39.832181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:39.833128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:39.833988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:39.833988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:39.833988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:39.833988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:39.833988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:39.833988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:39.833988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:39.833988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:39.833988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:39.833988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:39.833988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:39.833988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:39.836904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 241/492] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:39.837947 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1943dc-2014-4e5f-8c33-d5c10c31ebfa None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:39.862146 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9ebae-ff36-4f02-95a8-346c56c66a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:39.862819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9ebae-ff36-4f02-95a8-346c56c66a5b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:39.863095 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9ebae-ff36-4f02-95a8-346c56c66a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:39.863367 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9ebae-ff36-4f02-95a8-346c56c66a5b None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:39.864115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9ebae-ff36-4f02-95a8-346c56c66a5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:39.864415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9ebae-ff36-4f02-95a8-346c56c66a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:39.865943 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9ebae-ff36-4f02-95a8-346c56c66a5b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:39.875325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 252/493] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:39.876339 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9ebae-ff36-4f02-95a8-346c56c66a5b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:39.915739 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:39.940934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:39.955345 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1943dc-2014-4e5f-8c33-d5c10c31ebfa None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:39.988448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9ebae-ff36-4f02-95a8-346c56c66a5b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:39.994291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f88ad9-d000-4d85-abb6-35b2bc32d62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:39.995223 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f88ad9-d000-4d85-abb6-35b2bc32d62c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:39.995607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f88ad9-d000-4d85-abb6-35b2bc32d62c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:39.995985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f88ad9-d000-4d85-abb6-35b2bc32d62c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:40.004852 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f88ad9-d000-4d85-abb6-35b2bc32d62c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:40.006668 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f88ad9-d000-4d85-abb6-35b2bc32d62c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-60f88ad9-d000-4d85-abb6-35b2bc32d62c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:40.025158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:40.026349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:40.027477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:40.027477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:40.027477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:40.027477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:40.027477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:40.027477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:40.027477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:40.027477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:40.027477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:27:40.027477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:40.033745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 242/494] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 20 22:27:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:40.033745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f88ad9-d000-4d85-abb6-35b2bc32d62c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:40.034776 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf622641-ee3e-45d0-be0c-d75202487bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:40.035649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf622641-ee3e-45d0-be0c-d75202487bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:40.036070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf622641-ee3e-45d0-be0c-d75202487bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:40.036479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf622641-ee3e-45d0-be0c-d75202487bf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:40.037379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf622641-ee3e-45d0-be0c-d75202487bf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:40.038451 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf622641-ee3e-45d0-be0c-d75202487bf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:40.039841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf622641-ee3e-45d0-be0c-d75202487bf4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:40.048954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 253/495] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:40.054386 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99c8e3-e4f0-4bc5-9b43-5437e6fbfb7b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:40.054677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99c8e3-e4f0-4bc5-9b43-5437e6fbfb7b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:40.055011 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99c8e3-e4f0-4bc5-9b43-5437e6fbfb7b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:40.056387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 254/496] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:40.060010 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99c8e3-e4f0-4bc5-9b43-5437e6fbfb7b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:40.141464 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f88ad9-d000-4d85-abb6-35b2bc32d62c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:40.173673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:40.177449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cbe17-87ba-43a6-8625-9207b39dbad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:40.178281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cbe17-87ba-43a6-8625-9207b39dbad6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:40.178529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99c8e3-e4f0-4bc5-9b43-5437e6fbfb7b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:40.178630 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cbe17-87ba-43a6-8625-9207b39dbad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:40.178824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cbe17-87ba-43a6-8625-9207b39dbad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:40.189987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cbe17-87ba-43a6-8625-9207b39dbad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:40.191517 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cbe17-87ba-43a6-8625-9207b39dbad6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:40.199841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-502cbe17-87ba-43a6-8625-9207b39dbad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:40.209762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:40.210837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:40.211813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:40.211813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:40.211813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:40.211813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:40.211813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 243/497] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:40.212094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cbe17-87ba-43a6-8625-9207b39dbad6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:40.222541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3664be-89d0-4774-b45f-52373a6de2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:40.223232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3664be-89d0-4774-b45f-52373a6de2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:40.223516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3664be-89d0-4774-b45f-52373a6de2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:40.223832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3664be-89d0-4774-b45f-52373a6de2f9 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:40.224685 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3664be-89d0-4774-b45f-52373a6de2f9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:40.224997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3664be-89d0-4774-b45f-52373a6de2f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:40.226468 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3664be-89d0-4774-b45f-52373a6de2f9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:40.263360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 255/498] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 20 22:27:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:40.265405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff28139-272f-4c8d-a6a3-bbb6e894588e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:40.265691 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff28139-272f-4c8d-a6a3-bbb6e894588e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:40.266004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff28139-272f-4c8d-a6a3-bbb6e894588e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:40.281854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0ff28139-272f-4c8d-a6a3-bbb6e894588e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:40.283087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0ff28139-272f-4c8d-a6a3-bbb6e894588e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:40.314805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cbe17-87ba-43a6-8625-9207b39dbad6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:40.348968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd45b53-926f-446e-ad3e-cd1c8dcb55fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:40.349149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 256/499] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:40.349961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd45b53-926f-446e-ad3e-cd1c8dcb55fb None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:40.350312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd45b53-926f-446e-ad3e-cd1c8dcb55fb None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:40.350636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db113c0c-6875-422b-9cb0-b07d4b5c8dca None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:40.350753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd45b53-926f-446e-ad3e-cd1c8dcb55fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:40.351050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db113c0c-6875-422b-9cb0-b07d4b5c8dca None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:40.351399 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db113c0c-6875-422b-9cb0-b07d4b5c8dca None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:40.353173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 257/500] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:40.353783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db113c0c-6875-422b-9cb0-b07d4b5c8dca None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:40.362918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd45b53-926f-446e-ad3e-cd1c8dcb55fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:40.364389 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd45b53-926f-446e-ad3e-cd1c8dcb55fb None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ddd45b53-926f-446e-ad3e-cd1c8dcb55fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:40.382271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:40.383372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:40.384281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:40.384281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:40.384281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:40.384281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:40.384281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 244/501] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:40.384281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd45b53-926f-446e-ad3e-cd1c8dcb55fb None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:40.436626 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:40.452755 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:40.463510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db113c0c-6875-422b-9cb0-b07d4b5c8dca None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:40.484342 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd45b53-926f-446e-ad3e-cd1c8dcb55fb None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:40.496918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2985d-ed92-4019-90ca-e6d7d3040782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:40.497601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2985d-ed92-4019-90ca-e6d7d3040782 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:40.497913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2985d-ed92-4019-90ca-e6d7d3040782 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:40.498711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2985d-ed92-4019-90ca-e6d7d3040782 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:40.499474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2985d-ed92-4019-90ca-e6d7d3040782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:40.499744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2985d-ed92-4019-90ca-e6d7d3040782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:40.501129 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2985d-ed92-4019-90ca-e6d7d3040782 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:40.512922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 258/502] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:40.514702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58e54-d3d2-413a-b0dd-efaf381df4b8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:40.515050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58e54-d3d2-413a-b0dd-efaf381df4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:40.515341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f58e54-d3d2-413a-b0dd-efaf381df4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:40.519735 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92771c25-224d-4891-a4e7-a298cdbb635a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:40.520558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92771c25-224d-4891-a4e7-a298cdbb635a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:40.520843 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92771c25-224d-4891-a4e7-a298cdbb635a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:40.521118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92771c25-224d-4891-a4e7-a298cdbb635a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:40.532990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-17f58e54-d3d2-413a-b0dd-efaf381df4b8 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:40.534212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-17f58e54-d3d2-413a-b0dd-efaf381df4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:40.589540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92771c25-224d-4891-a4e7-a298cdbb635a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:40.591024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92771c25-224d-4891-a4e7-a298cdbb635a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:40.602531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 259/503] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:40.603631 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f58e54-d3d2-413a-b0dd-efaf381df4b8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:40.647061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:40.681428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:40.696224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 245/504] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:40.701085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92771c25-224d-4891-a4e7-a298cdbb635a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:40.705302 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f58e54-d3d2-413a-b0dd-efaf381df4b8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:40.740385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c858b-5c99-4643-8a41-c5f31cdb7032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:40.741188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c858b-5c99-4643-8a41-c5f31cdb7032 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:40.741472 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c858b-5c99-4643-8a41-c5f31cdb7032 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:40.741772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c858b-5c99-4643-8a41-c5f31cdb7032 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:40.753633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c858b-5c99-4643-8a41-c5f31cdb7032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-629c858b-5c99-4643-8a41-c5f31cdb7032 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:40.763149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:40.764065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:40.765017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:40.765017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:40.765017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:40.765017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:40.765017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:40.765017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:40.765017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:40.765017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:40.765017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:40.765017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:40.765017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:40.765017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:40.765017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 260/505] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:40.765690 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c858b-5c99-4643-8a41-c5f31cdb7032 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:40.803603 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92771c25-224d-4891-a4e7-a298cdbb635a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:40.839831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0447d-e6d9-4444-a65b-8b9e2f47b48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:40.840492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0447d-e6d9-4444-a65b-8b9e2f47b48e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:40.840772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0447d-e6d9-4444-a65b-8b9e2f47b48e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:40.841047 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0447d-e6d9-4444-a65b-8b9e2f47b48e None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:40.841849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0447d-e6d9-4444-a65b-8b9e2f47b48e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:40.842749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0447d-e6d9-4444-a65b-8b9e2f47b48e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:40.844146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0447d-e6d9-4444-a65b-8b9e2f47b48e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:40.855492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 246/506] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:40.856283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0447d-e6d9-4444-a65b-8b9e2f47b48e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:40.870351 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c858b-5c99-4643-8a41-c5f31cdb7032 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:40.871976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:40.903697 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97964f18-831c-4e7e-8064-e1fc21ead6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:40.904695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97964f18-831c-4e7e-8064-e1fc21ead6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:40.905168 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97964f18-831c-4e7e-8064-e1fc21ead6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:40.905258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97964f18-831c-4e7e-8064-e1fc21ead6e0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:40.907978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:40.913069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97964f18-831c-4e7e-8064-e1fc21ead6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:40.914552 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97964f18-831c-4e7e-8064-e1fc21ead6e0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-97964f18-831c-4e7e-8064-e1fc21ead6e0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:40.930531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:40.931466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:40.932696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:40.932696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:40.932696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:40.932696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:40.932696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:40.932696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:40.932696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:40.932696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:40.932696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 22:27:40.932696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:40.932696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 261/507] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:40.932696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97964f18-831c-4e7e-8064-e1fc21ead6e0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:40.962435 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0447d-e6d9-4444-a65b-8b9e2f47b48e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:40.995880 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515a892-d1ba-4395-8670-e97f026c9019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:40.996680 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515a892-d1ba-4395-8670-e97f026c9019 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:40.996964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515a892-d1ba-4395-8670-e97f026c9019 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:40.997238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515a892-d1ba-4395-8670-e97f026c9019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:41.008605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515a892-d1ba-4395-8670-e97f026c9019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:41.010245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515a892-d1ba-4395-8670-e97f026c9019 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-4515a892-d1ba-4395-8670-e97f026c9019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:41.027094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:41.028065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:41.028966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:41.028966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:41.028966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:41.028966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:41.028966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 247/508] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:41.029240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515a892-d1ba-4395-8670-e97f026c9019 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:41.037656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97964f18-831c-4e7e-8064-e1fc21ead6e0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:41.074260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04ee42-5dfb-4575-a529-949a02f973c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:41.075059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ee42-5dfb-4575-a529-949a02f973c6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:41.075342 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ee42-5dfb-4575-a529-949a02f973c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:41.075626 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f04ee42-5dfb-4575-a529-949a02f973c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:41.086650 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04ee42-5dfb-4575-a529-949a02f973c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:41.088134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f04ee42-5dfb-4575-a529-949a02f973c6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:41.091413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3f04ee42-5dfb-4575-a529-949a02f973c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:41.106520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:41.114124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:41.115148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:41.115148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:41.115148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:41.115148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:41.115148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 262/509] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:41.115148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04ee42-5dfb-4575-a529-949a02f973c6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:41.136157 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515a892-d1ba-4395-8670-e97f026c9019 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:41.158250 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:41.171901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa49551-31d4-48e9-9e80-a087ffc2153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:41.172609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa49551-31d4-48e9-9e80-a087ffc2153a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:41.172895 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa49551-31d4-48e9-9e80-a087ffc2153a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:41.173169 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa49551-31d4-48e9-9e80-a087ffc2153a None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:41.173947 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa49551-31d4-48e9-9e80-a087ffc2153a None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:41.174261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa49551-31d4-48e9-9e80-a087ffc2153a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:41.175658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa49551-31d4-48e9-9e80-a087ffc2153a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:41.183619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 248/510] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:41.184423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa49551-31d4-48e9-9e80-a087ffc2153a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:41.209312 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f04ee42-5dfb-4575-a529-949a02f973c6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:41.243444 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc8cd9-5afc-4c2f-95fe-ca4f33bc039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:41.244170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8cd9-5afc-4c2f-95fe-ca4f33bc039a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:41.244455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8cd9-5afc-4c2f-95fe-ca4f33bc039a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:41.244728 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc8cd9-5afc-4c2f-95fe-ca4f33bc039a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:41.253690 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc8cd9-5afc-4c2f-95fe-ca4f33bc039a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:41.255198 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc8cd9-5afc-4c2f-95fe-ca4f33bc039a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1fdc8cd9-5afc-4c2f-95fe-ca4f33bc039a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:41.270056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:41.271112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:41.272023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:41.272023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:41.272023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:41.272023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:41.272023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:41.272023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:41.272023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:41.272023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:41.272023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 22:27:41.272023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:41.272023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 263/511] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:41.272876 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc8cd9-5afc-4c2f-95fe-ca4f33bc039a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:41.292382 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa49551-31d4-48e9-9e80-a087ffc2153a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:41.319600 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:41.328232 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6473a8-823d-4843-9f95-ea04817fc90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:41.332281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6473a8-823d-4843-9f95-ea04817fc90e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:41.332281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6473a8-823d-4843-9f95-ea04817fc90e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:41.332281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6473a8-823d-4843-9f95-ea04817fc90e None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:41.332281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6473a8-823d-4843-9f95-ea04817fc90e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:41.332281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6473a8-823d-4843-9f95-ea04817fc90e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:41.332281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6473a8-823d-4843-9f95-ea04817fc90e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:41.370670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 249/512] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Jul 20 22:27:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:41.371647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6473a8-823d-4843-9f95-ea04817fc90e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:41.381069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc8cd9-5afc-4c2f-95fe-ca4f33bc039a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:41.390777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:41.417291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46755daf-8efa-49bb-998f-042869b4c4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:41.418272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46755daf-8efa-49bb-998f-042869b4c4ce None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:41.418565 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46755daf-8efa-49bb-998f-042869b4c4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:41.418846 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46755daf-8efa-49bb-998f-042869b4c4ce None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:41.419595 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46755daf-8efa-49bb-998f-042869b4c4ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:41.419906 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46755daf-8efa-49bb-998f-042869b4c4ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:41.421352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46755daf-8efa-49bb-998f-042869b4c4ce None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:41.433849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 264/513] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:41.434600 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46755daf-8efa-49bb-998f-042869b4c4ce None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:41.483225 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6473a8-823d-4843-9f95-ea04817fc90e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:41.519787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa1854-5419-433d-9cbd-b76628a73db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:41.520374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa1854-5419-433d-9cbd-b76628a73db9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:41.520657 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa1854-5419-433d-9cbd-b76628a73db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:41.520934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aa1854-5419-433d-9cbd-b76628a73db9 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:41.521666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa1854-5419-433d-9cbd-b76628a73db9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:41.522009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa1854-5419-433d-9cbd-b76628a73db9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:41.523386 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aa1854-5419-433d-9cbd-b76628a73db9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:41.536431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 250/514] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:41.537299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa1854-5419-433d-9cbd-b76628a73db9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:41.545142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46755daf-8efa-49bb-998f-042869b4c4ce None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:41.580746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad9006-70f3-467c-a90d-bc68b23b094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:41.581622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad9006-70f3-467c-a90d-bc68b23b094a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:41.581939 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad9006-70f3-467c-a90d-bc68b23b094a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:41.582221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad9006-70f3-467c-a90d-bc68b23b094a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:41.586742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:41.594260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad9006-70f3-467c-a90d-bc68b23b094a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:41.595783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad9006-70f3-467c-a90d-bc68b23b094a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-edad9006-70f3-467c-a90d-bc68b23b094a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:41.614116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:41.615772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:41.616646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:41.616646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:41.616646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:41.616646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:41.616646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 265/515] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:41.616646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad9006-70f3-467c-a90d-bc68b23b094a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:41.641461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:41.645768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aa1854-5419-433d-9cbd-b76628a73db9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:41.682705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8fd9d-ffb1-4086-9a39-34f6992fcf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:41.683390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8fd9d-ffb1-4086-9a39-34f6992fcf7c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:41.683658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8fd9d-ffb1-4086-9a39-34f6992fcf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:41.683958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8fd9d-ffb1-4086-9a39-34f6992fcf7c None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:41.684811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8fd9d-ffb1-4086-9a39-34f6992fcf7c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:41.685121 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8fd9d-ffb1-4086-9a39-34f6992fcf7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:41.686822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a8fd9d-ffb1-4086-9a39-34f6992fcf7c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:41.704895 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 251/516] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Jul 20 22:27:41 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:41.705767 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8fd9d-ffb1-4086-9a39-34f6992fcf7c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:41.737518 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad9006-70f3-467c-a90d-bc68b23b094a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:41.776683 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cecbb-4471-4b78-8b18-1f4e8f06a38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:41.777259 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cecbb-4471-4b78-8b18-1f4e8f06a38b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:41.777546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cecbb-4471-4b78-8b18-1f4e8f06a38b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:41.777889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cecbb-4471-4b78-8b18-1f4e8f06a38b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:41.818705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a8fd9d-ffb1-4086-9a39-34f6992fcf7c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:41.820302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:41.855451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b02e90-d744-4f4b-bfec-0b681a4c45f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:41.856156 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b02e90-d744-4f4b-bfec-0b681a4c45f2 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:41.856439 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b02e90-d744-4f4b-bfec-0b681a4c45f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:41.856717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b02e90-d744-4f4b-bfec-0b681a4c45f2 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:41.858834 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b02e90-d744-4f4b-bfec-0b681a4c45f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:41.858976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cecbb-4471-4b78-8b18-1f4e8f06a38b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:41.859188 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b02e90-d744-4f4b-bfec-0b681a4c45f2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:41.859345 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cecbb-4471-4b78-8b18-1f4e8f06a38b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:41.882063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:41.948878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 252/517] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:27:41 2022] POST /identity/v3/users => generated 247 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:27:41.949774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b02e90-d744-4f4b-bfec-0b681a4c45f2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:41.982410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 266/518] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:41.984276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cecbb-4471-4b78-8b18-1f4e8f06a38b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:42.094612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b02e90-d744-4f4b-bfec-0b681a4c45f2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:42.115801 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cecbb-4471-4b78-8b18-1f4e8f06a38b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:42.138480 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64923acf-ebd3-40ea-9a8f-62d304a39669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:42.140969 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64923acf-ebd3-40ea-9a8f-62d304a39669 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:42.141283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64923acf-ebd3-40ea-9a8f-62d304a39669 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:42.141564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64923acf-ebd3-40ea-9a8f-62d304a39669 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:42.141901 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:42.152612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64923acf-ebd3-40ea-9a8f-62d304a39669 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:42.154592 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64923acf-ebd3-40ea-9a8f-62d304a39669 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:42.163069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d316d53-79ab-4c18-b44e-ec5b996ed126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:42.163991 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d316d53-79ab-4c18-b44e-ec5b996ed126 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:42.164451 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d316d53-79ab-4c18-b44e-ec5b996ed126 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:42.164917 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d316d53-79ab-4c18-b44e-ec5b996ed126 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:42.165832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d316d53-79ab-4c18-b44e-ec5b996ed126 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:42.166293 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d316d53-79ab-4c18-b44e-ec5b996ed126 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:42.168003 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d316d53-79ab-4c18-b44e-ec5b996ed126 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-64923acf-ebd3-40ea-9a8f-62d304a39669 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:42.173666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:42.174595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:42.175494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:42.175494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:42.175494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:42.175494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:42.175494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:42.175494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:42.175494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:42.175494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:42.175494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 253/519] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:42.175980 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64923acf-ebd3-40ea-9a8f-62d304a39669 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:42.184451 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 267/520] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:42.186762 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d316d53-79ab-4c18-b44e-ec5b996ed126 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:42.199246 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:42.292115 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64923acf-ebd3-40ea-9a8f-62d304a39669 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:42.298455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d316d53-79ab-4c18-b44e-ec5b996ed126 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:42.330904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed46b5-1001-4ad1-9470-a55deee921b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:42.331571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed46b5-1001-4ad1-9470-a55deee921b9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:42.331858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed46b5-1001-4ad1-9470-a55deee921b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:42.332139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed46b5-1001-4ad1-9470-a55deee921b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:42.333824 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd021b7-dfb6-4185-a81f-3eff52567535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:42.334566 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd021b7-dfb6-4185-a81f-3eff52567535 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:42.335016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd021b7-dfb6-4185-a81f-3eff52567535 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:42.335297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd021b7-dfb6-4185-a81f-3eff52567535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:42.347273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd021b7-dfb6-4185-a81f-3eff52567535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:42.348738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd021b7-dfb6-4185-a81f-3eff52567535 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1bd021b7-dfb6-4185-a81f-3eff52567535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:42.367942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:42.368857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:42.370325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:42.370325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:42.370325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:42.370325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:42.370325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 268/521] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:42.370325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd021b7-dfb6-4185-a81f-3eff52567535 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:42.402070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:42.413161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed46b5-1001-4ad1-9470-a55deee921b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:42.421209 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed46b5-1001-4ad1-9470-a55deee921b9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:42.435349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:42.479522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd021b7-dfb6-4185-a81f-3eff52567535 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:42.516130 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cc37a-1369-4132-bcfd-6f248cf9bb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:42.516813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cc37a-1369-4132-bcfd-6f248cf9bb78 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:42.517094 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cc37a-1369-4132-bcfd-6f248cf9bb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:42.517369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cc37a-1369-4132-bcfd-6f248cf9bb78 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:42.518204 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cc37a-1369-4132-bcfd-6f248cf9bb78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:42.518516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cc37a-1369-4132-bcfd-6f248cf9bb78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:42.519949 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cc37a-1369-4132-bcfd-6f248cf9bb78 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:42.531933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 254/522] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:42.533023 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed46b5-1001-4ad1-9470-a55deee921b9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:42.538831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 269/523] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:42.539665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cc37a-1369-4132-bcfd-6f248cf9bb78 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:42.637017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:42.645866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cc37a-1369-4132-bcfd-6f248cf9bb78 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:42.650369 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed46b5-1001-4ad1-9470-a55deee921b9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:42.666602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:42.682251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2afa4b-90bf-48c9-a0bb-65fa987e28a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:42.682926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2afa4b-90bf-48c9-a0bb-65fa987e28a2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:42.683212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2afa4b-90bf-48c9-a0bb-65fa987e28a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:42.683488 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2afa4b-90bf-48c9-a0bb-65fa987e28a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:42.684216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2afa4b-90bf-48c9-a0bb-65fa987e28a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:42.684462 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc9497-30f7-41bc-86a8-7ca0601fb418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:42.684918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2afa4b-90bf-48c9-a0bb-65fa987e28a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:42.685312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc9497-30f7-41bc-86a8-7ca0601fb418 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:42.685634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc9497-30f7-41bc-86a8-7ca0601fb418 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:42.685943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc9497-30f7-41bc-86a8-7ca0601fb418 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:42.686160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2afa4b-90bf-48c9-a0bb-65fa987e28a2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:42.694017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc9497-30f7-41bc-86a8-7ca0601fb418 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:42.695474 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc9497-30f7-41bc-86a8-7ca0601fb418 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:42.698005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 270/524] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:42.702790 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2afa4b-90bf-48c9-a0bb-65fa987e28a2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-b5bc9497-30f7-41bc-86a8-7ca0601fb418 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:42.715715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:42.716703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:42.718774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:42.718774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:42.718774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:42.718774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:42.718774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:42.718774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:42.718774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:42.718774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:42.718774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 22:27:42.718774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:42.718774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 255/525] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:42.718774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc9497-30f7-41bc-86a8-7ca0601fb418 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:42.816519 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2afa4b-90bf-48c9-a0bb-65fa987e28a2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:42.826361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc9497-30f7-41bc-86a8-7ca0601fb418 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:42.860661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a90fed-5473-48a4-ad00-8056048f3a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:42.861672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a90fed-5473-48a4-ad00-8056048f3a4f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:42.862067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a90fed-5473-48a4-ad00-8056048f3a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:42.862426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a90fed-5473-48a4-ad00-8056048f3a4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:42.868239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbff3f-bf26-476e-a06d-6dd96c96fa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:42.869470 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbff3f-bf26-476e-a06d-6dd96c96fa6e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:42.869869 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbff3f-bf26-476e-a06d-6dd96c96fa6e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:42.870212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbff3f-bf26-476e-a06d-6dd96c96fa6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:42.871134 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbff3f-bf26-476e-a06d-6dd96c96fa6e None admin] RBAC: Adding query filter params (role.id=2a5f2a34d0b341e58b642fc48dc7c5da, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=67c92c8d2b9d41e489e4c03ae4e71fe2) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:42.871900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbff3f-bf26-476e-a06d-6dd96c96fa6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:42.873708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a90fed-5473-48a4-ad00-8056048f3a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:42.873931 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbff3f-bf26-476e-a06d-6dd96c96fa6e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:42.875247 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a90fed-5473-48a4-ad00-8056048f3a4f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:42.890190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 256/526] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:42 2022] GET /identity/v3/role_assignments?user.id=67c92c8d2b9d41e489e4c03ae4e71fe2&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=2a5f2a34d0b341e58b642fc48dc7c5da => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:42.890190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbff3f-bf26-476e-a06d-6dd96c96fa6e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-46a90fed-5473-48a4-ad00-8056048f3a4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:42.903188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:42.904937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:42.906850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:42.906850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:42.906850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:42.906850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:42.906850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 271/527] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:42.906850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a90fed-5473-48a4-ad00-8056048f3a4f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:42.910865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:42.954872 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:43.018162 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbff3f-bf26-476e-a06d-6dd96c96fa6e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:43.036879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a90fed-5473-48a4-ad00-8056048f3a4f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:43.070776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ea6c0-d8bf-4e0a-bff8-8f122b7e54f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:43.070776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ea6c0-d8bf-4e0a-bff8-8f122b7e54f0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:43.070776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ea6c0-d8bf-4e0a-bff8-8f122b7e54f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:43.070776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ea6c0-d8bf-4e0a-bff8-8f122b7e54f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:43.082272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ea6c0-d8bf-4e0a-bff8-8f122b7e54f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:43.083743 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ea6c0-d8bf-4e0a-bff8-8f122b7e54f0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:43.086235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a3bb6-cbdc-4df0-834d-3c96186bc794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:43.086922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3bb6-cbdc-4df0-834d-3c96186bc794 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:43.087200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3bb6-cbdc-4df0-834d-3c96186bc794 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:43.087471 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3bb6-cbdc-4df0-834d-3c96186bc794 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:43.088322 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a3bb6-cbdc-4df0-834d-3c96186bc794 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:43.088632 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a3bb6-cbdc-4df0-834d-3c96186bc794 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:43.090089 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a3bb6-cbdc-4df0-834d-3c96186bc794 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-389ea6c0-d8bf-4e0a-bff8-8f122b7e54f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:43.104159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:43.105088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:43.105987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:43.105987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:43.105987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:43.105987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:43.105987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:43.105987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:43.105987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:43.105987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:43.108863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 257/528] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:43.109947 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ea6c0-d8bf-4e0a-bff8-8f122b7e54f0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:43.118151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 272/529] 10.222.0.83 () {56 vars in 1139 bytes} [Wed Jul 20 22:27:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:43.118151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a3bb6-cbdc-4df0-834d-3c96186bc794 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:43.206641 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:43.250551 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ea6c0-d8bf-4e0a-bff8-8f122b7e54f0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:43.252883 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:43.256357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a3bb6-cbdc-4df0-834d-3c96186bc794 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:43.293647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757d7d2-5a7f-478b-b3be-c046f38482bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:43.294804 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757d7d2-5a7f-478b-b3be-c046f38482bd None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:43.295483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757d7d2-5a7f-478b-b3be-c046f38482bd None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:43.295972 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757d7d2-5a7f-478b-b3be-c046f38482bd None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:43.296923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757d7d2-5a7f-478b-b3be-c046f38482bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:43.297853 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757d7d2-5a7f-478b-b3be-c046f38482bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:43.299327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6524d7-bd8b-4f24-a053-35c321d7a7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:43.300063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6524d7-bd8b-4f24-a053-35c321d7a7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:43.300417 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6524d7-bd8b-4f24-a053-35c321d7a7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:43.300777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6524d7-bd8b-4f24-a053-35c321d7a7e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:43.301320 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757d7d2-5a7f-478b-b3be-c046f38482bd None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:43.301697 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6524d7-bd8b-4f24-a053-35c321d7a7e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:43.302115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6524d7-bd8b-4f24-a053-35c321d7a7e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:43.303719 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6524d7-bd8b-4f24-a053-35c321d7a7e5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:43.319875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 258/531] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:43.321070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757d7d2-5a7f-478b-b3be-c046f38482bd None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:43.321849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 273/531] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:43.322696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6524d7-bd8b-4f24-a053-35c321d7a7e5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:43.428438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757d7d2-5a7f-478b-b3be-c046f38482bd None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:43.434746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6524d7-bd8b-4f24-a053-35c321d7a7e5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:43.465067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:43.468613 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea3422-8606-41ba-b483-51d41e498d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:43.469502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea3422-8606-41ba-b483-51d41e498d9a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:43.470005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea3422-8606-41ba-b483-51d41e498d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:43.470476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea3422-8606-41ba-b483-51d41e498d9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:43.478813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96f64f-cc42-4172-b10d-714d006feb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:43.480291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f64f-cc42-4172-b10d-714d006feb04 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:43.480752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f64f-cc42-4172-b10d-714d006feb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:43.481199 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96f64f-cc42-4172-b10d-714d006feb04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:43.482747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96f64f-cc42-4172-b10d-714d006feb04 None admin] RBAC: Adding query filter params (role.id=2a5f2a34d0b341e58b642fc48dc7c5da, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=669a11ce83b746eeb7f4e7d0acca4b6f) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:43.483263 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96f64f-cc42-4172-b10d-714d006feb04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:43.485630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96f64f-cc42-4172-b10d-714d006feb04 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:43.498872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 274/532] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:43 2022] GET /identity/v3/role_assignments?user.id=669a11ce83b746eeb7f4e7d0acca4b6f&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=2a5f2a34d0b341e58b642fc48dc7c5da => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:43.498872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96f64f-cc42-4172-b10d-714d006feb04 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:43.525968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:43.609449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea3422-8606-41ba-b483-51d41e498d9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:43.610974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efea3422-8606-41ba-b483-51d41e498d9a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:43.701919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96f64f-cc42-4172-b10d-714d006feb04 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:43.741584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faed4df-917f-435c-8a03-76f69dfd5688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:43.742393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faed4df-917f-435c-8a03-76f69dfd5688 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:43.742686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faed4df-917f-435c-8a03-76f69dfd5688 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:43.742968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faed4df-917f-435c-8a03-76f69dfd5688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:43.750714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faed4df-917f-435c-8a03-76f69dfd5688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:43.751871 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faed4df-917f-435c-8a03-76f69dfd5688 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:43.764455 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 259/533] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-4faed4df-917f-435c-8a03-76f69dfd5688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:43.770148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:43.770987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:43.771842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:43.771842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:43.771842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:43.771842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:43.771842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:43.771842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:43.771842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:43.771842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:43.771842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 275/534] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:43.773716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea3422-8606-41ba-b483-51d41e498d9a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:43.777532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faed4df-917f-435c-8a03-76f69dfd5688 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:43.830102 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:43.881603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faed4df-917f-435c-8a03-76f69dfd5688 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:43.883655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:43.953180 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea3422-8606-41ba-b483-51d41e498d9a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:43.957365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a76375-59b4-4f87-a392-a358d6b576b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:43.958283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a76375-59b4-4f87-a392-a358d6b576b7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:43.958783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a76375-59b4-4f87-a392-a358d6b576b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:43.959274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a76375-59b4-4f87-a392-a358d6b576b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:43.960537 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a76375-59b4-4f87-a392-a358d6b576b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:43.968461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a76375-59b4-4f87-a392-a358d6b576b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:43.970221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a76375-59b4-4f87-a392-a358d6b576b7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:43.990345 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 276/535] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:43.996429 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a76375-59b4-4f87-a392-a358d6b576b7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:44.025096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57cdc5-427c-4543-a6f9-542c4d7361e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:44.027103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57cdc5-427c-4543-a6f9-542c4d7361e7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:44.028337 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57cdc5-427c-4543-a6f9-542c4d7361e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:44.028985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57cdc5-427c-4543-a6f9-542c4d7361e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:44.048998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57cdc5-427c-4543-a6f9-542c4d7361e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:44.051471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57cdc5-427c-4543-a6f9-542c4d7361e7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ab57cdc5-427c-4543-a6f9-542c4d7361e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:44.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:44.091635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:44.092939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:44.092939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:44.092939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:44.092939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:44.096691 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 260/536] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:44.103416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57cdc5-427c-4543-a6f9-542c4d7361e7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:44.178634 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a76375-59b4-4f87-a392-a358d6b576b7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:44.186589 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:44.214512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c2027-56dc-4dd7-8100-165e22bdfc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:44.215328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c2027-56dc-4dd7-8100-165e22bdfc06 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:44.215613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c2027-56dc-4dd7-8100-165e22bdfc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:44.215892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c2027-56dc-4dd7-8100-165e22bdfc06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:44.216761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c2027-56dc-4dd7-8100-165e22bdfc06 None admin] RBAC: Adding query filter params (role.id=2a5f2a34d0b341e58b642fc48dc7c5da, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=12ab5b94b21b466e8070771a61378e89) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:44.217644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c2027-56dc-4dd7-8100-165e22bdfc06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:44.219327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c2027-56dc-4dd7-8100-165e22bdfc06 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:44.225101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 277/537] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:43 2022] GET /identity/v3/role_assignments?user.id=12ab5b94b21b466e8070771a61378e89&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=2a5f2a34d0b341e58b642fc48dc7c5da => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:44.231025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce1849-832f-4b32-bc68-28f1981fa312 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:44.231312 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce1849-832f-4b32-bc68-28f1981fa312 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:44.231604 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce1849-832f-4b32-bc68-28f1981fa312 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:44.234972 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 278/538] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:44.241607 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a3c05-58d4-43da-89ab-f101013835d1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:44.241926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a3c05-58d4-43da-89ab-f101013835d1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:44.242210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a3c05-58d4-43da-89ab-f101013835d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:44.252366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57cdc5-427c-4543-a6f9-542c4d7361e7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:44.269089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:44.274432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b14a3c05-58d4-43da-89ab-f101013835d1 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:44.275671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b14a3c05-58d4-43da-89ab-f101013835d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:44.307048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6123a5-8674-4ace-8df7-6a93ee433e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:44.307810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6123a5-8674-4ace-8df7-6a93ee433e31 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:44.308098 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6123a5-8674-4ace-8df7-6a93ee433e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:44.308379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6123a5-8674-4ace-8df7-6a93ee433e31 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:44.309539 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6123a5-8674-4ace-8df7-6a93ee433e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:44.309886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6123a5-8674-4ace-8df7-6a93ee433e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:44.312368 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6123a5-8674-4ace-8df7-6a93ee433e31 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:44.344462 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 261/539] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:44.350205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6123a5-8674-4ace-8df7-6a93ee433e31 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:44.403969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 279/540] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:44.440802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a3c05-58d4-43da-89ab-f101013835d1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:44.546913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6123a5-8674-4ace-8df7-6a93ee433e31 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:44.586721 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a3c05-58d4-43da-89ab-f101013835d1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:44.598101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:44.610262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21602097-dc2e-47af-8d37-1c57bc47200c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:44.611069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21602097-dc2e-47af-8d37-1c57bc47200c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:44.611350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21602097-dc2e-47af-8d37-1c57bc47200c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:44.611676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21602097-dc2e-47af-8d37-1c57bc47200c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:44.627445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21602097-dc2e-47af-8d37-1c57bc47200c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:44.628924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21602097-dc2e-47af-8d37-1c57bc47200c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:44.632754 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8348bef-40ff-443b-a1e6-876bf26a4ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:44.633570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8348bef-40ff-443b-a1e6-876bf26a4ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:44.633881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8348bef-40ff-443b-a1e6-876bf26a4ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:44.634507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8348bef-40ff-443b-a1e6-876bf26a4ea5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:44.658304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8348bef-40ff-443b-a1e6-876bf26a4ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-21602097-dc2e-47af-8d37-1c57bc47200c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:44.664723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:44.666683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:44.668710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:44.668710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:44.668710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:44.668710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:44.668710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:44.668710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:44.668710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:44.668710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:44.668710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 262/541] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f8348bef-40ff-443b-a1e6-876bf26a4ea5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:44.670546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:44.672496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:44.679106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:44.679106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:44.679106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:44.679106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:44.679106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:44.679106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:44.679106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:44.679106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:44.679106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:44.679106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:44.679106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:44.679106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:44.679106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 280/542] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:44.680708 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21602097-dc2e-47af-8d37-1c57bc47200c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:44.683430 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8348bef-40ff-443b-a1e6-876bf26a4ea5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:44.746940 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:44.848676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8348bef-40ff-443b-a1e6-876bf26a4ea5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:44.895186 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2e1f5-8e3e-4142-a5c5-7682c17f53e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:44.896329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e1f5-8e3e-4142-a5c5-7682c17f53e2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:44.896816 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e1f5-8e3e-4142-a5c5-7682c17f53e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:44.897289 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e1f5-8e3e-4142-a5c5-7682c17f53e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:44.898579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2e1f5-8e3e-4142-a5c5-7682c17f53e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:44.899138 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2e1f5-8e3e-4142-a5c5-7682c17f53e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:44.900900 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2e1f5-8e3e-4142-a5c5-7682c17f53e2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:44.916959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 281/543] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:44.925081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2e1f5-8e3e-4142-a5c5-7682c17f53e2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:44.935779 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21602097-dc2e-47af-8d37-1c57bc47200c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:44.950117 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:45.036805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2e1f5-8e3e-4142-a5c5-7682c17f53e2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:45.068877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd94fa-4a4c-496e-84f5-d17be4d60332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:45.068877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd94fa-4a4c-496e-84f5-d17be4d60332 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:45.068877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd94fa-4a4c-496e-84f5-d17be4d60332 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:45.068877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd94fa-4a4c-496e-84f5-d17be4d60332 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:45.069294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd94fa-4a4c-496e-84f5-d17be4d60332 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:45.069544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd94fa-4a4c-496e-84f5-d17be4d60332 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:45.070878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd94fa-4a4c-496e-84f5-d17be4d60332 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:45.096112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 263/544] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:45.097517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80207b-9187-4640-add5-648cdf6f281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:45.098658 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80207b-9187-4640-add5-648cdf6f281b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:45.099477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80207b-9187-4640-add5-648cdf6f281b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:45.100269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80207b-9187-4640-add5-648cdf6f281b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:45.101449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd94fa-4a4c-496e-84f5-d17be4d60332 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:45.102464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80207b-9187-4640-add5-648cdf6f281b None admin] RBAC: Adding query filter params (role.id=2a5f2a34d0b341e58b642fc48dc7c5da, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=d3faac5703c54396bcdba9e149a6d35e) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:45.103618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80207b-9187-4640-add5-648cdf6f281b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:45.105747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80207b-9187-4640-add5-648cdf6f281b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:45.113757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 282/545] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:44 2022] GET /identity/v3/role_assignments?user.id=d3faac5703c54396bcdba9e149a6d35e&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=2a5f2a34d0b341e58b642fc48dc7c5da => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:45.127681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d474b-6843-4255-8ca1-636d3cf5905b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:45.127980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d474b-6843-4255-8ca1-636d3cf5905b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:45.128277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d474b-6843-4255-8ca1-636d3cf5905b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:45.130160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 283/546] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:45.136047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9b5a5-e248-406f-8bac-4b3aa0883246 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:45.136358 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9b5a5-e248-406f-8bac-4b3aa0883246 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:45.136603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9b5a5-e248-406f-8bac-4b3aa0883246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:45.158383 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-52f9b5a5-e248-406f-8bac-4b3aa0883246 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:45.159602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-52f9b5a5-e248-406f-8bac-4b3aa0883246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:45.268170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 284/547] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:27:45.294452 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9b5a5-e248-406f-8bac-4b3aa0883246 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:45.315050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:45.316830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:45.325329 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd94fa-4a4c-496e-84f5-d17be4d60332 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:45.399435 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebe6a8-935a-4958-94e1-08b5a3aa0bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:45.400158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebe6a8-935a-4958-94e1-08b5a3aa0bdb None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:45.400443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebe6a8-935a-4958-94e1-08b5a3aa0bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:45.400720 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebe6a8-935a-4958-94e1-08b5a3aa0bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:45.425416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebe6a8-935a-4958-94e1-08b5a3aa0bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:45.426964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebe6a8-935a-4958-94e1-08b5a3aa0bdb None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:45.446657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9b5a5-e248-406f-8bac-4b3aa0883246 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-a6ebe6a8-935a-4958-94e1-08b5a3aa0bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:45.474489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:45.475671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:45.476570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:45.476570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:45.476570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:45.476570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:45.476570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 264/548] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:45.483835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebe6a8-935a-4958-94e1-08b5a3aa0bdb None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:45.487735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0e178-5a31-4b3e-8ecb-0d5052ded088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:45.488621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0e178-5a31-4b3e-8ecb-0d5052ded088 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:45.488966 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0e178-5a31-4b3e-8ecb-0d5052ded088 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:45.489309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0e178-5a31-4b3e-8ecb-0d5052ded088 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:45.502397 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0e178-5a31-4b3e-8ecb-0d5052ded088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a5a0e178-5a31-4b3e-8ecb-0d5052ded088 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:45.510855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:45.513161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:45.515870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:45.515870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:45.515870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:45.515870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:45.515870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:45.515870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:45.515870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:45.515870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:45.515870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:45.515870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:45.515870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:45.515870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:45.515870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 285/549] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:45.520679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0e178-5a31-4b3e-8ecb-0d5052ded088 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:45.637622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:45.675705 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0e178-5a31-4b3e-8ecb-0d5052ded088 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:45.706140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebe6a8-935a-4958-94e1-08b5a3aa0bdb None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:45.748589 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39e118-e97f-43cf-be6c-69e56ee32d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:45.749266 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39e118-e97f-43cf-be6c-69e56ee32d3b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:45.749553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39e118-e97f-43cf-be6c-69e56ee32d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:45.749855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39e118-e97f-43cf-be6c-69e56ee32d3b None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:45.750625 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39e118-e97f-43cf-be6c-69e56ee32d3b None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:45.750938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39e118-e97f-43cf-be6c-69e56ee32d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:45.752321 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b39e118-e97f-43cf-be6c-69e56ee32d3b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:45.768005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 286/550] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:45.770955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc9912-48b5-4481-8303-e6d950d34fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:45.771819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc9912-48b5-4481-8303-e6d950d34fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:45.771997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc9912-48b5-4481-8303-e6d950d34fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:45.772265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc9912-48b5-4481-8303-e6d950d34fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:45.773013 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc9912-48b5-4481-8303-e6d950d34fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:45.773329 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc9912-48b5-4481-8303-e6d950d34fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:45.774418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39e118-e97f-43cf-be6c-69e56ee32d3b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:45.776419 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc9912-48b5-4481-8303-e6d950d34fd6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:45.799933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 265/551] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:45.806052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc9912-48b5-4481-8303-e6d950d34fd6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:45.826106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:45.971379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc9912-48b5-4481-8303-e6d950d34fd6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:45.990603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39e118-e97f-43cf-be6c-69e56ee32d3b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:46.013419 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddda19bc-eb31-48de-a64f-69084322b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:46.014647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda19bc-eb31-48de-a64f-69084322b824 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:46.015347 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda19bc-eb31-48de-a64f-69084322b824 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:46.015641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda19bc-eb31-48de-a64f-69084322b824 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:46.025136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda19bc-eb31-48de-a64f-69084322b824 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:46.026611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddda19bc-eb31-48de-a64f-69084322b824 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:46.028042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce84363-f3d5-4d05-a614-c3233bda463c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:46.029007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce84363-f3d5-4d05-a614-c3233bda463c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:46.029837 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce84363-f3d5-4d05-a614-c3233bda463c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:46.030128 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce84363-f3d5-4d05-a614-c3233bda463c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:46.033229 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:46.041894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce84363-f3d5-4d05-a614-c3233bda463c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:46.043360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce84363-f3d5-4d05-a614-c3233bda463c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ddda19bc-eb31-48de-a64f-69084322b824 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:46.045905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:46.046991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:46.047941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:46.047941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:46.047941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:46.047941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:46.047941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:46.047941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:46.047941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:46.047941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:46.047941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 22:27:46.047941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:46.047941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 266/552] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:27:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:46.047941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc30b7d-fc40-470c-8f4b-02003ca05893 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:46.048674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc30b7d-fc40-470c-8f4b-02003ca05893 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:46.048674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc30b7d-fc40-470c-8f4b-02003ca05893 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:46.054223 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 267/553] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:46.056049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594d328-3261-43fd-abf2-76c8aea5ffb6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:46.056343 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594d328-3261-43fd-abf2-76c8aea5ffb6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:46.056623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594d328-3261-43fd-abf2-76c8aea5ffb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3ce84363-f3d5-4d05-a614-c3233bda463c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:46.067052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:46.069124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:46.071282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:46.071282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:46.071282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:46.071282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:46.071282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 287/554] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:46.071282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce84363-f3d5-4d05-a614-c3233bda463c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:46.090204 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8594d328-3261-43fd-abf2-76c8aea5ffb6 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:46.091670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8594d328-3261-43fd-abf2-76c8aea5ffb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:46.166237 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:46.177744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 268/555] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:46.177744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594d328-3261-43fd-abf2-76c8aea5ffb6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:46.218807 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce84363-f3d5-4d05-a614-c3233bda463c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:46.269548 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f228e96-b643-4fa7-9020-76c2c8f07fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:46.270965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f228e96-b643-4fa7-9020-76c2c8f07fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:46.271826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f228e96-b643-4fa7-9020-76c2c8f07fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:46.272280 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f228e96-b643-4fa7-9020-76c2c8f07fe9 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:46.273655 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f228e96-b643-4fa7-9020-76c2c8f07fe9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:46.274467 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f228e96-b643-4fa7-9020-76c2c8f07fe9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:46.276823 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f228e96-b643-4fa7-9020-76c2c8f07fe9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:46.297308 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594d328-3261-43fd-abf2-76c8aea5ffb6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:46.314850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 288/556] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Jul 20 22:27:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:46.317517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f228e96-b643-4fa7-9020-76c2c8f07fe9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:46.350483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf201694-ddc6-48b3-a607-74f6dac8ebe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:46.351120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201694-ddc6-48b3-a607-74f6dac8ebe4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:46.351406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201694-ddc6-48b3-a607-74f6dac8ebe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:46.351684 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf201694-ddc6-48b3-a607-74f6dac8ebe4 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:46.352562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf201694-ddc6-48b3-a607-74f6dac8ebe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:46.353300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf201694-ddc6-48b3-a607-74f6dac8ebe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:46.355514 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf201694-ddc6-48b3-a607-74f6dac8ebe4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:46.371763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 269/557] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:46.372645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf201694-ddc6-48b3-a607-74f6dac8ebe4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:46.383900 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:46.442105 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:46.457799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f228e96-b643-4fa7-9020-76c2c8f07fe9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:46.490221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf201694-ddc6-48b3-a607-74f6dac8ebe4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:46.510104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4775587-5a10-4157-bbdd-6a49e0a9cdb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:46.510909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4775587-5a10-4157-bbdd-6a49e0a9cdb1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:46.511187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4775587-5a10-4157-bbdd-6a49e0a9cdb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:46.511465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4775587-5a10-4157-bbdd-6a49e0a9cdb1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:46.522733 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4775587-5a10-4157-bbdd-6a49e0a9cdb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:46.531681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc9864-6ec4-48b3-b657-d6e04a5667a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c4775587-5a10-4157-bbdd-6a49e0a9cdb1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:46.532192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:46.533684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:46.534571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:46.534571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:46.534571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:46.534571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:46.534571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:46.534571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:46.534571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:46.534571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:46.534571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:46.534571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:46.534571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:46.534571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:46.534571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 289/558] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:46.534571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4775587-5a10-4157-bbdd-6a49e0a9cdb1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:46.536114 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc9864-6ec4-48b3-b657-d6e04a5667a7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:46.536589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc9864-6ec4-48b3-b657-d6e04a5667a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:46.537050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc9864-6ec4-48b3-b657-d6e04a5667a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:46.612646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc9864-6ec4-48b3-b657-d6e04a5667a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:46.614489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc9864-6ec4-48b3-b657-d6e04a5667a7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:46.645664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4775587-5a10-4157-bbdd-6a49e0a9cdb1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:46.653222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:46.676972 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:46.682962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7f147-689f-4c00-adff-9bfe6b6ef9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:46.683947 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7f147-689f-4c00-adff-9bfe6b6ef9bb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:46.684058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7f147-689f-4c00-adff-9bfe6b6ef9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:46.684313 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7f147-689f-4c00-adff-9bfe6b6ef9bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:46.692085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7f147-689f-4c00-adff-9bfe6b6ef9bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:46.693543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7f147-689f-4c00-adff-9bfe6b6ef9bb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-9ea7f147-689f-4c00-adff-9bfe6b6ef9bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:46.708841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:46.709973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:46.710929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:46.710929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:46.710929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:46.710929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:46.710929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:46.710929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:46.710929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:46.710929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:46.710929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:27:46.710929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:46.715003 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 290/559] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 20 22:27:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:46.715921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7f147-689f-4c00-adff-9bfe6b6ef9bb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:46.736088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 270/560] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:46.737368 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc9864-6ec4-48b3-b657-d6e04a5667a7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:46.820804 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7f147-689f-4c00-adff-9bfe6b6ef9bb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:46.851039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc9864-6ec4-48b3-b657-d6e04a5667a7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:46.856504 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592217d-2344-41c6-82a2-d019640861e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:46.857179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592217d-2344-41c6-82a2-d019640861e4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:46.857497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592217d-2344-41c6-82a2-d019640861e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:46.857987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592217d-2344-41c6-82a2-d019640861e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:46.858867 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592217d-2344-41c6-82a2-d019640861e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:46.859178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592217d-2344-41c6-82a2-d019640861e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:46.860559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592217d-2344-41c6-82a2-d019640861e4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:46.873852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 291/561] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:46.873852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592217d-2344-41c6-82a2-d019640861e4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:46.894876 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe772f0-fb3d-4a41-8c97-98109de2c47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:46.895554 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe772f0-fb3d-4a41-8c97-98109de2c47f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:46.895837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe772f0-fb3d-4a41-8c97-98109de2c47f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:46.896110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe772f0-fb3d-4a41-8c97-98109de2c47f None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:46.896950 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe772f0-fb3d-4a41-8c97-98109de2c47f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:46.897259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe772f0-fb3d-4a41-8c97-98109de2c47f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:46.898729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe772f0-fb3d-4a41-8c97-98109de2c47f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:46.901143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:46.921640 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 271/562] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 20 22:27:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:46.923355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86877c7-acb4-400e-b0ee-f6b9e417a534 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:46.926967 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86877c7-acb4-400e-b0ee-f6b9e417a534 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:46.926967 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86877c7-acb4-400e-b0ee-f6b9e417a534 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:46.926967 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 272/563] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:46.926967 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86877c7-acb4-400e-b0ee-f6b9e417a534 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:46.950648 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:46.978814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592217d-2344-41c6-82a2-d019640861e4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:47.015838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3349a-7d1d-4fdf-aaaa-fa80c7d05e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:47.016778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3349a-7d1d-4fdf-aaaa-fa80c7d05e15 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:47.017061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3349a-7d1d-4fdf-aaaa-fa80c7d05e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:47.017334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3349a-7d1d-4fdf-aaaa-fa80c7d05e15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:47.029539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3349a-7d1d-4fdf-aaaa-fa80c7d05e15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:47.031092 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3349a-7d1d-4fdf-aaaa-fa80c7d05e15 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-7bb3349a-7d1d-4fdf-aaaa-fa80c7d05e15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:47.049986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:47.050924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:47.051866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:47.051866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:47.051866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:47.051866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:47.051866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 292/564] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:47.052167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3349a-7d1d-4fdf-aaaa-fa80c7d05e15 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:47.059210 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86877c7-acb4-400e-b0ee-f6b9e417a534 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:47.101633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeeea5-014f-46b9-8bb5-0516fd9895a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:47.102562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeeea5-014f-46b9-8bb5-0516fd9895a9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:47.102841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeeea5-014f-46b9-8bb5-0516fd9895a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:47.103380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeeea5-014f-46b9-8bb5-0516fd9895a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:47.115054 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeeea5-014f-46b9-8bb5-0516fd9895a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:47.116641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aeeea5-014f-46b9-8bb5-0516fd9895a9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:47.135920 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-f5aeeea5-014f-46b9-8bb5-0516fd9895a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:47.136829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:47.137712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:47.139247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:47.139247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:47.139247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:47.139247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:47.139247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 273/565] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:47.141139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c73866-4e92-4b9c-887c-32c8d03a54ef None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:47.141424 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c73866-4e92-4b9c-887c-32c8d03a54ef None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:47.141699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c73866-4e92-4b9c-887c-32c8d03a54ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:47.158989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-72c73866-4e92-4b9c-887c-32c8d03a54ef None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:47.160174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-72c73866-4e92-4b9c-887c-32c8d03a54ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:47.161324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3349a-7d1d-4fdf-aaaa-fa80c7d05e15 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:47.199309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23935d84-6454-4735-aa82-1fb6983b0e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:47.199981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23935d84-6454-4735-aa82-1fb6983b0e1c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:47.200265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23935d84-6454-4735-aa82-1fb6983b0e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:47.200540 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23935d84-6454-4735-aa82-1fb6983b0e1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:47.212382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23935d84-6454-4735-aa82-1fb6983b0e1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:47.214050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23935d84-6454-4735-aa82-1fb6983b0e1c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:47.225544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:47.241751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 274/566] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:47.241751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c73866-4e92-4b9c-887c-32c8d03a54ef None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-23935d84-6454-4735-aa82-1fb6983b0e1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:47.242030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:47.243058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:47.244172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:47.244172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:47.244172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:47.244172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:47.244172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 293/567] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:47.244172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23935d84-6454-4735-aa82-1fb6983b0e1c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:47.351414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c73866-4e92-4b9c-887c-32c8d03a54ef None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:47.353970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23935d84-6454-4735-aa82-1fb6983b0e1c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:47.384281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:47.386408 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569ff3c-dca8-46fd-ad0a-e4f1b7ff1b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:47.387073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569ff3c-dca8-46fd-ad0a-e4f1b7ff1b44 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:47.387350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569ff3c-dca8-46fd-ad0a-e4f1b7ff1b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:47.387621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c569ff3c-dca8-46fd-ad0a-e4f1b7ff1b44 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:47.388387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569ff3c-dca8-46fd-ad0a-e4f1b7ff1b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:47.389173 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569ff3c-dca8-46fd-ad0a-e4f1b7ff1b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:47.389997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75d54-f51d-4e49-be18-2f4f96cf720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:47.390668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75d54-f51d-4e49-be18-2f4f96cf720c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:47.390952 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75d54-f51d-4e49-be18-2f4f96cf720c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:47.396562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c569ff3c-dca8-46fd-ad0a-e4f1b7ff1b44 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:47.396671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75d54-f51d-4e49-be18-2f4f96cf720c None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:47.396671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b75d54-f51d-4e49-be18-2f4f96cf720c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:47.396671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b75d54-f51d-4e49-be18-2f4f96cf720c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:47.396671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b75d54-f51d-4e49-be18-2f4f96cf720c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:47.402233 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 275/568] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:47.403024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569ff3c-dca8-46fd-ad0a-e4f1b7ff1b44 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:47.408098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 294/569] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:47.408098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75d54-f51d-4e49-be18-2f4f96cf720c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:47.464844 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:47.507507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c569ff3c-dca8-46fd-ad0a-e4f1b7ff1b44 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:47.507933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75d54-f51d-4e49-be18-2f4f96cf720c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:47.541549 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c93663-89e8-4c1a-90d4-2007d7326575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:47.541778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9037d20-e425-4ef1-986b-421d3d1cf6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:47.542243 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c93663-89e8-4c1a-90d4-2007d7326575 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:47.542389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9037d20-e425-4ef1-986b-421d3d1cf6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:47.542526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c93663-89e8-4c1a-90d4-2007d7326575 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:47.542676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9037d20-e425-4ef1-986b-421d3d1cf6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:47.542805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c93663-89e8-4c1a-90d4-2007d7326575 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:47.542957 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9037d20-e425-4ef1-986b-421d3d1cf6f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:47.543530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c93663-89e8-4c1a-90d4-2007d7326575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:47.543840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c93663-89e8-4c1a-90d4-2007d7326575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:47.545454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c93663-89e8-4c1a-90d4-2007d7326575 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:47.553512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9037d20-e425-4ef1-986b-421d3d1cf6f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:47.556992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 276/570] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:47.558273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba9f11-8bdb-4e5b-bb8f-1f97d50d960e None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:47.558562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba9f11-8bdb-4e5b-bb8f-1f97d50d960e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:47.558838 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba9f11-8bdb-4e5b-bb8f-1f97d50d960e None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:47.561769 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 277/571] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:47.561769 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba9f11-8bdb-4e5b-bb8f-1f97d50d960e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b9037d20-e425-4ef1-986b-421d3d1cf6f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:47.562004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:47.562883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:47.563752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:47.563752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:47.563752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:47.563752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:47.563752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:47.563752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:47.563752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:47.563752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:47.563752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:47.563752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:47.563752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:47.563752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:47.563752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 295/572] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:47.564744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9037d20-e425-4ef1-986b-421d3d1cf6f2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:47.622785 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:47.668330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba9f11-8bdb-4e5b-bb8f-1f97d50d960e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:47.670263 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9037d20-e425-4ef1-986b-421d3d1cf6f2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:47.686305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:47.703694 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00c7ba-8fb4-4a88-b02e-514c504b0155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:47.704483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00c7ba-8fb4-4a88-b02e-514c504b0155 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:47.704763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00c7ba-8fb4-4a88-b02e-514c504b0155 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:47.704883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c0127-af8f-42fe-8904-a88a6efde992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:47.705036 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a00c7ba-8fb4-4a88-b02e-514c504b0155 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:47.705649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0127-af8f-42fe-8904-a88a6efde992 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:47.705974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0127-af8f-42fe-8904-a88a6efde992 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:47.706254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c0127-af8f-42fe-8904-a88a6efde992 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:47.711889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00c7ba-8fb4-4a88-b02e-514c504b0155 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:47.713566 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a00c7ba-8fb4-4a88-b02e-514c504b0155 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:47.714712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c0127-af8f-42fe-8904-a88a6efde992 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:47.716153 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c0127-af8f-42fe-8904-a88a6efde992 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-5a00c7ba-8fb4-4a88-b02e-514c504b0155 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:47.728388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:47.729442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:47.730565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:47.730565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:47.730565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:47.730565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:47.730565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:47.730565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:47.730565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:47.730565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:47.730565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 278/573] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:47.730565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00c7ba-8fb4-4a88-b02e-514c504b0155 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-853c0127-af8f-42fe-8904-a88a6efde992 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:47.731149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:47.732041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:47.733145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:47.733145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:47.733145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:47.733145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:47.733145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:47.733145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:47.733145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:47.733145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:47.733145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 22:27:47.733145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:47.733145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 296/574] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:47.734348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789ef25-d9c4-4345-a4fe-11d7f6f1c8ea None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:47.734348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789ef25-d9c4-4345-a4fe-11d7f6f1c8ea None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:47.734348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a789ef25-d9c4-4345-a4fe-11d7f6f1c8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:47.750280 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a789ef25-d9c4-4345-a4fe-11d7f6f1c8ea None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:47.751478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a789ef25-d9c4-4345-a4fe-11d7f6f1c8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:47.820101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 297/575] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:47.820958 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789ef25-d9c4-4345-a4fe-11d7f6f1c8ea None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:47.840602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a00c7ba-8fb4-4a88-b02e-514c504b0155 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:47.863999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:47.894103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800c7c0-503a-43aa-b738-a6b4055a731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:47.894103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800c7c0-503a-43aa-b738-a6b4055a731a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:47.894103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800c7c0-503a-43aa-b738-a6b4055a731a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:47.894103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800c7c0-503a-43aa-b738-a6b4055a731a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:47.894596 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800c7c0-503a-43aa-b738-a6b4055a731a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:47.894596 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800c7c0-503a-43aa-b738-a6b4055a731a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-6800c7c0-503a-43aa-b738-a6b4055a731a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:47.900699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:47.901659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:47.902632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:47.902632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:47.902632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:47.902632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:47.902632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:47.902632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:47.902632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:47.902632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:47.902632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 279/576] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:47.903180 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800c7c0-503a-43aa-b738-a6b4055a731a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:47.922656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a789ef25-d9c4-4345-a4fe-11d7f6f1c8ea None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:47.942772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:47.958838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b43d30-c465-4101-a59c-2655c120a45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:47.959518 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b43d30-c465-4101-a59c-2655c120a45e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:47.959800 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b43d30-c465-4101-a59c-2655c120a45e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:47.960104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b43d30-c465-4101-a59c-2655c120a45e None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:47.960855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b43d30-c465-4101-a59c-2655c120a45e None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:47.961167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b43d30-c465-4101-a59c-2655c120a45e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:47.962598 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b43d30-c465-4101-a59c-2655c120a45e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:47.971098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 298/577] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:47.971977 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b43d30-c465-4101-a59c-2655c120a45e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:48.003806 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800c7c0-503a-43aa-b738-a6b4055a731a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:48.038696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0af47-44d4-4ddb-9f29-9b9eff060df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:48.039357 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0af47-44d4-4ddb-9f29-9b9eff060df3 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:48.039641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0af47-44d4-4ddb-9f29-9b9eff060df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:48.039916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f0af47-44d4-4ddb-9f29-9b9eff060df3 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:48.040698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0af47-44d4-4ddb-9f29-9b9eff060df3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:48.041012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0af47-44d4-4ddb-9f29-9b9eff060df3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:48.042483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f0af47-44d4-4ddb-9f29-9b9eff060df3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:48.060128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 280/578] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:48.061702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0af47-44d4-4ddb-9f29-9b9eff060df3 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:48.073385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b43d30-c465-4101-a59c-2655c120a45e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:48.075682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:48.108252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f73e5f-2804-47c9-aedf-2f0c0b85fda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:48.108932 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73e5f-2804-47c9-aedf-2f0c0b85fda1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:48.109214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73e5f-2804-47c9-aedf-2f0c0b85fda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:48.109489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f73e5f-2804-47c9-aedf-2f0c0b85fda1 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:48.110359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f73e5f-2804-47c9-aedf-2f0c0b85fda1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:48.110667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f73e5f-2804-47c9-aedf-2f0c0b85fda1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:48.112083 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f73e5f-2804-47c9-aedf-2f0c0b85fda1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:48.134191 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 299/579] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Jul 20 22:27:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:48.134191 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f73e5f-2804-47c9-aedf-2f0c0b85fda1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:48.163060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:48.166990 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f0af47-44d4-4ddb-9f29-9b9eff060df3 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:48.201434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a89191-8493-40d7-a232-c940129a0cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:48.202221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89191-8493-40d7-a232-c940129a0cef None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:48.202502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89191-8493-40d7-a232-c940129a0cef None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:48.202780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89191-8493-40d7-a232-c940129a0cef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:48.212748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a89191-8493-40d7-a232-c940129a0cef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-f0a89191-8493-40d7-a232-c940129a0cef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:48.220536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:48.221677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:48.227452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:48.227452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:48.227452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:48.227452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:48.227452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:48.227452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:48.227452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:48.227452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:48.227452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:48.227452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:48.227452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:48.227452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:48.227452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 281/580] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:48.227452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a89191-8493-40d7-a232-c940129a0cef None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:48.241359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f73e5f-2804-47c9-aedf-2f0c0b85fda1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:48.276161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef158c-4b72-4889-a609-358fe130cac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:48.276847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef158c-4b72-4889-a609-358fe130cac2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:48.277134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef158c-4b72-4889-a609-358fe130cac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:48.277414 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ef158c-4b72-4889-a609-358fe130cac2 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:48.278239 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef158c-4b72-4889-a609-358fe130cac2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:48.278553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef158c-4b72-4889-a609-358fe130cac2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:48.280001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ef158c-4b72-4889-a609-358fe130cac2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:48.291703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 300/581] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:48.292513 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef158c-4b72-4889-a609-358fe130cac2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:48.319451 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:48.324456 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a89191-8493-40d7-a232-c940129a0cef None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:48.360326 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07361385-fe19-405c-94b9-fd0a4f40be54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:48.361126 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07361385-fe19-405c-94b9-fd0a4f40be54 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:48.361409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07361385-fe19-405c-94b9-fd0a4f40be54 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:48.361685 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07361385-fe19-405c-94b9-fd0a4f40be54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:48.373646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07361385-fe19-405c-94b9-fd0a4f40be54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:48.375727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07361385-fe19-405c-94b9-fd0a4f40be54 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-07361385-fe19-405c-94b9-fd0a4f40be54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:48.392878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:48.393984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:48.395009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:48.395009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:48.395009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:48.395009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:48.395009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 282/582] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:48.395009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07361385-fe19-405c-94b9-fd0a4f40be54 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:48.395382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ef158c-4b72-4889-a609-358fe130cac2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:48.410100 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:48.428536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd24e77-8fb9-43a4-ad40-9d58c656a62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:48.429195 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd24e77-8fb9-43a4-ad40-9d58c656a62f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:48.429477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd24e77-8fb9-43a4-ad40-9d58c656a62f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:48.429773 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd24e77-8fb9-43a4-ad40-9d58c656a62f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:48.430697 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd24e77-8fb9-43a4-ad40-9d58c656a62f None admin] RBAC: Adding query filter params (role.id=2a5f2a34d0b341e58b642fc48dc7c5da, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=146610a7cbbc46928a4a8d710c4d1942) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:48.431042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd24e77-8fb9-43a4-ad40-9d58c656a62f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:48.432363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd24e77-8fb9-43a4-ad40-9d58c656a62f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:48.454054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 301/583] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:48 2022] GET /identity/v3/role_assignments?user.id=146610a7cbbc46928a4a8d710c4d1942&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=2a5f2a34d0b341e58b642fc48dc7c5da => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:48.454054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd24e77-8fb9-43a4-ad40-9d58c656a62f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:48.509816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07361385-fe19-405c-94b9-fd0a4f40be54 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:48.535907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:48.550904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3f36b-c070-4209-ab9f-1ba920dfb82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:48.551819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3f36b-c070-4209-ab9f-1ba920dfb82f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:48.552169 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3f36b-c070-4209-ab9f-1ba920dfb82f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:48.552513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3f36b-c070-4209-ab9f-1ba920dfb82f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:48.552881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd24e77-8fb9-43a4-ad40-9d58c656a62f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:48.565891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3f36b-c070-4209-ab9f-1ba920dfb82f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:48.567830 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b3f36b-c070-4209-ab9f-1ba920dfb82f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-17b3f36b-c070-4209-ab9f-1ba920dfb82f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:48.587312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:48.588476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:48.589608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:48.589608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:48.589608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:48.589608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:48.594106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 283/584] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:48.594371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aecfb-9cb2-4756-a5fd-637b19b67f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:48.594976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3f36b-c070-4209-ab9f-1ba920dfb82f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:48.595264 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aecfb-9cb2-4756-a5fd-637b19b67f39 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:48.595623 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aecfb-9cb2-4756-a5fd-637b19b67f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:48.595969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681aecfb-9cb2-4756-a5fd-637b19b67f39 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:48.596729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aecfb-9cb2-4756-a5fd-637b19b67f39 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:48.597038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aecfb-9cb2-4756-a5fd-637b19b67f39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:48.598433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681aecfb-9cb2-4756-a5fd-637b19b67f39 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:48.609653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 302/585] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:48.611129 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aecfb-9cb2-4756-a5fd-637b19b67f39 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:48.686973 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:48.725660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681aecfb-9cb2-4756-a5fd-637b19b67f39 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:48.747190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3f36b-c070-4209-ab9f-1ba920dfb82f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:48.761010 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42eefd-0aed-4834-b573-aad87df33e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:48.761578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b99922-9f3a-4e84-be30-68807447c9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:48.761801 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42eefd-0aed-4834-b573-aad87df33e33 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:48.761991 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42eefd-0aed-4834-b573-aad87df33e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:48.762268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad42eefd-0aed-4834-b573-aad87df33e33 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:48.762764 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b99922-9f3a-4e84-be30-68807447c9e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:48.762997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42eefd-0aed-4834-b573-aad87df33e33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:48.763163 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b99922-9f3a-4e84-be30-68807447c9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:48.763287 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42eefd-0aed-4834-b573-aad87df33e33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:48.763546 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b99922-9f3a-4e84-be30-68807447c9e6 None admin] PATH_INFO: `/v3/projects/8cec07c864274d649ecd1944be870bd5/users/67c92c8d2b9d41e489e4c03ae4e71fe2/roles/2a5f2a34d0b341e58b642fc48dc7c5da` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:48.764771 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad42eefd-0aed-4834-b573-aad87df33e33 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:48.777864 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 303/586] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:48.778900 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42eefd-0aed-4834-b573-aad87df33e33 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:48.783819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b99922-9f3a-4e84-be30-68807447c9e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cec07c864274d649ecd1944be870bd5, user_id=67c92c8d2b9d41e489e4c03ae4e71fe2, role_id=2a5f2a34d0b341e58b642fc48dc7c5da)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:48.785748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b99922-9f3a-4e84-be30-68807447c9e6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:48.793095 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:48.878724 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad42eefd-0aed-4834-b573-aad87df33e33 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:48.912958 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079bdf4-f67b-4ad0-b805-a01b26821a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:48.913619 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079bdf4-f67b-4ad0-b805-a01b26821a69 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:48.913927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079bdf4-f67b-4ad0-b805-a01b26821a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:48.914201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079bdf4-f67b-4ad0-b805-a01b26821a69 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:48.914927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079bdf4-f67b-4ad0-b805-a01b26821a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:48.915233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079bdf4-f67b-4ad0-b805-a01b26821a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:48.916595 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079bdf4-f67b-4ad0-b805-a01b26821a69 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:48.933074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 304/588] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:48.933074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079bdf4-f67b-4ad0-b805-a01b26821a69 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:48.933353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 284/588] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:27:48 2022] PUT /identity/v3/projects/8cec07c864274d649ecd1944be870bd5/users/67c92c8d2b9d41e489e4c03ae4e71fe2/roles/2a5f2a34d0b341e58b642fc48dc7c5da => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:27:48.938580 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b99922-9f3a-4e84-be30-68807447c9e6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:49.015224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:49.054917 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079bdf4-f67b-4ad0-b805-a01b26821a69 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:49.059322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b99922-9f3a-4e84-be30-68807447c9e6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:49.082253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:49.105359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902be13-6885-486a-a7f1-4ce47ee6f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:49.106208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902be13-6885-486a-a7f1-4ce47ee6f7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:49.106483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902be13-6885-486a-a7f1-4ce47ee6f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:49.107036 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902be13-6885-486a-a7f1-4ce47ee6f7b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:49.110535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141357c-9154-4f24-87b2-b7fd0771ca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:49.111893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141357c-9154-4f24-87b2-b7fd0771ca31 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:49.112178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141357c-9154-4f24-87b2-b7fd0771ca31 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:49.112455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f141357c-9154-4f24-87b2-b7fd0771ca31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:49.115434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902be13-6885-486a-a7f1-4ce47ee6f7b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:49.116891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902be13-6885-486a-a7f1-4ce47ee6f7b4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:49.127665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141357c-9154-4f24-87b2-b7fd0771ca31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:49.129584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f141357c-9154-4f24-87b2-b7fd0771ca31 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e902be13-6885-486a-a7f1-4ce47ee6f7b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:49.134993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:49.135954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:49.136921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:49.136921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:49.136921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:49.136921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:49.136921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:49.136921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:49.136921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:49.136921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:49.136921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 22:27:49.136921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:49.136921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 285/589] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:49.137531 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902be13-6885-486a-a7f1-4ce47ee6f7b4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f141357c-9154-4f24-87b2-b7fd0771ca31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:49.156002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:49.157055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:49.158077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:49.158077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:49.158077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:49.158077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:49.158077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 305/590] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:49.158974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141357c-9154-4f24-87b2-b7fd0771ca31 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:49.242999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902be13-6885-486a-a7f1-4ce47ee6f7b4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:49.263726 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f141357c-9154-4f24-87b2-b7fd0771ca31 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:49.279985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448df72-2335-498f-9b84-6bcd0d05a25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:49.280794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448df72-2335-498f-9b84-6bcd0d05a25e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:49.281073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448df72-2335-498f-9b84-6bcd0d05a25e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:49.281452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448df72-2335-498f-9b84-6bcd0d05a25e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:49.285084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:49.290010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448df72-2335-498f-9b84-6bcd0d05a25e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:49.291635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448df72-2335-498f-9b84-6bcd0d05a25e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:49.300612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ff4a0-f09b-4d11-9c43-871ba97a149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:49.301581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ff4a0-f09b-4d11-9c43-871ba97a149a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:49.301899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ff4a0-f09b-4d11-9c43-871ba97a149a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:49.302176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ff4a0-f09b-4d11-9c43-871ba97a149a None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:49.303407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ff4a0-f09b-4d11-9c43-871ba97a149a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:49.303734 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ff4a0-f09b-4d11-9c43-871ba97a149a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:49.305261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ff4a0-f09b-4d11-9c43-871ba97a149a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-3448df72-2335-498f-9b84-6bcd0d05a25e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:49.308014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:49.309152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:49.310291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:49.310291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:49.310291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:49.310291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:49.310291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:49.310291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:49.310291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:49.310291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:49.312319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 286/591] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:49.313313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448df72-2335-498f-9b84-6bcd0d05a25e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:49.333945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 306/592] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Jul 20 22:27:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:49.334857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ff4a0-f09b-4d11-9c43-871ba97a149a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:49.350092 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:49.445999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448df72-2335-498f-9b84-6bcd0d05a25e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:49.447805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ff4a0-f09b-4d11-9c43-871ba97a149a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:49.486689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485fcff-736d-4670-b039-f34fcefdb696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:49.487621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485fcff-736d-4670-b039-f34fcefdb696 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:49.487974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485fcff-736d-4670-b039-f34fcefdb696 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:49.488340 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c485fcff-736d-4670-b039-f34fcefdb696 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:49.489242 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485fcff-736d-4670-b039-f34fcefdb696 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:49.489619 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485fcff-736d-4670-b039-f34fcefdb696 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:49.491323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c485fcff-736d-4670-b039-f34fcefdb696 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:49.491922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d3a96-671a-4efa-b224-a7ea9b39ddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:49.492782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3a96-671a-4efa-b224-a7ea9b39ddde None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:49.493335 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3a96-671a-4efa-b224-a7ea9b39ddde None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:49.494121 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3a96-671a-4efa-b224-a7ea9b39ddde None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:49.495519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d3a96-671a-4efa-b224-a7ea9b39ddde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:49.495986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d3a96-671a-4efa-b224-a7ea9b39ddde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:49.497506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d3a96-671a-4efa-b224-a7ea9b39ddde None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:49.506840 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 307/593] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:49.507854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485fcff-736d-4670-b039-f34fcefdb696 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:49.514547 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 287/594] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:49.515673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d3a96-671a-4efa-b224-a7ea9b39ddde None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:49.562650 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:49.631008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c485fcff-736d-4670-b039-f34fcefdb696 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:49.679254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:49.689989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d3a96-671a-4efa-b224-a7ea9b39ddde None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:49.695112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cca54b-1d79-4311-a8fc-1bc4ae12de74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:49.695981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cca54b-1d79-4311-a8fc-1bc4ae12de74 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:49.696266 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cca54b-1d79-4311-a8fc-1bc4ae12de74 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:49.696542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cca54b-1d79-4311-a8fc-1bc4ae12de74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:49.709528 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cca54b-1d79-4311-a8fc-1bc4ae12de74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:49.711361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cca54b-1d79-4311-a8fc-1bc4ae12de74 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a0cca54b-1d79-4311-a8fc-1bc4ae12de74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:49.732362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:49.733410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:49.734369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:49.734369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:49.734369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:49.734369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:49.735028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5d20b-3d75-4138-9813-de1f20529904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:49.735858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5d20b-3d75-4138-9813-de1f20529904 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:49.736141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5d20b-3d75-4138-9813-de1f20529904 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:49.736414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5d20b-3d75-4138-9813-de1f20529904 None admin] PATH_INFO: `/v3/projects/8cec07c864274d649ecd1944be870bd5/users/669a11ce83b746eeb7f4e7d0acca4b6f/roles/2a5f2a34d0b341e58b642fc48dc7c5da` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:49.737194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 308/595] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:49.738209 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cca54b-1d79-4311-a8fc-1bc4ae12de74 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:49.755278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5d20b-3d75-4138-9813-de1f20529904 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cec07c864274d649ecd1944be870bd5, user_id=669a11ce83b746eeb7f4e7d0acca4b6f, role_id=2a5f2a34d0b341e58b642fc48dc7c5da)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:49.757409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5d20b-3d75-4138-9813-de1f20529904 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:49.835983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:49.849980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cca54b-1d79-4311-a8fc-1bc4ae12de74 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:49.850308 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 288/596] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:27:49 2022] PUT /identity/v3/projects/8cec07c864274d649ecd1944be870bd5/users/669a11ce83b746eeb7f4e7d0acca4b6f/roles/2a5f2a34d0b341e58b642fc48dc7c5da => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:27:49.852423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5d20b-3d75-4138-9813-de1f20529904 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:49.915129 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2ef56-fa30-49b0-8cec-d54589ebd64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:49.916014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2ef56-fa30-49b0-8cec-d54589ebd64c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:49.916304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2ef56-fa30-49b0-8cec-d54589ebd64c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:49.916581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2ef56-fa30-49b0-8cec-d54589ebd64c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:49.932501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2ef56-fa30-49b0-8cec-d54589ebd64c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:49.934008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2ef56-fa30-49b0-8cec-d54589ebd64c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-bca2ef56-fa30-49b0-8cec-d54589ebd64c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:49.960159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:49.961200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:49.962184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:49.962184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:49.962184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:49.962184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:49.962184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:49.962184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:49.962184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:49.962184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:49.962184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 22:27:49.962184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:49.969911 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 309/597] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:49.970892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2ef56-fa30-49b0-8cec-d54589ebd64c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:50.051477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5d20b-3d75-4138-9813-de1f20529904 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:50.096660 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e024e9e-a59c-47db-87cd-d81dbeca7279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:50.098177 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e024e9e-a59c-47db-87cd-d81dbeca7279 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:50.098685 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e024e9e-a59c-47db-87cd-d81dbeca7279 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:50.099161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e024e9e-a59c-47db-87cd-d81dbeca7279 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:50.100140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e024e9e-a59c-47db-87cd-d81dbeca7279 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:50.100651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e024e9e-a59c-47db-87cd-d81dbeca7279 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:50.102417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e024e9e-a59c-47db-87cd-d81dbeca7279 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:50.117334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 289/598] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:50.126787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e024e9e-a59c-47db-87cd-d81dbeca7279 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:50.129755 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2ef56-fa30-49b0-8cec-d54589ebd64c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:50.132349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:50.169710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583d650-e1cb-4387-bcf1-724257a2256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:50.171582 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583d650-e1cb-4387-bcf1-724257a2256e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:50.172271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583d650-e1cb-4387-bcf1-724257a2256e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:50.172702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583d650-e1cb-4387-bcf1-724257a2256e None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:50.174024 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583d650-e1cb-4387-bcf1-724257a2256e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:50.174555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583d650-e1cb-4387-bcf1-724257a2256e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:50.176723 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583d650-e1cb-4387-bcf1-724257a2256e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:50.206919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 310/599] 10.222.0.83 () {56 vars in 1139 bytes} [Wed Jul 20 22:27:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:50.212583 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583d650-e1cb-4387-bcf1-724257a2256e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:50.238102 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:50.332746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e024e9e-a59c-47db-87cd-d81dbeca7279 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:50.376419 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329aeec-8299-4313-978d-559dbafe8f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:50.377236 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329aeec-8299-4313-978d-559dbafe8f93 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:50.377521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329aeec-8299-4313-978d-559dbafe8f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:50.377820 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329aeec-8299-4313-978d-559dbafe8f93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:50.391769 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329aeec-8299-4313-978d-559dbafe8f93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:50.393243 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329aeec-8299-4313-978d-559dbafe8f93 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:50.402965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583d650-e1cb-4387-bcf1-724257a2256e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-2329aeec-8299-4313-978d-559dbafe8f93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:50.424506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:50.425595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:50.426765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:50.426765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:50.426765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:50.426765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:50.426765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:50.426765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:50.426765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:50.426765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:50.426765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 290/600] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:50.433274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329aeec-8299-4313-978d-559dbafe8f93 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:50.478742 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8019c6-9820-4042-9a11-430e3941fcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:50.479792 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8019c6-9820-4042-9a11-430e3941fcaf None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:50.480254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8019c6-9820-4042-9a11-430e3941fcaf None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:50.481316 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8019c6-9820-4042-9a11-430e3941fcaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:50.505927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8019c6-9820-4042-9a11-430e3941fcaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:50.509173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8019c6-9820-4042-9a11-430e3941fcaf None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-0c8019c6-9820-4042-9a11-430e3941fcaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:50.537173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:50.538470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:50.539601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:50.539601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:50.539601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:50.539601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:50.548060 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 311/601] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:50.550424 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:50.553895 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8019c6-9820-4042-9a11-430e3941fcaf None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:50.608673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329aeec-8299-4313-978d-559dbafe8f93 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:50.647977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6c1aa-4e38-4673-bccd-3a1e0487acf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:50.648678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6c1aa-4e38-4673-bccd-3a1e0487acf9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:50.648963 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6c1aa-4e38-4673-bccd-3a1e0487acf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:50.649403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6c1aa-4e38-4673-bccd-3a1e0487acf9 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:50.651068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6c1aa-4e38-4673-bccd-3a1e0487acf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:50.651390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6c1aa-4e38-4673-bccd-3a1e0487acf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:50.652838 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6c1aa-4e38-4673-bccd-3a1e0487acf9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:50.669151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 291/602] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:50.671509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f809e8-8f26-4a41-9840-f79443088cb8 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:50.671799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f809e8-8f26-4a41-9840-f79443088cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:50.672239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f809e8-8f26-4a41-9840-f79443088cb8 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:50.674504 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 292/603] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:50.675343 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f809e8-8f26-4a41-9840-f79443088cb8 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:50.678953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:50.737079 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8019c6-9820-4042-9a11-430e3941fcaf None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:50.781473 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c51f19-3441-4835-a20c-654f50fa2852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:50.782183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51f19-3441-4835-a20c-654f50fa2852 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:50.782471 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51f19-3441-4835-a20c-654f50fa2852 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:50.782825 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c51f19-3441-4835-a20c-654f50fa2852 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:50.783487 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c51f19-3441-4835-a20c-654f50fa2852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:50.784144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c51f19-3441-4835-a20c-654f50fa2852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:50.785407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c51f19-3441-4835-a20c-654f50fa2852 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:50.791124 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f809e8-8f26-4a41-9840-f79443088cb8 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:50.798636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 312/604] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:50.800332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cadaf9-df79-4a42-8077-7933ffe4c7cb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:50.800332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cadaf9-df79-4a42-8077-7933ffe4c7cb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:50.800568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cadaf9-df79-4a42-8077-7933ffe4c7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:50.817863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f0cadaf9-df79-4a42-8077-7933ffe4c7cb None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:50.818227 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:50.819116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f0cadaf9-df79-4a42-8077-7933ffe4c7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:50.831121 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d167279-59a9-48e8-92f4-860595645412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:50.838067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d167279-59a9-48e8-92f4-860595645412 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:50.838067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d167279-59a9-48e8-92f4-860595645412 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:50.838067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d167279-59a9-48e8-92f4-860595645412 None admin] PATH_INFO: `/v3/projects/8cec07c864274d649ecd1944be870bd5/users/12ab5b94b21b466e8070771a61378e89/roles/2a5f2a34d0b341e58b642fc48dc7c5da` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:50.849787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d167279-59a9-48e8-92f4-860595645412 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cec07c864274d649ecd1944be870bd5, user_id=12ab5b94b21b466e8070771a61378e89, role_id=2a5f2a34d0b341e58b642fc48dc7c5da)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:50.851519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d167279-59a9-48e8-92f4-860595645412 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:50.897859 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 313/605] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:50.897859 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cadaf9-df79-4a42-8077-7933ffe4c7cb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:50.954180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:50.979307 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 293/606] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:27:50 2022] PUT /identity/v3/projects/8cec07c864274d649ecd1944be870bd5/users/12ab5b94b21b466e8070771a61378e89/roles/2a5f2a34d0b341e58b642fc48dc7c5da => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:27:50.980120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d167279-59a9-48e8-92f4-860595645412 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:51.014930 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cadaf9-df79-4a42-8077-7933ffe4c7cb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:51.084603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1745b-3c4d-4748-9ed3-93e0568f2870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:51.085488 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1745b-3c4d-4748-9ed3-93e0568f2870 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:51.085798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1745b-3c4d-4748-9ed3-93e0568f2870 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:51.086078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1745b-3c4d-4748-9ed3-93e0568f2870 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:51.104078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1745b-3c4d-4748-9ed3-93e0568f2870 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:51.105556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1745b-3c4d-4748-9ed3-93e0568f2870 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:51.123046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d167279-59a9-48e8-92f4-860595645412 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-bca1745b-3c4d-4748-9ed3-93e0568f2870 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:51.137956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:51.139931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:51.140916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:51.140916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:51.140916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:51.140916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:51.140916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:51.140916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:51.140916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:51.140916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:51.140916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 314/607] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:51.146153 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1745b-3c4d-4748-9ed3-93e0568f2870 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:51.175052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3a6d3-d0eb-4369-8592-a2edfb1f1bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:51.176377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3a6d3-d0eb-4369-8592-a2edfb1f1bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:51.176897 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3a6d3-d0eb-4369-8592-a2edfb1f1bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:51.177641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3a6d3-d0eb-4369-8592-a2edfb1f1bc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:51.193978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca3a6d3-d0eb-4369-8592-a2edfb1f1bc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-aca3a6d3-d0eb-4369-8592-a2edfb1f1bc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:51.204521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:51.205588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:51.206502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:51.206502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:51.206502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:51.206502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:51.206502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:51.206502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:51.206502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:51.206502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:51.206502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:51.206502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:51.206502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:51.206502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:51.210838 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 294/608] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:51.218636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3a6d3-d0eb-4369-8592-a2edfb1f1bc1 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:51.275845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:51.333085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1745b-3c4d-4748-9ed3-93e0568f2870 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:51.348370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:51.359273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3a6d3-d0eb-4369-8592-a2edfb1f1bc1 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:51.380434 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d4e02-52d1-4a31-95de-b067f3231781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:51.381115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d4e02-52d1-4a31-95de-b067f3231781 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:51.381397 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d4e02-52d1-4a31-95de-b067f3231781 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:51.381676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d4e02-52d1-4a31-95de-b067f3231781 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:51.382500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d4e02-52d1-4a31-95de-b067f3231781 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:51.382814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d4e02-52d1-4a31-95de-b067f3231781 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:51.384263 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d4e02-52d1-4a31-95de-b067f3231781 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:51.398405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 315/609] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:51.399845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257fa0d-bee7-4ca1-b586-f43c8e5f02ee None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:51.400198 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257fa0d-bee7-4ca1-b586-f43c8e5f02ee None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:51.400487 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257fa0d-bee7-4ca1-b586-f43c8e5f02ee None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:51.401398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447fae5-4b3e-4cc1-9291-4ae878a2f6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:51.401994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 316/610] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:51.402121 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447fae5-4b3e-4cc1-9291-4ae878a2f6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:51.402401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447fae5-4b3e-4cc1-9291-4ae878a2f6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:51.402679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447fae5-4b3e-4cc1-9291-4ae878a2f6c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:51.403436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447fae5-4b3e-4cc1-9291-4ae878a2f6c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:51.403748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447fae5-4b3e-4cc1-9291-4ae878a2f6c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:51.405378 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447fae5-4b3e-4cc1-9291-4ae878a2f6c4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:51.407132 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257fa0d-bee7-4ca1-b586-f43c8e5f02ee None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:51.415485 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 295/611] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:51.420843 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf569c-c22a-491a-b2e1-d7b6f6e7ca69 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:51.421173 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf569c-c22a-491a-b2e1-d7b6f6e7ca69 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:51.421457 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf569c-c22a-491a-b2e1-d7b6f6e7ca69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:51.444689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-62cf569c-c22a-491a-b2e1-d7b6f6e7ca69 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:51.445836 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-62cf569c-c22a-491a-b2e1-d7b6f6e7ca69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:51.517911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 296/612] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:51.518791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf569c-c22a-491a-b2e1-d7b6f6e7ca69 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:51.532674 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257fa0d-bee7-4ca1-b586-f43c8e5f02ee None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:51.566316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:51.575708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc6e88-9e5a-4f49-8d83-b7745c35b916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:51.577012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc6e88-9e5a-4f49-8d83-b7745c35b916 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:51.577296 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc6e88-9e5a-4f49-8d83-b7745c35b916 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:51.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc6e88-9e5a-4f49-8d83-b7745c35b916 None admin] PATH_INFO: `/v3/projects/8cec07c864274d649ecd1944be870bd5/users/d3faac5703c54396bcdba9e149a6d35e/roles/2a5f2a34d0b341e58b642fc48dc7c5da` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:51.594074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc6e88-9e5a-4f49-8d83-b7745c35b916 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cec07c864274d649ecd1944be870bd5, user_id=d3faac5703c54396bcdba9e149a6d35e, role_id=2a5f2a34d0b341e58b642fc48dc7c5da)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:51.595594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc6e88-9e5a-4f49-8d83-b7745c35b916 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:51.645523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf569c-c22a-491a-b2e1-d7b6f6e7ca69 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:51.681248 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9236f5-7c75-4a87-8f03-1e6440ae6a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:51.682090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9236f5-7c75-4a87-8f03-1e6440ae6a38 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:51.682373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9236f5-7c75-4a87-8f03-1e6440ae6a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:51.682651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9236f5-7c75-4a87-8f03-1e6440ae6a38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:51.694085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9236f5-7c75-4a87-8f03-1e6440ae6a38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:51.695923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9236f5-7c75-4a87-8f03-1e6440ae6a38 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:51.699668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 317/613] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:27:51 2022] PUT /identity/v3/projects/8cec07c864274d649ecd1944be870bd5/users/d3faac5703c54396bcdba9e149a6d35e/roles/2a5f2a34d0b341e58b642fc48dc7c5da => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:27:51.700655 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc6e88-9e5a-4f49-8d83-b7745c35b916 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-0e9236f5-7c75-4a87-8f03-1e6440ae6a38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:51.719423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:51.726612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:51.727564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:51.727564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:51.727564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:51.727564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:51.727564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 297/614] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:51.731948 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9236f5-7c75-4a87-8f03-1e6440ae6a38 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:51.738986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:51.884837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:51.911181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc6e88-9e5a-4f49-8d83-b7745c35b916 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:51.915985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9236f5-7c75-4a87-8f03-1e6440ae6a38 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:51.958308 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c899408-ebb7-4d21-bda5-cc1e5dc00504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:51.959549 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899408-ebb7-4d21-bda5-cc1e5dc00504 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:51.960017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899408-ebb7-4d21-bda5-cc1e5dc00504 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:51.960245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23529b76-e95f-4153-973b-a6a99f978a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:51.960697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899408-ebb7-4d21-bda5-cc1e5dc00504 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:51.961184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23529b76-e95f-4153-973b-a6a99f978a4f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:51.961535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23529b76-e95f-4153-973b-a6a99f978a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:51.961903 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23529b76-e95f-4153-973b-a6a99f978a4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:51.962204 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c899408-ebb7-4d21-bda5-cc1e5dc00504 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:51.962903 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c899408-ebb7-4d21-bda5-cc1e5dc00504 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:51.964654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c899408-ebb7-4d21-bda5-cc1e5dc00504 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:51.974351 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23529b76-e95f-4153-973b-a6a99f978a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:51.982886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 298/615] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-23529b76-e95f-4153-973b-a6a99f978a4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:51.985784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:51.986779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:51.987714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:51.987714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:51.987714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:51.987714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:51.987714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:51.987714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:51.987714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:51.987714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:51.987714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:51.987714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:51.987714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:51.987714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:51.987714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 318/616] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:51.991407 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c899408-ebb7-4d21-bda5-cc1e5dc00504 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:51.993596 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23529b76-e95f-4153-973b-a6a99f978a4f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:52.087272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:52.107144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23529b76-e95f-4153-973b-a6a99f978a4f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:52.111801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c899408-ebb7-4d21-bda5-cc1e5dc00504 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:52.142741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e74e59f-2bbd-4c89-b4a3-1faa611e9a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:52.143551 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74e59f-2bbd-4c89-b4a3-1faa611e9a7c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:52.143834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74e59f-2bbd-4c89-b4a3-1faa611e9a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:52.144111 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e74e59f-2bbd-4c89-b4a3-1faa611e9a7c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:52.151754 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74e59f-2bbd-4c89-b4a3-1faa611e9a7c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:52.153456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e74e59f-2bbd-4c89-b4a3-1faa611e9a7c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:52.154971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49d4fe-b3d2-4caa-9903-87347e14ce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:52.156564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d4fe-b3d2-4caa-9903-87347e14ce5b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:52.157067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d4fe-b3d2-4caa-9903-87347e14ce5b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:52.157609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49d4fe-b3d2-4caa-9903-87347e14ce5b None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:52.158666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49d4fe-b3d2-4caa-9903-87347e14ce5b None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:52.159194 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49d4fe-b3d2-4caa-9903-87347e14ce5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:52.160874 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49d4fe-b3d2-4caa-9903-87347e14ce5b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:52.163774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-0e74e59f-2bbd-4c89-b4a3-1faa611e9a7c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:52.168780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:52.169882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:52.171106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:52.171106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:52.171106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:52.171106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:52.171106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:52.171106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:52.171106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:52.171106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:52.171106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 22:27:52.171106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:52.171106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 319/617] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:27:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:27:52.171950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d6213-1688-4061-a3ea-4011bf651baa None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:52.171950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d6213-1688-4061-a3ea-4011bf651baa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:52.173483 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d6213-1688-4061-a3ea-4011bf651baa None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:52.178129 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 320/618] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:52.181406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 299/619] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:52.181521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d6213-1688-4061-a3ea-4011bf651baa None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:52.183371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935124fd-b617-427f-8547-d9246f19dd02 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:52.184088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935124fd-b617-427f-8547-d9246f19dd02 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:52.184579 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935124fd-b617-427f-8547-d9246f19dd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:52.203752 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-935124fd-b617-427f-8547-d9246f19dd02 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:52.205456 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-935124fd-b617-427f-8547-d9246f19dd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:52.284838 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 300/620] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:27:52.286117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935124fd-b617-427f-8547-d9246f19dd02 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:52.291858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d6213-1688-4061-a3ea-4011bf651baa None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:52.331275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be804d-926e-4e12-bbbe-6df0d88cbad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:52.332405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be804d-926e-4e12-bbbe-6df0d88cbad0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:52.332932 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be804d-926e-4e12-bbbe-6df0d88cbad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:52.334129 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be804d-926e-4e12-bbbe-6df0d88cbad0 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:52.335039 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be804d-926e-4e12-bbbe-6df0d88cbad0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:52.335360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be804d-926e-4e12-bbbe-6df0d88cbad0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:52.336843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be804d-926e-4e12-bbbe-6df0d88cbad0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:52.349365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:52.357383 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 321/621] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Jul 20 22:27:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:52.362655 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be804d-926e-4e12-bbbe-6df0d88cbad0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:52.406009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935124fd-b617-427f-8547-d9246f19dd02 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:52.434666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:52.445023 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39890f77-13cf-4d96-9228-9bca2dece837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:52.445775 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39890f77-13cf-4d96-9228-9bca2dece837 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:52.446120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39890f77-13cf-4d96-9228-9bca2dece837 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:52.446617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39890f77-13cf-4d96-9228-9bca2dece837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:52.459497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39890f77-13cf-4d96-9228-9bca2dece837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:52.461098 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39890f77-13cf-4d96-9228-9bca2dece837 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:52.473204 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be804d-926e-4e12-bbbe-6df0d88cbad0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-39890f77-13cf-4d96-9228-9bca2dece837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:52.482160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:52.483370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:52.484520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:52.484520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:52.484520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:52.484520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:52.490617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 301/622] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:52.490617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39890f77-13cf-4d96-9228-9bca2dece837 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:52.526830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d225f4-1104-4ba5-ab53-062314f9fff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:52.528267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d225f4-1104-4ba5-ab53-062314f9fff2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:52.528797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d225f4-1104-4ba5-ab53-062314f9fff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:52.529373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d225f4-1104-4ba5-ab53-062314f9fff2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:52.542809 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d225f4-1104-4ba5-ab53-062314f9fff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-34d225f4-1104-4ba5-ab53-062314f9fff2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:52.552536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:52.553707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:52.554813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:52.554813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:52.554813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:52.554813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:52.554813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:52.554813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:52.554813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:52.554813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:52.554813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:52.554813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:52.554813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:52.554813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:52.557592 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 322/623] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:52.558598 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d225f4-1104-4ba5-ab53-062314f9fff2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:52.628371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39890f77-13cf-4d96-9228-9bca2dece837 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:52.642486 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:52.666445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fd153-76be-4de9-9293-51acbb3eb09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:52.667673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fd153-76be-4de9-9293-51acbb3eb09d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:52.667799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fd153-76be-4de9-9293-51acbb3eb09d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:52.668178 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fd153-76be-4de9-9293-51acbb3eb09d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:52.680003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fd153-76be-4de9-9293-51acbb3eb09d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:52.681607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fd153-76be-4de9-9293-51acbb3eb09d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:52.695140 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d225f4-1104-4ba5-ab53-062314f9fff2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-449fd153-76be-4de9-9293-51acbb3eb09d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:52.701652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:52.702840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:52.703964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:52.703964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:52.703964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:52.703964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:52.705334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 302/624] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:52.706271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fd153-76be-4de9-9293-51acbb3eb09d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:52.735944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786a67d-6b47-46b8-9aa2-fd70629eb316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:52.736863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786a67d-6b47-46b8-9aa2-fd70629eb316 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:52.737320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786a67d-6b47-46b8-9aa2-fd70629eb316 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:52.737784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786a67d-6b47-46b8-9aa2-fd70629eb316 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:52.738677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786a67d-6b47-46b8-9aa2-fd70629eb316 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:52.739132 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786a67d-6b47-46b8-9aa2-fd70629eb316 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:52.740635 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e786a67d-6b47-46b8-9aa2-fd70629eb316 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:52.741712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:52.759216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 323/625] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:52.760573 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786a67d-6b47-46b8-9aa2-fd70629eb316 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:52.817276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fd153-76be-4de9-9293-51acbb3eb09d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:52.853911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa5141-edf3-432a-9e42-bc4d8e43842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:52.854969 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa5141-edf3-432a-9e42-bc4d8e43842f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:52.855100 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa5141-edf3-432a-9e42-bc4d8e43842f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:52.855494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa5141-edf3-432a-9e42-bc4d8e43842f None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:52.856325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa5141-edf3-432a-9e42-bc4d8e43842f None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:52.856707 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa5141-edf3-432a-9e42-bc4d8e43842f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:52.858910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa5141-edf3-432a-9e42-bc4d8e43842f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:52.868288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 303/626] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:52.869219 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa5141-edf3-432a-9e42-bc4d8e43842f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:52.873852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786a67d-6b47-46b8-9aa2-fd70629eb316 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:52.892155 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:52.910724 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0c575-6832-4a3b-85bd-2d07cbce887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:52.911752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0c575-6832-4a3b-85bd-2d07cbce887c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:52.912221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0c575-6832-4a3b-85bd-2d07cbce887c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:52.912711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0c575-6832-4a3b-85bd-2d07cbce887c None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:52.913657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0c575-6832-4a3b-85bd-2d07cbce887c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:52.914217 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0c575-6832-4a3b-85bd-2d07cbce887c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:52.915813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0c575-6832-4a3b-85bd-2d07cbce887c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:52.929483 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 324/627] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:52.930741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0c575-6832-4a3b-85bd-2d07cbce887c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:52.976216 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa5141-edf3-432a-9e42-bc4d8e43842f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:52.990896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:53.013150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191bcc2-8d0a-4365-b444-2a888a85d599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:53.014064 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191bcc2-8d0a-4365-b444-2a888a85d599 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:53.014314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191bcc2-8d0a-4365-b444-2a888a85d599 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:53.014596 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191bcc2-8d0a-4365-b444-2a888a85d599 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:53.023010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191bcc2-8d0a-4365-b444-2a888a85d599 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:53.024472 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191bcc2-8d0a-4365-b444-2a888a85d599 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-9191bcc2-8d0a-4365-b444-2a888a85d599 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:53.040523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:53.041568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:53.042602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:53.042602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:53.042602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:53.042602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:53.042602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:53.042602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:53.042602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:53.042602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:53.042602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:27:53.042602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:53.052168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 304/628] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 20 22:27:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:53.052168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191bcc2-8d0a-4365-b444-2a888a85d599 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:53.062209 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0c575-6832-4a3b-85bd-2d07cbce887c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:53.113000 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b1a34-81ea-4ffd-941b-81626a73e4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:53.114385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b1a34-81ea-4ffd-941b-81626a73e4bf None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:53.115220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b1a34-81ea-4ffd-941b-81626a73e4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:53.115676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b1a34-81ea-4ffd-941b-81626a73e4bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:53.131779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b1a34-81ea-4ffd-941b-81626a73e4bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:53.133904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b1a34-81ea-4ffd-941b-81626a73e4bf None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d28b1a34-81ea-4ffd-941b-81626a73e4bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:53.159365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:53.160963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:53.162055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:53.162055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:53.162055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:53.162055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:53.164799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 325/629] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:53.165766 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b1a34-81ea-4ffd-941b-81626a73e4bf None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:53.182444 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191bcc2-8d0a-4365-b444-2a888a85d599 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:53.212456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:53.230216 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c94cbf-ebfb-4a50-b638-130642be13a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:53.231379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94cbf-ebfb-4a50-b638-130642be13a8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:53.231670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94cbf-ebfb-4a50-b638-130642be13a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:53.231946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c94cbf-ebfb-4a50-b638-130642be13a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:53.241487 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c94cbf-ebfb-4a50-b638-130642be13a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:53.243240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c94cbf-ebfb-4a50-b638-130642be13a8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-15c94cbf-ebfb-4a50-b638-130642be13a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:53.261553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:53.262747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:53.263937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:53.263937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:53.263937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:53.263937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:53.263937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:53.263937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:53.263937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:53.263937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:53.267883 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 305/630] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:53.268911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c94cbf-ebfb-4a50-b638-130642be13a8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:53.289462 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:53.311499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b1a34-81ea-4ffd-941b-81626a73e4bf None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:53.348022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422e43b-10bf-42ca-94d3-8a3d599e9331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:53.348647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422e43b-10bf-42ca-94d3-8a3d599e9331 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:53.348934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422e43b-10bf-42ca-94d3-8a3d599e9331 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:53.349233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422e43b-10bf-42ca-94d3-8a3d599e9331 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:53.350277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422e43b-10bf-42ca-94d3-8a3d599e9331 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:53.350644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422e43b-10bf-42ca-94d3-8a3d599e9331 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:53.352047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422e43b-10bf-42ca-94d3-8a3d599e9331 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:53.371489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 326/631] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 20 22:27:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:53.372523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422e43b-10bf-42ca-94d3-8a3d599e9331 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:53.394050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c94cbf-ebfb-4a50-b638-130642be13a8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:53.432660 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b115b7-72d0-480e-9178-3abcb0425940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:53.433481 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b115b7-72d0-480e-9178-3abcb0425940 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:53.433917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b115b7-72d0-480e-9178-3abcb0425940 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:53.434403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b115b7-72d0-480e-9178-3abcb0425940 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:53.435162 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b115b7-72d0-480e-9178-3abcb0425940 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:53.436291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b115b7-72d0-480e-9178-3abcb0425940 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:53.437655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b115b7-72d0-480e-9178-3abcb0425940 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:53.454451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 306/632] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:53.454451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eeece-77e3-41b5-a9e2-112d21652260 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:53.454451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eeece-77e3-41b5-a9e2-112d21652260 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:53.454451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57eeece-77e3-41b5-a9e2-112d21652260 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:53.454451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 307/633] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:53.454451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57eeece-77e3-41b5-a9e2-112d21652260 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:53.471146 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:53.484497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422e43b-10bf-42ca-94d3-8a3d599e9331 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:53.519591 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b92162-7a32-4567-8b1d-0d703df26e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:53.520365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b92162-7a32-4567-8b1d-0d703df26e58 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:53.520711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b92162-7a32-4567-8b1d-0d703df26e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:53.521061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b92162-7a32-4567-8b1d-0d703df26e58 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:53.521971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b92162-7a32-4567-8b1d-0d703df26e58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:53.522271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b92162-7a32-4567-8b1d-0d703df26e58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:53.523695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b92162-7a32-4567-8b1d-0d703df26e58 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:53.540180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 327/634] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:53.540180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b92162-7a32-4567-8b1d-0d703df26e58 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:53.549079 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:53.581464 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57eeece-77e3-41b5-a9e2-112d21652260 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:53.620616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ee260-4636-4c74-be4a-64396d0c3e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:53.621358 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ee260-4636-4c74-be4a-64396d0c3e25 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:53.621800 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ee260-4636-4c74-be4a-64396d0c3e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:53.622181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ee260-4636-4c74-be4a-64396d0c3e25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:53.642210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b92162-7a32-4567-8b1d-0d703df26e58 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:53.679378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad691fd-aecb-42ac-b2a7-bba094c83f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:53.680202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad691fd-aecb-42ac-b2a7-bba094c83f93 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:53.680485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad691fd-aecb-42ac-b2a7-bba094c83f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:53.680767 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad691fd-aecb-42ac-b2a7-bba094c83f93 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:53.689308 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad691fd-aecb-42ac-b2a7-bba094c83f93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:53.690862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad691fd-aecb-42ac-b2a7-bba094c83f93 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:53.701520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ee260-4636-4c74-be4a-64396d0c3e25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:53.703178 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ee260-4636-4c74-be4a-64396d0c3e25 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-dad691fd-aecb-42ac-b2a7-bba094c83f93 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:53.705510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:53.706692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:53.707981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:53.707981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:53.707981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:53.707981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:53.707981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:53.707981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:53.707981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:53.707981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:53.707981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 22:27:53.707981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:53.711411 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 328/635] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:53.712590 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b5d9-5533-4db6-97e4-1428181d9a52 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:53.712899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b5d9-5533-4db6-97e4-1428181d9a52 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:53.713186 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844b5d9-5533-4db6-97e4-1428181d9a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:53.730141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1844b5d9-5533-4db6-97e4-1428181d9a52 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:53.731400 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1844b5d9-5533-4db6-97e4-1428181d9a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:53.734169 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:53.787744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:53.803740 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 329/636] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:53.808375 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844b5d9-5533-4db6-97e4-1428181d9a52 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:53.832423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 308/637] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:53.832423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ee260-4636-4c74-be4a-64396d0c3e25 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:53.915547 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844b5d9-5533-4db6-97e4-1428181d9a52 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:53.941306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ee260-4636-4c74-be4a-64396d0c3e25 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:53.958486 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549bbcc-a27b-44cf-93f7-057d02f69ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:53.959586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549bbcc-a27b-44cf-93f7-057d02f69ddb None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:53.960190 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549bbcc-a27b-44cf-93f7-057d02f69ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:53.960475 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549bbcc-a27b-44cf-93f7-057d02f69ddb None admin] PATH_INFO: `/v3/projects/8cec07c864274d649ecd1944be870bd5/users/146610a7cbbc46928a4a8d710c4d1942/roles/2a5f2a34d0b341e58b642fc48dc7c5da` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:53.970477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:53.978969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549bbcc-a27b-44cf-93f7-057d02f69ddb None admin] RBAC: Authorizing `identity:create_grant(project_id=8cec07c864274d649ecd1944be870bd5, user_id=146610a7cbbc46928a4a8d710c4d1942, role_id=2a5f2a34d0b341e58b642fc48dc7c5da)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:53.984334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c58688-1afd-4b52-b5b2-b51b5ce27aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:53.984334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c58688-1afd-4b52-b5b2-b51b5ce27aba None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:53.984334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c58688-1afd-4b52-b5b2-b51b5ce27aba None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:53.984639 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549bbcc-a27b-44cf-93f7-057d02f69ddb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:53.984744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c58688-1afd-4b52-b5b2-b51b5ce27aba None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:53.984744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c58688-1afd-4b52-b5b2-b51b5ce27aba None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:53.984744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c58688-1afd-4b52-b5b2-b51b5ce27aba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:53.984744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c58688-1afd-4b52-b5b2-b51b5ce27aba None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:54.001888 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 309/638] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Jul 20 22:27:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:54.002869 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c58688-1afd-4b52-b5b2-b51b5ce27aba None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:54.035993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:54.106115 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c58688-1afd-4b52-b5b2-b51b5ce27aba None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:54.141049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92b7fd-ca48-410b-98af-387bf31562de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:54.141890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92b7fd-ca48-410b-98af-387bf31562de None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:54.142179 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92b7fd-ca48-410b-98af-387bf31562de None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:54.142455 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf92b7fd-ca48-410b-98af-387bf31562de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:54.152371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf92b7fd-ca48-410b-98af-387bf31562de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-cf92b7fd-ca48-410b-98af-387bf31562de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:54.160849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:54.162059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:54.163059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:54.163059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:54.163059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:54.163059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:54.163059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:54.163059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:54.163059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:54.163059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:54.163059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:54.163059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:54.163059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:54.163059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:54.163059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 310/639] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:54.163059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92b7fd-ca48-410b-98af-387bf31562de None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:54.258807 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf92b7fd-ca48-410b-98af-387bf31562de None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:54.291768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61431d1-d479-4ef5-a8b0-052d58049cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:54.292560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61431d1-d479-4ef5-a8b0-052d58049cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:54.292846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61431d1-d479-4ef5-a8b0-052d58049cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:54.293190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61431d1-d479-4ef5-a8b0-052d58049cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:54.303515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61431d1-d479-4ef5-a8b0-052d58049cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:54.304965 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61431d1-d479-4ef5-a8b0-052d58049cc2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e61431d1-d479-4ef5-a8b0-052d58049cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:54.321911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:54.323069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:54.324315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:54.324315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:54.324315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:54.324315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:54.324315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 311/640] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:54.324315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61431d1-d479-4ef5-a8b0-052d58049cc2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:54.423484 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61431d1-d479-4ef5-a8b0-052d58049cc2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:54.456808 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282ba28-a726-4843-b4f6-243aae75ab09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:54.457575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ba28-a726-4843-b4f6-243aae75ab09 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:54.457892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ba28-a726-4843-b4f6-243aae75ab09 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:54.458176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282ba28-a726-4843-b4f6-243aae75ab09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:54.488017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 330/641] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:27:53 2022] PUT /identity/v3/projects/8cec07c864274d649ecd1944be870bd5/users/146610a7cbbc46928a4a8d710c4d1942/roles/2a5f2a34d0b341e58b642fc48dc7c5da => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:27:54.493417 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe932-ae12-4168-b0cd-3fc96018756a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:54.493417 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe932-ae12-4168-b0cd-3fc96018756a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:54.493417 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfe932-ae12-4168-b0cd-3fc96018756a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:54.493417 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 331/642] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:54.496302 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfe932-ae12-4168-b0cd-3fc96018756a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:54.525251 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:54.536110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282ba28-a726-4843-b4f6-243aae75ab09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:54.542558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282ba28-a726-4843-b4f6-243aae75ab09 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:54.612242 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfe932-ae12-4168-b0cd-3fc96018756a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:54.614323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:54.653834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace7cf9-bcb6-4b5d-9159-0f9b1c3fecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:54.654899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace7cf9-bcb6-4b5d-9159-0f9b1c3fecb8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:54.655408 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace7cf9-bcb6-4b5d-9159-0f9b1c3fecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:54.655770 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace7cf9-bcb6-4b5d-9159-0f9b1c3fecb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:54.656227 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 312/643] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:54.657288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282ba28-a726-4843-b4f6-243aae75ab09 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:54.658321 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace7cf9-bcb6-4b5d-9159-0f9b1c3fecb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:54.658647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace7cf9-bcb6-4b5d-9159-0f9b1c3fecb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:54.660237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace7cf9-bcb6-4b5d-9159-0f9b1c3fecb8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:54.670086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 332/644] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:54.672344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae5fe-37a6-45b9-9ec8-1eb2b28c6910 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:54.672706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae5fe-37a6-45b9-9ec8-1eb2b28c6910 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:54.673054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae5fe-37a6-45b9-9ec8-1eb2b28c6910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:54.693304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1eeae5fe-37a6-45b9-9ec8-1eb2b28c6910 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:54.694532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1eeae5fe-37a6-45b9-9ec8-1eb2b28c6910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:54.707075 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:54.743367 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:54.764910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282ba28-a726-4843-b4f6-243aae75ab09 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:54.773937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 333/645] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:54.773937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeae5fe-37a6-45b9-9ec8-1eb2b28c6910 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:54.818756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb1654-1076-4901-b529-66d448252598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:54.819727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb1654-1076-4901-b529-66d448252598 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:54.820639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb1654-1076-4901-b529-66d448252598 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:54.821103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb1654-1076-4901-b529-66d448252598 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:54.822284 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb1654-1076-4901-b529-66d448252598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:54.822944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb1654-1076-4901-b529-66d448252598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:54.825162 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb1654-1076-4901-b529-66d448252598 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:54.841570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 313/646] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:54.843262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb1654-1076-4901-b529-66d448252598 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:54.868672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeae5fe-37a6-45b9-9ec8-1eb2b28c6910 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:54.907677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d02d6-49fb-470b-b655-84086f1af0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:54.908485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d02d6-49fb-470b-b655-84086f1af0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:54.908766 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d02d6-49fb-470b-b655-84086f1af0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:54.909037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d02d6-49fb-470b-b655-84086f1af0f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:54.920919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d02d6-49fb-470b-b655-84086f1af0f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:54.922536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d02d6-49fb-470b-b655-84086f1af0f2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-bc0d02d6-49fb-470b-b655-84086f1af0f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:54.941842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:54.942845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:54.943937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:54.943937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:54.943937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:54.943937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:54.943937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 334/647] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:54.944233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d02d6-49fb-470b-b655-84086f1af0f2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:54.967650 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb1654-1076-4901-b529-66d448252598 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:54.971783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:54.976941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:55.013314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b895c46-ad62-4482-829b-f66262a0c23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:55.014567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b895c46-ad62-4482-829b-f66262a0c23b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:55.014955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b895c46-ad62-4482-829b-f66262a0c23b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:55.015179 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b895c46-ad62-4482-829b-f66262a0c23b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:55.028155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b895c46-ad62-4482-829b-f66262a0c23b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:55.029645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b895c46-ad62-4482-829b-f66262a0c23b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-7b895c46-ad62-4482-829b-f66262a0c23b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:55.047870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:55.048824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:55.049775 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:55.049775 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:55.049775 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:55.049775 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:55.050004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d02d6-49fb-470b-b655-84086f1af0f2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:55.053655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 314/648] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:55.054536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b895c46-ad62-4482-829b-f66262a0c23b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:55.093964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b43306-fa3d-421d-9fbf-78aa6277752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:55.094763 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b43306-fa3d-421d-9fbf-78aa6277752b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:55.095042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b43306-fa3d-421d-9fbf-78aa6277752b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:55.095312 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b43306-fa3d-421d-9fbf-78aa6277752b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:55.106275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b43306-fa3d-421d-9fbf-78aa6277752b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f0b43306-fa3d-421d-9fbf-78aa6277752b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:55.114877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:55.115856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:55.122336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:55.122336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:55.122336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:55.122336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:55.122336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:55.122336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:55.122336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:55.122336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:55.122336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:55.122336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:55.122336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:55.122336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:55.122336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 335/649] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:55.122336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b43306-fa3d-421d-9fbf-78aa6277752b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:55.172623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b895c46-ad62-4482-829b-f66262a0c23b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:55.207197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f00be-c087-4829-b0a6-e529965ac981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:55.208003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f00be-c087-4829-b0a6-e529965ac981 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:55.208287 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f00be-c087-4829-b0a6-e529965ac981 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:55.208565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f00be-c087-4829-b0a6-e529965ac981 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:55.215293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f00be-c087-4829-b0a6-e529965ac981 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:55.216766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f00be-c087-4829-b0a6-e529965ac981 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:55.218242 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:55.227048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b43306-fa3d-421d-9fbf-78aa6277752b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-697f00be-c087-4829-b0a6-e529965ac981 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:55.231300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:55.232784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:55.238857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:55.238857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:55.238857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:55.238857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:55.238857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:55.238857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:55.238857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:55.238857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:55.238857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 315/650] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:55.238857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f00be-c087-4829-b0a6-e529965ac981 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:55.256426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:55.270541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57dc09-d860-40fc-a53c-919f3dd9ab03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:55.271214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57dc09-d860-40fc-a53c-919f3dd9ab03 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:55.271495 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57dc09-d860-40fc-a53c-919f3dd9ab03 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:55.271767 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57dc09-d860-40fc-a53c-919f3dd9ab03 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:55.272491 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57dc09-d860-40fc-a53c-919f3dd9ab03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:55.272812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57dc09-d860-40fc-a53c-919f3dd9ab03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:55.274208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57dc09-d860-40fc-a53c-919f3dd9ab03 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:55.287012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 336/651] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:55.287668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57dc09-d860-40fc-a53c-919f3dd9ab03 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:55.347566 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f00be-c087-4829-b0a6-e529965ac981 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:55.384888 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b6d8-cf14-46ca-bdc6-c220599ac129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:55.385562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b6d8-cf14-46ca-bdc6-c220599ac129 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:55.385881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b6d8-cf14-46ca-bdc6-c220599ac129 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:55.386161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423b6d8-cf14-46ca-bdc6-c220599ac129 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:55.386887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423b6d8-cf14-46ca-bdc6-c220599ac129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:55.387208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423b6d8-cf14-46ca-bdc6-c220599ac129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:55.388608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423b6d8-cf14-46ca-bdc6-c220599ac129 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:55.400827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 316/652] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:55.401633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b6d8-cf14-46ca-bdc6-c220599ac129 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:55.403108 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57dc09-d860-40fc-a53c-919f3dd9ab03 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:55.446820 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610e0dc-4e42-4e04-a578-11bb5929e327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:55.447492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610e0dc-4e42-4e04-a578-11bb5929e327 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:55.447777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610e0dc-4e42-4e04-a578-11bb5929e327 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:55.448054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610e0dc-4e42-4e04-a578-11bb5929e327 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:55.448803 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610e0dc-4e42-4e04-a578-11bb5929e327 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:55.449110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610e0dc-4e42-4e04-a578-11bb5929e327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:55.450506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610e0dc-4e42-4e04-a578-11bb5929e327 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:55.461758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 337/653] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:55.461758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610e0dc-4e42-4e04-a578-11bb5929e327 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:55.479362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:55.499717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:55.527011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423b6d8-cf14-46ca-bdc6-c220599ac129 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:55.565193 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec5952-1bb5-4a17-9a9f-163a67c2a94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:55.565986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec5952-1bb5-4a17-9a9f-163a67c2a94e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:55.566332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec5952-1bb5-4a17-9a9f-163a67c2a94e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:55.566671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec5952-1bb5-4a17-9a9f-163a67c2a94e None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:55.566783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610e0dc-4e42-4e04-a578-11bb5929e327 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:55.567583 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec5952-1bb5-4a17-9a9f-163a67c2a94e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:55.567960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec5952-1bb5-4a17-9a9f-163a67c2a94e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:55.569455 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec5952-1bb5-4a17-9a9f-163a67c2a94e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:55.587103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 317/654] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:55.587103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec5952-1bb5-4a17-9a9f-163a67c2a94e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:55.609133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1c662-e796-436b-af72-201ed25ecfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:55.610390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1c662-e796-436b-af72-201ed25ecfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:55.610678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1c662-e796-436b-af72-201ed25ecfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:55.610957 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1c662-e796-436b-af72-201ed25ecfa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:55.618189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1c662-e796-436b-af72-201ed25ecfa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:55.619639 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1c662-e796-436b-af72-201ed25ecfa6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3fb1c662-e796-436b-af72-201ed25ecfa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:55.634621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:55.635927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:55.643160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:55.643160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:55.643160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:55.643160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:55.643160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:55.643160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:55.643160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:55.643160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:55.643160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 338/655] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:55.643160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1c662-e796-436b-af72-201ed25ecfa6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:55.710382 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec5952-1bb5-4a17-9a9f-163a67c2a94e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:55.718932 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:55.744003 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1c662-e796-436b-af72-201ed25ecfa6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:55.749932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cfbc4-31b7-4f4f-b28f-fc453bb242d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:55.750742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cfbc4-31b7-4f4f-b28f-fc453bb242d4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:55.751026 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cfbc4-31b7-4f4f-b28f-fc453bb242d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:55.751580 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273cfbc4-31b7-4f4f-b28f-fc453bb242d4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:55.755009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:55.760493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cfbc4-31b7-4f4f-b28f-fc453bb242d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:55.762146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273cfbc4-31b7-4f4f-b28f-fc453bb242d4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-273cfbc4-31b7-4f4f-b28f-fc453bb242d4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:55.777784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:55.778781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:55.780352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:55.780352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:55.780352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:55.780352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:55.780352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:55.780352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:55.780352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:55.780352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:55.780352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 22:27:55.780352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:55.780352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 318/656] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:55.781015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cfbc4-31b7-4f4f-b28f-fc453bb242d4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:55.783391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749fea6-ceff-4806-9b5d-5b729e8c64ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:55.784290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749fea6-ceff-4806-9b5d-5b729e8c64ee None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:55.784747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749fea6-ceff-4806-9b5d-5b729e8c64ee None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:55.784921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749fea6-ceff-4806-9b5d-5b729e8c64ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:55.796529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749fea6-ceff-4806-9b5d-5b729e8c64ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:55.798011 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749fea6-ceff-4806-9b5d-5b729e8c64ee None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3749fea6-ceff-4806-9b5d-5b729e8c64ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:55.815406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:55.816341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:55.817292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:55.817292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:55.817292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:55.817292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:55.817292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 339/657] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:55.817574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749fea6-ceff-4806-9b5d-5b729e8c64ee None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:55.898455 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273cfbc4-31b7-4f4f-b28f-fc453bb242d4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:55.929458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749fea6-ceff-4806-9b5d-5b729e8c64ee None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:55.935121 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89332ab4-c357-4a63-bdea-ee92ef548382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:55.936059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89332ab4-c357-4a63-bdea-ee92ef548382 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:55.936560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89332ab4-c357-4a63-bdea-ee92ef548382 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:55.937045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89332ab4-c357-4a63-bdea-ee92ef548382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:55.938017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89332ab4-c357-4a63-bdea-ee92ef548382 None admin] RBAC: Adding query filter params (role.id=2a5f2a34d0b341e58b642fc48dc7c5da, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=67c92c8d2b9d41e489e4c03ae4e71fe2) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:55.938431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89332ab4-c357-4a63-bdea-ee92ef548382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:55.939970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89332ab4-c357-4a63-bdea-ee92ef548382 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:55.946613 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 319/658] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:55 2022] GET /identity/v3/role_assignments?user.id=67c92c8d2b9d41e489e4c03ae4e71fe2&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=2a5f2a34d0b341e58b642fc48dc7c5da => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:55.947492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89332ab4-c357-4a63-bdea-ee92ef548382 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:55.969475 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:55.983106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab286f93-a86b-44c7-a6c7-282ad47a0f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:55.984482 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab286f93-a86b-44c7-a6c7-282ad47a0f32 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:55.984924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab286f93-a86b-44c7-a6c7-282ad47a0f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:55.985611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab286f93-a86b-44c7-a6c7-282ad47a0f32 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:55.987306 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab286f93-a86b-44c7-a6c7-282ad47a0f32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:55.987887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab286f93-a86b-44c7-a6c7-282ad47a0f32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:55.989648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab286f93-a86b-44c7-a6c7-282ad47a0f32 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:56.010141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 340/659] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:56.010895 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab286f93-a86b-44c7-a6c7-282ad47a0f32 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:56.025219 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:56.098092 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89332ab4-c357-4a63-bdea-ee92ef548382 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:56.139352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75b2f6-afb9-4069-9879-4ef846badb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:56.140063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75b2f6-afb9-4069-9879-4ef846badb64 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:56.140346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75b2f6-afb9-4069-9879-4ef846badb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:56.140621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75b2f6-afb9-4069-9879-4ef846badb64 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:56.141885 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75b2f6-afb9-4069-9879-4ef846badb64 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:56.142303 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75b2f6-afb9-4069-9879-4ef846badb64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:56.143753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75b2f6-afb9-4069-9879-4ef846badb64 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:56.145089 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab286f93-a86b-44c7-a6c7-282ad47a0f32 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:56.163710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 320/660] 10.222.0.83 () {56 vars in 1137 bytes} [Wed Jul 20 22:27:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:56.164505 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75b2f6-afb9-4069-9879-4ef846badb64 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:56.183718 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895184d-c6fb-4066-9ee1-db11fe41aecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:56.185766 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895184d-c6fb-4066-9ee1-db11fe41aecf None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:56.186087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895184d-c6fb-4066-9ee1-db11fe41aecf None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:56.187151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895184d-c6fb-4066-9ee1-db11fe41aecf None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:56.187470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895184d-c6fb-4066-9ee1-db11fe41aecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:56.188336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895184d-c6fb-4066-9ee1-db11fe41aecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:56.189219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895184d-c6fb-4066-9ee1-db11fe41aecf None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:56.207134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 341/661] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:56.208320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895184d-c6fb-4066-9ee1-db11fe41aecf None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:56.258581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:56.291432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75b2f6-afb9-4069-9879-4ef846badb64 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:56.316126 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:56.322259 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895184d-c6fb-4066-9ee1-db11fe41aecf None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:56.340098 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224326f-99f1-4cc5-a6b1-9924742a49cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:56.342029 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224326f-99f1-4cc5-a6b1-9924742a49cf None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:56.342287 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224326f-99f1-4cc5-a6b1-9924742a49cf None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:56.342562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224326f-99f1-4cc5-a6b1-9924742a49cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:56.343405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224326f-99f1-4cc5-a6b1-9924742a49cf None admin] RBAC: Adding query filter params (role.id=2a5f2a34d0b341e58b642fc48dc7c5da, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=669a11ce83b746eeb7f4e7d0acca4b6f) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:56.343723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224326f-99f1-4cc5-a6b1-9924742a49cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:56.345165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b224326f-99f1-4cc5-a6b1-9924742a49cf None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:56.357909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 321/662] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:56 2022] GET /identity/v3/role_assignments?user.id=669a11ce83b746eeb7f4e7d0acca4b6f&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=2a5f2a34d0b341e58b642fc48dc7c5da => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:56.359030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224326f-99f1-4cc5-a6b1-9924742a49cf None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:56.368340 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063ee23-13e7-467c-b6e1-137380715d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:56.369361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063ee23-13e7-467c-b6e1-137380715d8e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:56.369914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063ee23-13e7-467c-b6e1-137380715d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:56.370416 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063ee23-13e7-467c-b6e1-137380715d8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:56.458411 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063ee23-13e7-467c-b6e1-137380715d8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:56.461227 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063ee23-13e7-467c-b6e1-137380715d8e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:56.552552 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:56.579987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224326f-99f1-4cc5-a6b1-9924742a49cf None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:56.628269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 342/663] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:56.629782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbc52b-16c7-4f95-a2e8-d80fbdcd6a7c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:56.630148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbc52b-16c7-4f95-a2e8-d80fbdcd6a7c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:56.630490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbc52b-16c7-4f95-a2e8-d80fbdcd6a7c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:56.630602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48eb679-91db-42bf-bdf8-f8fa9e86620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:56.631422 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eb679-91db-42bf-bdf8-f8fa9e86620f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:56.631769 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eb679-91db-42bf-bdf8-f8fa9e86620f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:56.632101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48eb679-91db-42bf-bdf8-f8fa9e86620f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:56.632258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 343/664] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:56.633263 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbc52b-16c7-4f95-a2e8-d80fbdcd6a7c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:56.641386 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48eb679-91db-42bf-bdf8-f8fa9e86620f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:56.642881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48eb679-91db-42bf-bdf8-f8fa9e86620f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e48eb679-91db-42bf-bdf8-f8fa9e86620f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:56.659497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:56.660524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:56.661509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:56.661509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:56.661509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:56.661509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:56.661509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:56.661509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:56.661509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:56.661509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:56.661509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 22:27:56.661509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:56.661509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 322/665] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:56.663082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4687f-2aae-4a00-9c89-a4a6f0ad3c71 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:56.663082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4687f-2aae-4a00-9c89-a4a6f0ad3c71 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:56.663082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4687f-2aae-4a00-9c89-a4a6f0ad3c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:56.681833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e0e4687f-2aae-4a00-9c89-a4a6f0ad3c71 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:56.683042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e0e4687f-2aae-4a00-9c89-a4a6f0ad3c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:56.733867 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:56.764627 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbc52b-16c7-4f95-a2e8-d80fbdcd6a7c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:56.775647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 323/666] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:56.777268 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4687f-2aae-4a00-9c89-a4a6f0ad3c71 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:56.808130 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f3cfe-dbdb-4db5-8e52-96520c250895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:56.808977 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f3cfe-dbdb-4db5-8e52-96520c250895 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:56.809270 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f3cfe-dbdb-4db5-8e52-96520c250895 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:56.809712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f3cfe-dbdb-4db5-8e52-96520c250895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:56.823672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f3cfe-dbdb-4db5-8e52-96520c250895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:56.825152 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f3cfe-dbdb-4db5-8e52-96520c250895 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-956f3cfe-dbdb-4db5-8e52-96520c250895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:56.849058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:56.850260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:56.851250 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:56.851250 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:56.851250 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:56.851250 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:56.851250 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 344/667] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:56.851540 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f3cfe-dbdb-4db5-8e52-96520c250895 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:56.874175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:56.900747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4687f-2aae-4a00-9c89-a4a6f0ad3c71 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:56.937827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ba7e3-4158-4b73-a9c6-378d4c272e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:56.938612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ba7e3-4158-4b73-a9c6-378d4c272e99 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:56.938899 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ba7e3-4158-4b73-a9c6-378d4c272e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:56.939331 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9ba7e3-4158-4b73-a9c6-378d4c272e99 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:56.940346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ba7e3-4158-4b73-a9c6-378d4c272e99 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:56.940667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ba7e3-4158-4b73-a9c6-378d4c272e99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:56.942175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9ba7e3-4158-4b73-a9c6-378d4c272e99 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:56.960486 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 324/668] 10.222.0.83 () {56 vars in 1139 bytes} [Wed Jul 20 22:27:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:56.961340 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ba7e3-4158-4b73-a9c6-378d4c272e99 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:56.972886 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f3cfe-dbdb-4db5-8e52-96520c250895 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:56.993057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:57.012344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a07c25-5680-4899-ad9d-0f94248ade3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:57.013521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a07c25-5680-4899-ad9d-0f94248ade3a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:57.014113 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a07c25-5680-4899-ad9d-0f94248ade3a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:57.014628 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a07c25-5680-4899-ad9d-0f94248ade3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:57.027669 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a07c25-5680-4899-ad9d-0f94248ade3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a3a07c25-5680-4899-ad9d-0f94248ade3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:57.037796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:57.038983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:57.040078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:57.040078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:57.040078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:57.040078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:57.040078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:57.040078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:57.040078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:57.040078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:57.040078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:57.040078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:57.040078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:27:57.040078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:57.048021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 345/669] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:27:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:57.049194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a07c25-5680-4899-ad9d-0f94248ade3a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:57.067185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9ba7e3-4158-4b73-a9c6-378d4c272e99 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:57.117421 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:57.128569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6d9c8-ba6d-4f8e-8e96-1693160567fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:57.134991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6d9c8-ba6d-4f8e-8e96-1693160567fc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:57.134991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6d9c8-ba6d-4f8e-8e96-1693160567fc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:57.134991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6d9c8-ba6d-4f8e-8e96-1693160567fc None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:57.134991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6d9c8-ba6d-4f8e-8e96-1693160567fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:57.134991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6d9c8-ba6d-4f8e-8e96-1693160567fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:57.134991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece6d9c8-ba6d-4f8e-8e96-1693160567fc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:57.152966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 325/670] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:57.152966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6d9c8-ba6d-4f8e-8e96-1693160567fc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:57.169711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a07c25-5680-4899-ad9d-0f94248ade3a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:57.215554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca828a8-98f9-4aaf-86c9-da1f79adc1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:57.216484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca828a8-98f9-4aaf-86c9-da1f79adc1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:57.217478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca828a8-98f9-4aaf-86c9-da1f79adc1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:57.217777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca828a8-98f9-4aaf-86c9-da1f79adc1d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:57.256783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:57.269646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece6d9c8-ba6d-4f8e-8e96-1693160567fc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:57.302049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca828a8-98f9-4aaf-86c9-da1f79adc1d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:57.304143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca828a8-98f9-4aaf-86c9-da1f79adc1d4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:57.316370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d1754-41c2-49fc-865d-e083df9dd410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:57.317515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1754-41c2-49fc-865d-e083df9dd410 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:57.317845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1754-41c2-49fc-865d-e083df9dd410 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:57.318120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d1754-41c2-49fc-865d-e083df9dd410 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:57.318875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d1754-41c2-49fc-865d-e083df9dd410 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:57.319182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d1754-41c2-49fc-865d-e083df9dd410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:57.321252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d1754-41c2-49fc-865d-e083df9dd410 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:57.337606 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 326/671] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:27:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:57.337606 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d1754-41c2-49fc-865d-e083df9dd410 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:57.378392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:57.428590 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 346/672] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:57.429996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca828a8-98f9-4aaf-86c9-da1f79adc1d4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:57.469144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d1754-41c2-49fc-865d-e083df9dd410 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:57.510093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07341874-e5f7-4ebc-8b2b-051e11545ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:57.510808 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07341874-e5f7-4ebc-8b2b-051e11545ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:57.511088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07341874-e5f7-4ebc-8b2b-051e11545ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:57.511362 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07341874-e5f7-4ebc-8b2b-051e11545ab5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:57.520264 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07341874-e5f7-4ebc-8b2b-051e11545ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:57.521910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07341874-e5f7-4ebc-8b2b-051e11545ab5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-07341874-e5f7-4ebc-8b2b-051e11545ab5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:57.540118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:57.541073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:57.542266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:57.542266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:57.542266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:57.542266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:57.542266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:57.542266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:57.542266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:57.542266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:57.544547 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca828a8-98f9-4aaf-86c9-da1f79adc1d4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:57.546087 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 327/673] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:57.547166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07341874-e5f7-4ebc-8b2b-051e11545ab5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:57.564916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:57.591935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbef9a2-5bd4-4910-bb33-1bf622a9a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:57.592868 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbef9a2-5bd4-4910-bb33-1bf622a9a311 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:57.593154 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbef9a2-5bd4-4910-bb33-1bf622a9a311 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:57.593427 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbef9a2-5bd4-4910-bb33-1bf622a9a311 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:57.608551 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbef9a2-5bd4-4910-bb33-1bf622a9a311 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:57.610100 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbef9a2-5bd4-4910-bb33-1bf622a9a311 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-7bbef9a2-5bd4-4910-bb33-1bf622a9a311 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:57.634052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:57.635464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:57.636507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:57.636507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:57.636507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:57.636507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:57.641465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 347/674] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:57.642415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbef9a2-5bd4-4910-bb33-1bf622a9a311 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:57.657159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:57.673655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07341874-e5f7-4ebc-8b2b-051e11545ab5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:57.725415 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae900b-af05-4336-8d2e-1127923e7d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:57.726536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae900b-af05-4336-8d2e-1127923e7d29 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:57.726825 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae900b-af05-4336-8d2e-1127923e7d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:57.727107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae900b-af05-4336-8d2e-1127923e7d29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:57.741290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae900b-af05-4336-8d2e-1127923e7d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:57.743345 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae900b-af05-4336-8d2e-1127923e7d29 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-9eae900b-af05-4336-8d2e-1127923e7d29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:57.769944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:57.770930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:57.771932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:57.771932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:57.771932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:57.771932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:57.771932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 328/675] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:57.772226 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae900b-af05-4336-8d2e-1127923e7d29 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:57.773644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbef9a2-5bd4-4910-bb33-1bf622a9a311 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:57.812418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55f831-e8a4-4190-bc59-7c2c88d5bf7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:57.813473 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55f831-e8a4-4190-bc59-7c2c88d5bf7f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:57.814010 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55f831-e8a4-4190-bc59-7c2c88d5bf7f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:57.814493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55f831-e8a4-4190-bc59-7c2c88d5bf7f None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:57.815504 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55f831-e8a4-4190-bc59-7c2c88d5bf7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:57.816033 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55f831-e8a4-4190-bc59-7c2c88d5bf7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:57.817708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55f831-e8a4-4190-bc59-7c2c88d5bf7f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:57.831686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 348/676] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:57.833110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55f831-e8a4-4190-bc59-7c2c88d5bf7f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:57.853972 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:57.902638 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae900b-af05-4336-8d2e-1127923e7d29 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:57.948854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:57.965817 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d8fdb-7d96-4397-b692-868f53ebed12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:57.967550 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d8fdb-7d96-4397-b692-868f53ebed12 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:57.968338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d8fdb-7d96-4397-b692-868f53ebed12 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:57.969105 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d8fdb-7d96-4397-b692-868f53ebed12 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:57.970801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d8fdb-7d96-4397-b692-868f53ebed12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:57.971813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d8fdb-7d96-4397-b692-868f53ebed12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:57.974822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d8fdb-7d96-4397-b692-868f53ebed12 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:57.985621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55f831-e8a4-4190-bc59-7c2c88d5bf7f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:57.998611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 329/677] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:58.000539 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d8fdb-7d96-4397-b692-868f53ebed12 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:58.029790 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641130f-d728-4b58-9b41-2742c0196dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:58.030404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641130f-d728-4b58-9b41-2742c0196dae None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:58.030700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641130f-d728-4b58-9b41-2742c0196dae None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:58.030967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e641130f-d728-4b58-9b41-2742c0196dae None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:58.032213 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641130f-d728-4b58-9b41-2742c0196dae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:58.032531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641130f-d728-4b58-9b41-2742c0196dae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:58.033950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e641130f-d728-4b58-9b41-2742c0196dae None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:58.050185 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 349/678] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:58.051228 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641130f-d728-4b58-9b41-2742c0196dae None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:58.153973 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d8fdb-7d96-4397-b692-868f53ebed12 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:58.182229 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e641130f-d728-4b58-9b41-2742c0196dae None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:58.187937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:58.203696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5344b6-15ed-4971-9d88-dd11d95f0203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:58.204363 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5344b6-15ed-4971-9d88-dd11d95f0203 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:58.204639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5344b6-15ed-4971-9d88-dd11d95f0203 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:58.204910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5344b6-15ed-4971-9d88-dd11d95f0203 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:58.205775 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5344b6-15ed-4971-9d88-dd11d95f0203 None admin] RBAC: Adding query filter params (role.id=2a5f2a34d0b341e58b642fc48dc7c5da, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=12ab5b94b21b466e8070771a61378e89) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:58.206151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5344b6-15ed-4971-9d88-dd11d95f0203 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:58.207644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5344b6-15ed-4971-9d88-dd11d95f0203 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:58.213862 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 330/679] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:57 2022] GET /identity/v3/role_assignments?user.id=12ab5b94b21b466e8070771a61378e89&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=2a5f2a34d0b341e58b642fc48dc7c5da => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:58.215143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5344b6-15ed-4971-9d88-dd11d95f0203 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:58.222193 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:58.230952 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a392109-2de2-48fe-acb8-23b48a2e326b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:58.232839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a392109-2de2-48fe-acb8-23b48a2e326b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:58.233912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a392109-2de2-48fe-acb8-23b48a2e326b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:58.234541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a392109-2de2-48fe-acb8-23b48a2e326b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:58.246114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a392109-2de2-48fe-acb8-23b48a2e326b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:58.255020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a392109-2de2-48fe-acb8-23b48a2e326b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-2a392109-2de2-48fe-acb8-23b48a2e326b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:27:58.270888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:58.271942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:58.272925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:58.272925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:58.272925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:27:58.272925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:27:58.272925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:27:58.272925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:27:58.272925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:27:58.272925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:27:58.272925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 22:27:58.272925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:58.276027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 350/680] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:27:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:58.283209 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a392109-2de2-48fe-acb8-23b48a2e326b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:58.348977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5344b6-15ed-4971-9d88-dd11d95f0203 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:58.391319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca92ee1-5ee6-4fa1-9b2d-ee21a5ce9868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:58.392143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca92ee1-5ee6-4fa1-9b2d-ee21a5ce9868 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:58.392491 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca92ee1-5ee6-4fa1-9b2d-ee21a5ce9868 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:58.392774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca92ee1-5ee6-4fa1-9b2d-ee21a5ce9868 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:58.401797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca92ee1-5ee6-4fa1-9b2d-ee21a5ce9868 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:58.403708 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca92ee1-5ee6-4fa1-9b2d-ee21a5ce9868 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:58.407822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a392109-2de2-48fe-acb8-23b48a2e326b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-0ca92ee1-5ee6-4fa1-9b2d-ee21a5ce9868 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:58.418910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:58.420099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:58.421176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:58.421176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:58.421176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:58.421176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:58.421176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:58.421176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:58.421176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:58.421176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:58.421176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 331/681] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:58.423763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5946a4-d7f8-40f9-8e24-7fb6d81761e2 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:58.424382 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5946a4-d7f8-40f9-8e24-7fb6d81761e2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:58.424818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5946a4-d7f8-40f9-8e24-7fb6d81761e2 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:58.426692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 332/682] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:58.427585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5946a4-d7f8-40f9-8e24-7fb6d81761e2 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:58.447768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcce393-ce10-4933-b31e-a4eb74a58c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:58.448491 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce393-ce10-4933-b31e-a4eb74a58c58 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:58.448974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce393-ce10-4933-b31e-a4eb74a58c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:58.449442 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcce393-ce10-4933-b31e-a4eb74a58c58 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:58.451808 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcce393-ce10-4933-b31e-a4eb74a58c58 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:58.451808 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcce393-ce10-4933-b31e-a4eb74a58c58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:58.453548 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcce393-ce10-4933-b31e-a4eb74a58c58 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:58.475710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 351/683] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Jul 20 22:27:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:58.481876 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7029f-a6a0-4bed-9dec-99fc9e08a675 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:58.482490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7029f-a6a0-4bed-9dec-99fc9e08a675 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:58.483443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7029f-a6a0-4bed-9dec-99fc9e08a675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:58.492798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:58.507043 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-89a7029f-a6a0-4bed-9dec-99fc9e08a675 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:58.518154 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-89a7029f-a6a0-4bed-9dec-99fc9e08a675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:58.559500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:58.569283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5946a4-d7f8-40f9-8e24-7fb6d81761e2 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:58.586128 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 352/684] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:58.587359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7029f-a6a0-4bed-9dec-99fc9e08a675 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:58.625558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e9091-3c33-4f00-a4d1-d035c804f05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:58.625558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e9091-3c33-4f00-a4d1-d035c804f05a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:58.625558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e9091-3c33-4f00-a4d1-d035c804f05a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:58.625558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e9091-3c33-4f00-a4d1-d035c804f05a None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:58.629419 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e9091-3c33-4f00-a4d1-d035c804f05a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:58.629419 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e9091-3c33-4f00-a4d1-d035c804f05a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:58.629419 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e9091-3c33-4f00-a4d1-d035c804f05a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:58.645819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 333/685] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:58.646791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e9091-3c33-4f00-a4d1-d035c804f05a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:58.719702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7029f-a6a0-4bed-9dec-99fc9e08a675 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:58.770874 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e9091-3c33-4f00-a4d1-d035c804f05a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:58.772105 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8a004-51b3-41a6-9a8b-64ecb06a7506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:58.773781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8a004-51b3-41a6-9a8b-64ecb06a7506 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:58.774119 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8a004-51b3-41a6-9a8b-64ecb06a7506 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:58.778003 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8a004-51b3-41a6-9a8b-64ecb06a7506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:58.781218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:58.807556 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b80a99-5904-4684-859e-4764d9244266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:58.808202 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80a99-5904-4684-859e-4764d9244266 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:58.808814 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80a99-5904-4684-859e-4764d9244266 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:58.809191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b80a99-5904-4684-859e-4764d9244266 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:58.822165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b80a99-5904-4684-859e-4764d9244266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-30b80a99-5904-4684-859e-4764d9244266 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:27:58.831429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:58.832497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:58.833373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:58.833373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:58.833373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:58.833373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:58.833373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:27:58.833373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:27:58.833373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:27:58.833373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:27:58.833373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:27:58.833373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:27:58.833373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:27:58.833373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:58.837665 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 334/686] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:27:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:58.838539 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b80a99-5904-4684-859e-4764d9244266 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:58.841745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:58.878938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8a004-51b3-41a6-9a8b-64ecb06a7506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:58.880437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8a004-51b3-41a6-9a8b-64ecb06a7506 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:58.961274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b80a99-5904-4684-859e-4764d9244266 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:59.005748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a9ff6d-0138-4e25-a659-1f83a3776517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:59.005748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9ff6d-0138-4e25-a659-1f83a3776517 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:59.005748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9ff6d-0138-4e25-a659-1f83a3776517 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:59.005748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a9ff6d-0138-4e25-a659-1f83a3776517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:59.006203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9ff6d-0138-4e25-a659-1f83a3776517 None admin] RBAC: Adding query filter params (role.id=2a5f2a34d0b341e58b642fc48dc7c5da, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=d3faac5703c54396bcdba9e149a6d35e) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:59.006203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9ff6d-0138-4e25-a659-1f83a3776517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:59.006203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a9ff6d-0138-4e25-a659-1f83a3776517 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:59.014376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 353/687] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:27:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:27:59.014376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8a004-51b3-41a6-9a8b-64ecb06a7506 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:59.021666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 335/688] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:27:58 2022] GET /identity/v3/role_assignments?user.id=d3faac5703c54396bcdba9e149a6d35e&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=2a5f2a34d0b341e58b642fc48dc7c5da => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:59.023261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778fdee-7ea8-49dc-ad0a-ca3f27ef4f66 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:59.023751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778fdee-7ea8-49dc-ad0a-ca3f27ef4f66 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:59.024251 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778fdee-7ea8-49dc-ad0a-ca3f27ef4f66 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:59.025762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 336/689] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:27:59.026712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778fdee-7ea8-49dc-ad0a-ca3f27ef4f66 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:59.064089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:59.147197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778fdee-7ea8-49dc-ad0a-ca3f27ef4f66 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:59.187199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20169270-ab01-48ba-9d6e-9decfe2c7cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:59.188414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20169270-ab01-48ba-9d6e-9decfe2c7cde None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:59.188901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20169270-ab01-48ba-9d6e-9decfe2c7cde None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:59.189376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20169270-ab01-48ba-9d6e-9decfe2c7cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:59.213457 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20169270-ab01-48ba-9d6e-9decfe2c7cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:59.215103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20169270-ab01-48ba-9d6e-9decfe2c7cde None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:59.218479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-20169270-ab01-48ba-9d6e-9decfe2c7cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:59.243006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:59.243986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:59.244893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:59.244893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:59.244893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:59.244893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:59.249100 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 337/690] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:59.253321 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8a004-51b3-41a6-9a8b-64ecb06a7506 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:59.254005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb4b19-5228-4378-8bdd-a449b6690e0d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:59.254301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb4b19-5228-4378-8bdd-a449b6690e0d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:59.254581 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb4b19-5228-4378-8bdd-a449b6690e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:59.274985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4eeb4b19-5228-4378-8bdd-a449b6690e0d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:27:59.276523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4eeb4b19-5228-4378-8bdd-a449b6690e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:27:59.308329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3c1a1-2f8c-405a-837b-1e681b270328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:59.309265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3c1a1-2f8c-405a-837b-1e681b270328 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:59.309684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3c1a1-2f8c-405a-837b-1e681b270328 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:59.310327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3c1a1-2f8c-405a-837b-1e681b270328 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:59.311222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3c1a1-2f8c-405a-837b-1e681b270328 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:59.311536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3c1a1-2f8c-405a-837b-1e681b270328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:59.312935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3c1a1-2f8c-405a-837b-1e681b270328 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:59.324486 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 354/691] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:27:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:59.325328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3c1a1-2f8c-405a-837b-1e681b270328 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:59.376430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 338/692] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:27:59.377780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb4b19-5228-4378-8bdd-a449b6690e0d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:59.394779 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:59.475608 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3c1a1-2f8c-405a-837b-1e681b270328 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:59.488933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb4b19-5228-4378-8bdd-a449b6690e0d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:59.522339 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a6d88-4135-45d5-a4f3-d730fc7ebe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:59.523178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a6d88-4135-45d5-a4f3-d730fc7ebe84 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:59.523556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a6d88-4135-45d5-a4f3-d730fc7ebe84 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:59.523840 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a6d88-4135-45d5-a4f3-d730fc7ebe84 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:59.524681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a6d88-4135-45d5-a4f3-d730fc7ebe84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:59.524989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a6d88-4135-45d5-a4f3-d730fc7ebe84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:59.526536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a6d88-4135-45d5-a4f3-d730fc7ebe84 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:59.529166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b320b8a-f128-4032-9da1-79b8ab6f4bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:59.530587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320b8a-f128-4032-9da1-79b8ab6f4bac None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:59.531147 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320b8a-f128-4032-9da1-79b8ab6f4bac None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:59.531639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b320b8a-f128-4032-9da1-79b8ab6f4bac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:59.536389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:59.540379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 355/693] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:59.541755 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a6d88-4135-45d5-a4f3-d730fc7ebe84 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:59.547144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b320b8a-f128-4032-9da1-79b8ab6f4bac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:59.549167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b320b8a-f128-4032-9da1-79b8ab6f4bac None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-8b320b8a-f128-4032-9da1-79b8ab6f4bac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:59.572588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:59.573701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:59.574679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:59.574679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:59.574679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:59.574679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:59.578071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 339/694] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:59.579139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b320b8a-f128-4032-9da1-79b8ab6f4bac None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:59.664222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a6d88-4135-45d5-a4f3-d730fc7ebe84 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:59.667692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:59.704473 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdd797-983a-4681-99ac-76a6dd0cc25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:59.705549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd797-983a-4681-99ac-76a6dd0cc25a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:59.706086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd797-983a-4681-99ac-76a6dd0cc25a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:59.706605 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bdd797-983a-4681-99ac-76a6dd0cc25a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:59.710003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b320b8a-f128-4032-9da1-79b8ab6f4bac None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:59.718160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdd797-983a-4681-99ac-76a6dd0cc25a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:59.719967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bdd797-983a-4681-99ac-76a6dd0cc25a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f2bdd797-983a-4681-99ac-76a6dd0cc25a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:27:59.741267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:59.742415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:59.743553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:27:59.743553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:27:59.743553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:27:59.743553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:27:59.745205 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 356/695] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:59.746237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdd797-983a-4681-99ac-76a6dd0cc25a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:59.749608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22a8bd-7bea-4824-a2fa-e345e25c64c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:59.750847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22a8bd-7bea-4824-a2fa-e345e25c64c5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:59.752122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22a8bd-7bea-4824-a2fa-e345e25c64c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:59.752574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22a8bd-7bea-4824-a2fa-e345e25c64c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:59.761380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22a8bd-7bea-4824-a2fa-e345e25c64c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:59.763670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22a8bd-7bea-4824-a2fa-e345e25c64c5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-cc22a8bd-7bea-4824-a2fa-e345e25c64c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:27:59.782395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:27:59.783436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:27:59.784461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:27:59.784461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:27:59.784461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:27:59.784461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:27:59.784461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:27:59.784461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:27:59.784461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:27:59.784461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:27:59.787365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 340/696] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:27:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:27:59.788341 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22a8bd-7bea-4824-a2fa-e345e25c64c5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:59.806489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:59.861932 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bdd797-983a-4681-99ac-76a6dd0cc25a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:59.906755 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d3716-c44e-4ab2-bddd-e8247ee720fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:59.907975 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d3716-c44e-4ab2-bddd-e8247ee720fa None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:59.908649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d3716-c44e-4ab2-bddd-e8247ee720fa None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:59.909081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d3716-c44e-4ab2-bddd-e8247ee720fa None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:59.910682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d3716-c44e-4ab2-bddd-e8247ee720fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:59.911177 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d3716-c44e-4ab2-bddd-e8247ee720fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:59.913540 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d3716-c44e-4ab2-bddd-e8247ee720fa None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:59.917881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22a8bd-7bea-4824-a2fa-e345e25c64c5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:27:59.931503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 357/697] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:59.931503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d3716-c44e-4ab2-bddd-e8247ee720fa None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:27:59.958477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:27:59.974425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcac9a-4467-43d0-9d8f-686219885d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:27:59.975099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcac9a-4467-43d0-9d8f-686219885d77 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:27:59.975379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcac9a-4467-43d0-9d8f-686219885d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:27:59.975645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfcac9a-4467-43d0-9d8f-686219885d77 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:27:59.976377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfcac9a-4467-43d0-9d8f-686219885d77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:27:59.976678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfcac9a-4467-43d0-9d8f-686219885d77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:27:59.978318 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfcac9a-4467-43d0-9d8f-686219885d77 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:27:59.991804 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 341/698] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:27:59.992817 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcac9a-4467-43d0-9d8f-686219885d77 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:00.057428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d3716-c44e-4ab2-bddd-e8247ee720fa None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:00.072991 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:00.097533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e607aa1-2cc7-4baa-93a5-d6e24ed32f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:00.098085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e607aa1-2cc7-4baa-93a5-d6e24ed32f7a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:00.098374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e607aa1-2cc7-4baa-93a5-d6e24ed32f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:00.098644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e607aa1-2cc7-4baa-93a5-d6e24ed32f7a None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:00.099435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e607aa1-2cc7-4baa-93a5-d6e24ed32f7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:00.099744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e607aa1-2cc7-4baa-93a5-d6e24ed32f7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:00.101178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e607aa1-2cc7-4baa-93a5-d6e24ed32f7a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:00.113193 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfcac9a-4467-43d0-9d8f-686219885d77 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:00.115049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 358/699] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:27:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:00.116181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e607aa1-2cc7-4baa-93a5-d6e24ed32f7a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:00.162742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1c317-9d48-496f-b5b6-e905aa9ec476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:00.163608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1c317-9d48-496f-b5b6-e905aa9ec476 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:00.163893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1c317-9d48-496f-b5b6-e905aa9ec476 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:00.164171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1c317-9d48-496f-b5b6-e905aa9ec476 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:00.175851 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1c317-9d48-496f-b5b6-e905aa9ec476 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:00.177715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1c317-9d48-496f-b5b6-e905aa9ec476 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-82c1c317-9d48-496f-b5b6-e905aa9ec476 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:00.198976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:00.200019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:00.201071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:00.201071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:00.201071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:00.201071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:00.201071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:00.201071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:00.201071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:00.201071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:00.201071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:28:00.201071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:00.205955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 342/700] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 20 22:27:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:00.206891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1c317-9d48-496f-b5b6-e905aa9ec476 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:00.233939 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e607aa1-2cc7-4baa-93a5-d6e24ed32f7a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:00.268733 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:00.277293 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2de8d-2181-44b7-9f7f-5e39f8184d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:00.280708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2de8d-2181-44b7-9f7f-5e39f8184d27 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:00.280708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2de8d-2181-44b7-9f7f-5e39f8184d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:00.280708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2de8d-2181-44b7-9f7f-5e39f8184d27 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:00.280708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2de8d-2181-44b7-9f7f-5e39f8184d27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:00.281869 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2de8d-2181-44b7-9f7f-5e39f8184d27 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:00.325133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1c317-9d48-496f-b5b6-e905aa9ec476 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:00.362780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec45cc-0dce-4c64-955d-b74a9437e339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:00.363462 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec45cc-0dce-4c64-955d-b74a9437e339 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:00.363744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec45cc-0dce-4c64-955d-b74a9437e339 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:00.364017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec45cc-0dce-4c64-955d-b74a9437e339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:00.364870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec45cc-0dce-4c64-955d-b74a9437e339 None admin] RBAC: Adding query filter params (role.id=2a5f2a34d0b341e58b642fc48dc7c5da, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=146610a7cbbc46928a4a8d710c4d1942) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:00.365184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec45cc-0dce-4c64-955d-b74a9437e339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:00.366927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec45cc-0dce-4c64-955d-b74a9437e339 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:00.381870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 343/701] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:28:00 2022] GET /identity/v3/role_assignments?user.id=146610a7cbbc46928a4a8d710c4d1942&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=2a5f2a34d0b341e58b642fc48dc7c5da => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:00.381870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec45cc-0dce-4c64-955d-b74a9437e339 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:00.455284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 359/702] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:28:00 2022] POST /identity/v3/users => generated 254 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:28:00.514872 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec45cc-0dce-4c64-955d-b74a9437e339 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:00.529520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:00.558194 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b68e30-f437-4001-8322-a8a50634d520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:00.558893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b68e30-f437-4001-8322-a8a50634d520 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:00.559172 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b68e30-f437-4001-8322-a8a50634d520 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:00.559441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b68e30-f437-4001-8322-a8a50634d520 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:00.560374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b68e30-f437-4001-8322-a8a50634d520 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:00.561393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b68e30-f437-4001-8322-a8a50634d520 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:00.564111 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b68e30-f437-4001-8322-a8a50634d520 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:00.583794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 344/703] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 20 22:28:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:00.589466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2de8d-2181-44b7-9f7f-5e39f8184d27 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:00.595128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372e49d-352e-4526-b1d8-268902f70e0a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:00.595128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372e49d-352e-4526-b1d8-268902f70e0a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:00.595509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372e49d-352e-4526-b1d8-268902f70e0a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:00.597136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 345/704] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:00.608568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee0375-9cd1-4f98-bff8-e14249ce3be1 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:00.615606 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee0375-9cd1-4f98-bff8-e14249ce3be1 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:00.615606 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee0375-9cd1-4f98-bff8-e14249ce3be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:00.631367 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:00.633281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a0ee0375-9cd1-4f98-bff8-e14249ce3be1 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:00.634843 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a0ee0375-9cd1-4f98-bff8-e14249ce3be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:00.722654 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2de8d-2181-44b7-9f7f-5e39f8184d27 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:00.724124 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 346/705] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:28:00.748132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee0375-9cd1-4f98-bff8-e14249ce3be1 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:00.766453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994de0e-fe73-4156-bd33-5444de35ce61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:00.767457 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994de0e-fe73-4156-bd33-5444de35ce61 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:00.767969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994de0e-fe73-4156-bd33-5444de35ce61 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:00.768463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3994de0e-fe73-4156-bd33-5444de35ce61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:00.852061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994de0e-fe73-4156-bd33-5444de35ce61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:00.854155 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3994de0e-fe73-4156-bd33-5444de35ce61 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:00.861413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:00.865833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee0375-9cd1-4f98-bff8-e14249ce3be1 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:00.884311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:00.901988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edee6c-f214-4910-8cab-77a1be6c4e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:00.902860 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edee6c-f214-4910-8cab-77a1be6c4e6b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:00.903142 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edee6c-f214-4910-8cab-77a1be6c4e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:00.903413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edee6c-f214-4910-8cab-77a1be6c4e6b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:00.904678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edee6c-f214-4910-8cab-77a1be6c4e6b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:00.906777 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edee6c-f214-4910-8cab-77a1be6c4e6b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-d0edee6c-f214-4910-8cab-77a1be6c4e6b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:00.921751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:00.922794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 22:28:00.923683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:00.927897 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 347/706] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Jul 20 22:28:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:00.929183 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edee6c-f214-4910-8cab-77a1be6c4e6b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:00.967276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 360/707] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 22:28:00.972535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994de0e-fe73-4156-bd33-5444de35ce61 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:01.063373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edee6c-f214-4910-8cab-77a1be6c4e6b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:01.101785 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3994de0e-fe73-4156-bd33-5444de35ce61 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:01.116380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b79c59-4bf0-4486-93ce-66a794e8a29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:01.117156 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b79c59-4bf0-4486-93ce-66a794e8a29c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:01.133039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b79c59-4bf0-4486-93ce-66a794e8a29c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:01.133039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b79c59-4bf0-4486-93ce-66a794e8a29c None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:01.133039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b79c59-4bf0-4486-93ce-66a794e8a29c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:01.133039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b79c59-4bf0-4486-93ce-66a794e8a29c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:01.133039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b79c59-4bf0-4486-93ce-66a794e8a29c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:01.133039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 348/708] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Jul 20 22:28:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:01.133560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b79c59-4bf0-4486-93ce-66a794e8a29c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:01.135934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:01.155797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a5fe6-64fc-4bbf-9e88-8b5b1dc79ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:01.156921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a5fe6-64fc-4bbf-9e88-8b5b1dc79ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:01.157357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a5fe6-64fc-4bbf-9e88-8b5b1dc79ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:01.157869 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a5fe6-64fc-4bbf-9e88-8b5b1dc79ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:01.179996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a5fe6-64fc-4bbf-9e88-8b5b1dc79ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:01.181499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a5fe6-64fc-4bbf-9e88-8b5b1dc79ec9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:01.196700 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-779a5fe6-64fc-4bbf-9e88-8b5b1dc79ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:01.214855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:01.216222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:01.218320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:01.218320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:01.218320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:01.218320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:01.221622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 361/709] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:01.226759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a5fe6-64fc-4bbf-9e88-8b5b1dc79ec9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:01.349833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b79c59-4bf0-4486-93ce-66a794e8a29c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:01.350038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a5fe6-64fc-4bbf-9e88-8b5b1dc79ec9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:01.384372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820072db-01d4-47fa-a4db-18ded30f1450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:01.385101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820072db-01d4-47fa-a4db-18ded30f1450 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:01.385396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820072db-01d4-47fa-a4db-18ded30f1450 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:01.385856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820072db-01d4-47fa-a4db-18ded30f1450 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:01.386451 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820072db-01d4-47fa-a4db-18ded30f1450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:01.386818 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820072db-01d4-47fa-a4db-18ded30f1450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:01.388389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820072db-01d4-47fa-a4db-18ded30f1450 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:01.401441 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 362/710] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:01.409244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820072db-01d4-47fa-a4db-18ded30f1450 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:01.411581 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c4714-7d7b-466a-9207-ce944619a55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:01.412435 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c4714-7d7b-466a-9207-ce944619a55a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:01.412724 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c4714-7d7b-466a-9207-ce944619a55a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:01.412999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c4714-7d7b-466a-9207-ce944619a55a None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:01.413762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c4714-7d7b-466a-9207-ce944619a55a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:01.414050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c4714-7d7b-466a-9207-ce944619a55a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:01.416312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34c4714-7d7b-466a-9207-ce944619a55a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:01.423300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 349/711] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Jul 20 22:28:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:01.466266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed96b8-d7f1-41f6-a7c1-2c9c055c2151 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:01.467009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed96b8-d7f1-41f6-a7c1-2c9c055c2151 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:01.467009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed96b8-d7f1-41f6-a7c1-2c9c055c2151 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:01.468511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 350/712] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:01.475322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216def93-7c05-411c-87ec-b41d7ae7abea None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:01.475674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216def93-7c05-411c-87ec-b41d7ae7abea None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:01.475885 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216def93-7c05-411c-87ec-b41d7ae7abea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:01.478407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:01.511045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-216def93-7c05-411c-87ec-b41d7ae7abea None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:01.512552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-216def93-7c05-411c-87ec-b41d7ae7abea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:01.566313 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820072db-01d4-47fa-a4db-18ded30f1450 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:01.603490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b95b7-e14f-4dcf-8609-a51474c624fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:01.604220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b95b7-e14f-4dcf-8609-a51474c624fc None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:01.604508 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b95b7-e14f-4dcf-8609-a51474c624fc None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:01.604790 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b95b7-e14f-4dcf-8609-a51474c624fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:01.613830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b95b7-e14f-4dcf-8609-a51474c624fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:01.615298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b95b7-e14f-4dcf-8609-a51474c624fc None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-f52b95b7-e14f-4dcf-8609-a51474c624fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:01.635764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:01.636826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:01.637855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:01.637855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:01.637855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:01.637855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:01.637855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:01.637855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:01.637855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:01.637855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:01.641749 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 363/713] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:01.646027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b95b7-e14f-4dcf-8609-a51474c624fc None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:01.680975 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 351/714] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:28:01.709546 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216def93-7c05-411c-87ec-b41d7ae7abea None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:01.737484 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:01.780365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:01.783266 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b95b7-e14f-4dcf-8609-a51474c624fc None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:01.840399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216def93-7c05-411c-87ec-b41d7ae7abea None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:01.879517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf2dff-d10b-49cf-be39-1db996748095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:01.880153 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf2dff-d10b-49cf-be39-1db996748095 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:01.880542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf2dff-d10b-49cf-be39-1db996748095 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:01.880890 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf2dff-d10b-49cf-be39-1db996748095 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:01.881780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf2dff-d10b-49cf-be39-1db996748095 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:01.882176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf2dff-d10b-49cf-be39-1db996748095 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:01.883695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf2dff-d10b-49cf-be39-1db996748095 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:01.894566 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab4540-7045-4fee-8a41-1f7dae32a941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:01.895737 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4540-7045-4fee-8a41-1f7dae32a941 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:01.896230 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4540-7045-4fee-8a41-1f7dae32a941 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:01.896776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab4540-7045-4fee-8a41-1f7dae32a941 None admin] PATH_INFO: `/v3/services/network` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:01.897786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab4540-7045-4fee-8a41-1f7dae32a941 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:01.899476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab4540-7045-4fee-8a41-1f7dae32a941 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:01.910016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 364/715] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:01.912812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf2dff-d10b-49cf-be39-1db996748095 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-a4ab4540-7045-4fee-8a41-1f7dae32a941 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:01.923309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:01.941887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:01.942773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 352/716] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:01 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:01.943589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab4540-7045-4fee-8a41-1f7dae32a941 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:02.030478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:02.047825 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab4540-7045-4fee-8a41-1f7dae32a941 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:02.095510 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae790996-9951-46bc-b95f-bbd64db967e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:02.096199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790996-9951-46bc-b95f-bbd64db967e7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:02.096479 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790996-9951-46bc-b95f-bbd64db967e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:02.096756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790996-9951-46bc-b95f-bbd64db967e7 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:02.097478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae790996-9951-46bc-b95f-bbd64db967e7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:02.101626 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf2dff-d10b-49cf-be39-1db996748095 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:02.102015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae790996-9951-46bc-b95f-bbd64db967e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:02.103660 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae790996-9951-46bc-b95f-bbd64db967e7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:02.113760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 353/717] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 20 22:28:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:02.119281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae790996-9951-46bc-b95f-bbd64db967e7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:02.183600 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156de9a-fffd-4289-a31e-4a7d27978226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:02.184279 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156de9a-fffd-4289-a31e-4a7d27978226 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:02.184563 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156de9a-fffd-4289-a31e-4a7d27978226 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:02.184838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156de9a-fffd-4289-a31e-4a7d27978226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:02.187086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156de9a-fffd-4289-a31e-4a7d27978226 None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=67c92c8d2b9d41e489e4c03ae4e71fe2) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:02.187086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156de9a-fffd-4289-a31e-4a7d27978226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:02.188013 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156de9a-fffd-4289-a31e-4a7d27978226 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:02.208677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 365/718] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:28:01 2022] GET /identity/v3/role_assignments?user.id=67c92c8d2b9d41e489e4c03ae4e71fe2&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:02.275978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae790996-9951-46bc-b95f-bbd64db967e7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:02.317422 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a9258-d212-414c-855e-a06f15b4c14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:02.318150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a9258-d212-414c-855e-a06f15b4c14f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:02.318434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a9258-d212-414c-855e-a06f15b4c14f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:02.318712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a9258-d212-414c-855e-a06f15b4c14f None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:02.319517 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a9258-d212-414c-855e-a06f15b4c14f None admin] RBAC: Adding query filter params (type=network) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:02.319832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a9258-d212-414c-855e-a06f15b4c14f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:02.321306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a9258-d212-414c-855e-a06f15b4c14f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:02.327501 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 354/719] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 20 22:28:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:03.104099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e38c-ed48-43c4-902e-896cd22ca5ab None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:03.104657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e38c-ed48-43c4-902e-896cd22ca5ab None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:03.104657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815e38c-ed48-43c4-902e-896cd22ca5ab None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:03.106328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 366/720] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:03.112264 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde277f7-c4c4-4a56-80d0-3ff03673453e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:03.112697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde277f7-c4c4-4a56-80d0-3ff03673453e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:03.112892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde277f7-c4c4-4a56-80d0-3ff03673453e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:03.139622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-cde277f7-c4c4-4a56-80d0-3ff03673453e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:03.140513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cde277f7-c4c4-4a56-80d0-3ff03673453e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:03.148738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:03.230436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 355/721] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:28:03.230924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47a5be-429f-47d9-b544-9430b0ddc9be None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:03.231411 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47a5be-429f-47d9-b544-9430b0ddc9be None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:03.231880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f47a5be-429f-47d9-b544-9430b0ddc9be None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:03.234411 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 367/722] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:03.239639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741dca0-bbaa-49f3-8f02-feac12abcb44 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:03.240141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741dca0-bbaa-49f3-8f02-feac12abcb44 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:03.240612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741dca0-bbaa-49f3-8f02-feac12abcb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:03.258229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8741dca0-bbaa-49f3-8f02-feac12abcb44 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:03.259740 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8741dca0-bbaa-49f3-8f02-feac12abcb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:03.272761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47a5be-429f-47d9-b544-9430b0ddc9be None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:03.319106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:03.398930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 356/723] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:28:03.425422 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741dca0-bbaa-49f3-8f02-feac12abcb44 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:03.479872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f47a5be-429f-47d9-b544-9430b0ddc9be None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:03.544055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bd647-0568-4744-901d-75bcca349189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:03.546427 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bd647-0568-4744-901d-75bcca349189 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:03.548018 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bd647-0568-4744-901d-75bcca349189 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:03.548502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bd647-0568-4744-901d-75bcca349189 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:03.551398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:03.573022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bd647-0568-4744-901d-75bcca349189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-6f9bd647-0568-4744-901d-75bcca349189 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:03.588659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:03.589660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:03.590578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:03.590578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:03.590578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:03.590578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:03.590578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:03.590578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:03.590578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:03.590578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:03.590578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:03.590578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:03.590578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:03.590578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:03.595812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 368/724] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:28:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:03.602884 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bd647-0568-4744-901d-75bcca349189 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:03.616330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741dca0-bbaa-49f3-8f02-feac12abcb44 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:03.679530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca9e58-2f2c-4391-bdb6-2c291c799d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:03.680355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca9e58-2f2c-4391-bdb6-2c291c799d32 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:03.680636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca9e58-2f2c-4391-bdb6-2c291c799d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:03.680910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca9e58-2f2c-4391-bdb6-2c291c799d32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:03.706817 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca9e58-2f2c-4391-bdb6-2c291c799d32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-9dca9e58-2f2c-4391-bdb6-2c291c799d32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:03.715022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:03.717426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:03.718423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:03.718423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:03.718423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:03.718423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:03.718423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:03.718423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:03.718423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:03.718423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:03.718423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:03.718423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:03.718423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:28:03.718423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:03.723661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:03.724372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 357/725] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:28:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:03.730578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca9e58-2f2c-4391-bdb6-2c291c799d32 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:03.739343 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bd647-0568-4744-901d-75bcca349189 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:03.774419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61ffae-67f0-4c1c-be62-2ccc117f9bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:03.775176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61ffae-67f0-4c1c-be62-2ccc117f9bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:03.775460 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61ffae-67f0-4c1c-be62-2ccc117f9bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:03.775741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61ffae-67f0-4c1c-be62-2ccc117f9bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:03.776489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61ffae-67f0-4c1c-be62-2ccc117f9bf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:03.776796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61ffae-67f0-4c1c-be62-2ccc117f9bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:03.778341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e61ffae-67f0-4c1c-be62-2ccc117f9bf6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:03.788072 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 369/726] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:28:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:03.796194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61ffae-67f0-4c1c-be62-2ccc117f9bf6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:03.913225 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61ffae-67f0-4c1c-be62-2ccc117f9bf6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:03.937127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca9e58-2f2c-4391-bdb6-2c291c799d32 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:03.954834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ddb8d-4c0d-4c5e-a059-d664c3f5c90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:03.955641 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ddb8d-4c0d-4c5e-a059-d664c3f5c90e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:03.955920 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ddb8d-4c0d-4c5e-a059-d664c3f5c90e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:03.956194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ddb8d-4c0d-4c5e-a059-d664c3f5c90e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:03.974378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ddb8d-4c0d-4c5e-a059-d664c3f5c90e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:03.975826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ddb8d-4c0d-4c5e-a059-d664c3f5c90e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:03.988672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:03.996893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-708ddb8d-4c0d-4c5e-a059-d664c3f5c90e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:04.002892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:04.003817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:04.004785 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:04.004785 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:04.004785 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:04.004785 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:04.004785 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 370/727] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:04.008321 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ddb8d-4c0d-4c5e-a059-d664c3f5c90e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:04.012010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72090909-c4ed-48a2-af6a-d8a159407395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:04.012734 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090909-c4ed-48a2-af6a-d8a159407395 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:04.013015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090909-c4ed-48a2-af6a-d8a159407395 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:04.013311 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72090909-c4ed-48a2-af6a-d8a159407395 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:04.014187 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72090909-c4ed-48a2-af6a-d8a159407395 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:04.014398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72090909-c4ed-48a2-af6a-d8a159407395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:04.020479 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72090909-c4ed-48a2-af6a-d8a159407395 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:04.039208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 358/728] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:28:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:04.044026 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72090909-c4ed-48a2-af6a-d8a159407395 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:04.184273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72090909-c4ed-48a2-af6a-d8a159407395 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:04.208247 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ddb8d-4c0d-4c5e-a059-d664c3f5c90e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:04.219667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c906ad91-dba7-42fb-b404-0f5bac4caeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:04.220475 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ad91-dba7-42fb-b404-0f5bac4caeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:04.220757 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ad91-dba7-42fb-b404-0f5bac4caeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:04.221032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c906ad91-dba7-42fb-b404-0f5bac4caeb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:04.231796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906ad91-dba7-42fb-b404-0f5bac4caeb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:04.234268 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c906ad91-dba7-42fb-b404-0f5bac4caeb7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:04.245738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a6173-6e3f-4043-bfee-9636b7eabecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:04.246429 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a6173-6e3f-4043-bfee-9636b7eabecd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:04.246706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a6173-6e3f-4043-bfee-9636b7eabecd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:04.246977 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a6173-6e3f-4043-bfee-9636b7eabecd None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:04.247768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a6173-6e3f-4043-bfee-9636b7eabecd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:04.248563 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a6173-6e3f-4043-bfee-9636b7eabecd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:04.250050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a6173-6e3f-4043-bfee-9636b7eabecd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-c906ad91-dba7-42fb-b404-0f5bac4caeb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:04.253049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:04.253976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:04.254918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:04.254918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:04.254918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:04.254918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:04.254918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 359/729] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:04.259856 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc9b92-e8da-43a6-ba29-3e666e15a954 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:04.259856 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc9b92-e8da-43a6-ba29-3e666e15a954 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:04.259856 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc9b92-e8da-43a6-ba29-3e666e15a954 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:04.261675 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 360/730] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:04.262478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc9b92-e8da-43a6-ba29-3e666e15a954 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:04.263311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 371/731] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:04.268014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff452c-826a-41d2-9892-d4d7e6af9f61 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:04.268357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff452c-826a-41d2-9892-d4d7e6af9f61 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:04.268635 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dff452c-826a-41d2-9892-d4d7e6af9f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:04.286943 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8dff452c-826a-41d2-9892-d4d7e6af9f61 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:04.288147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8dff452c-826a-41d2-9892-d4d7e6af9f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:04.313271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:04.349125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:04.364375 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 372/732] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 22:28:04.365496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff452c-826a-41d2-9892-d4d7e6af9f61 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:04.377380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc9b92-e8da-43a6-ba29-3e666e15a954 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:04.432634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73395265-2fb9-407d-8d83-8c3430107523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:04.433964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73395265-2fb9-407d-8d83-8c3430107523 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:04.434394 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73395265-2fb9-407d-8d83-8c3430107523 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:04.434957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73395265-2fb9-407d-8d83-8c3430107523 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:04.436850 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73395265-2fb9-407d-8d83-8c3430107523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:04.437573 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73395265-2fb9-407d-8d83-8c3430107523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:04.439655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73395265-2fb9-407d-8d83-8c3430107523 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:04.455913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 361/733] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:04.457098 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73395265-2fb9-407d-8d83-8c3430107523 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:04.487060 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dff452c-826a-41d2-9892-d4d7e6af9f61 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:04.530102 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd7e9c-53e0-4b68-b72d-0ef3b56d82b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:04.531324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd7e9c-53e0-4b68-b72d-0ef3b56d82b7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:04.531721 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd7e9c-53e0-4b68-b72d-0ef3b56d82b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:04.532093 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd7e9c-53e0-4b68-b72d-0ef3b56d82b7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:04.541177 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd7e9c-53e0-4b68-b72d-0ef3b56d82b7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:04.543572 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd7e9c-53e0-4b68-b72d-0ef3b56d82b7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a2cd7e9c-53e0-4b68-b72d-0ef3b56d82b7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:04.563212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:04.564433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:04.565645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:04.565645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:04.565645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:04.565645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:04.565645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:04.565645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:04.565645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:04.565645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:04.565645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 22:28:04.565645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:04.567566 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 373/734] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:28:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:04.568494 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd7e9c-53e0-4b68-b72d-0ef3b56d82b7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:04.589860 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73395265-2fb9-407d-8d83-8c3430107523 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:04.599304 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:04.630223 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:04.634096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec118b68-fd53-4476-b6a4-d1e8b95d2016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:04.636524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec118b68-fd53-4476-b6a4-d1e8b95d2016 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:04.636966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec118b68-fd53-4476-b6a4-d1e8b95d2016 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:04.637408 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec118b68-fd53-4476-b6a4-d1e8b95d2016 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:04.639375 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec118b68-fd53-4476-b6a4-d1e8b95d2016 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:04.641257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec118b68-fd53-4476-b6a4-d1e8b95d2016 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:04.685678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd7e9c-53e0-4b68-b72d-0ef3b56d82b7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:04.721529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba77a3-2da1-44a2-b384-1266d6553f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:04.722378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba77a3-2da1-44a2-b384-1266d6553f95 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:04.722727 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba77a3-2da1-44a2-b384-1266d6553f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:04.722932 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba77a3-2da1-44a2-b384-1266d6553f95 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:04.730630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba77a3-2da1-44a2-b384-1266d6553f95 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:04.732177 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba77a3-2da1-44a2-b384-1266d6553f95 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-faba77a3-2da1-44a2-b384-1266d6553f95 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:04.771774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:04.773131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:04.774165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:04.774165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:04.774165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:04.774165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:04.774165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:04.774165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:04.774165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:04.774165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:04.774165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 22:28:04.774165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:04.774165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 374/735] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Jul 20 22:28:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:04.774165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba77a3-2da1-44a2-b384-1266d6553f95 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:04.812945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 362/736] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 20 22:28:04 2022] POST /identity/v3/services => generated 251 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:28:04.815233 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec118b68-fd53-4476-b6a4-d1e8b95d2016 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:04.877153 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba77a3-2da1-44a2-b384-1266d6553f95 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:04.890899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:04.925757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52d3cc-53e7-43fa-ae6a-225d7e6733e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:04.926735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52d3cc-53e7-43fa-ae6a-225d7e6733e4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:04.927029 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52d3cc-53e7-43fa-ae6a-225d7e6733e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:04.927309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52d3cc-53e7-43fa-ae6a-225d7e6733e4 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:04.928182 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52d3cc-53e7-43fa-ae6a-225d7e6733e4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:04.928502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52d3cc-53e7-43fa-ae6a-225d7e6733e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:04.930008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52d3cc-53e7-43fa-ae6a-225d7e6733e4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:04.954839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 375/737] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Jul 20 22:28:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:04.955036 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec118b68-fd53-4476-b6a4-d1e8b95d2016 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:04.955164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda04df9-765f-4ea7-8cb2-814d712be4d9 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:04.955164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda04df9-765f-4ea7-8cb2-814d712be4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:04.955164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda04df9-765f-4ea7-8cb2-814d712be4d9 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:04.955164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 376/738] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:04.955164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c0d28-96c3-43c5-aa92-2f6d532f6ce6 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:04.955493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c0d28-96c3-43c5-aa92-2f6d532f6ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:04.955493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c0d28-96c3-43c5-aa92-2f6d532f6ce6 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:04.956898 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 377/739] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:04.960963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c0d28-96c3-43c5-aa92-2f6d532f6ce6 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:05.000005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e9a94-8e1d-4a4c-83e8-61bfc1ee7abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:05.000969 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e9a94-8e1d-4a4c-83e8-61bfc1ee7abc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:05.001258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e9a94-8e1d-4a4c-83e8-61bfc1ee7abc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:05.001539 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e9a94-8e1d-4a4c-83e8-61bfc1ee7abc None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:05.002613 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e9a94-8e1d-4a4c-83e8-61bfc1ee7abc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:05.002930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e9a94-8e1d-4a4c-83e8-61bfc1ee7abc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:05.004816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e9a94-8e1d-4a4c-83e8-61bfc1ee7abc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:05.027493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 363/740] 10.222.0.83 () {56 vars in 1149 bytes} [Wed Jul 20 22:28:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:05.029274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35686b01-3151-4c51-bc8e-85e72a5be0ea None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:05.029274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35686b01-3151-4c51-bc8e-85e72a5be0ea None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:05.029274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35686b01-3151-4c51-bc8e-85e72a5be0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:05.045497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-35686b01-3151-4c51-bc8e-85e72a5be0ea None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:05.046744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-35686b01-3151-4c51-bc8e-85e72a5be0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:05.066033 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:05.083975 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c0d28-96c3-43c5-aa92-2f6d532f6ce6 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:05.124060 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdcf61-a2da-4f7b-969b-3603cbfaa58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:05.124637 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdcf61-a2da-4f7b-969b-3603cbfaa58c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:05.124916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdcf61-a2da-4f7b-969b-3603cbfaa58c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:05.125199 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cdcf61-a2da-4f7b-969b-3603cbfaa58c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:05.130108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 364/741] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:28:05.131643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa11c93-e66d-4a0b-bd1e-eada1f4fcec6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:05.132117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa11c93-e66d-4a0b-bd1e-eada1f4fcec6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:05.132591 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa11c93-e66d-4a0b-bd1e-eada1f4fcec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:05.156926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-eaa11c93-e66d-4a0b-bd1e-eada1f4fcec6 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:05.158624 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-eaa11c93-e66d-4a0b-bd1e-eada1f4fcec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:05.169374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:05.208990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdcf61-a2da-4f7b-969b-3603cbfaa58c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:05.210492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cdcf61-a2da-4f7b-969b-3603cbfaa58c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:05.237109 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 365/742] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 22:28:05.237998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa11c93-e66d-4a0b-bd1e-eada1f4fcec6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:05.322120 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 378/743] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:28:04 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:28:05.322824 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdcf61-a2da-4f7b-969b-3603cbfaa58c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:05.333184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:05.350096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa11c93-e66d-4a0b-bd1e-eada1f4fcec6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:05.392084 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8d90c-9e47-4da4-844e-00b37fe98b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:05.392762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d90c-9e47-4da4-844e-00b37fe98b7e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:05.393043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d90c-9e47-4da4-844e-00b37fe98b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:05.393322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8d90c-9e47-4da4-844e-00b37fe98b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:05.394292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:05.434898 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cdcf61-a2da-4f7b-969b-3603cbfaa58c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:05.469426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8d90c-9e47-4da4-844e-00b37fe98b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:05.471207 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8d90c-9e47-4da4-844e-00b37fe98b7e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:05.474401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a82264-883b-4d47-a568-badd604e3221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:05.474598 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82264-883b-4d47-a568-badd604e3221 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:05.474874 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82264-883b-4d47-a568-badd604e3221 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:05.475147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a82264-883b-4d47-a568-badd604e3221 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:05.475894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a82264-883b-4d47-a568-badd604e3221 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:05.477251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a82264-883b-4d47-a568-badd604e3221 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:05.559645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:05.568767 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 379/744] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 20 22:28:05 2022] POST /identity/v3/services => generated 240 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:28:05.569969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a82264-883b-4d47-a568-badd604e3221 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:05.589081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 366/745] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:28:05 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 22:28:05.589978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8d90c-9e47-4da4-844e-00b37fe98b7e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:05.721096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8d90c-9e47-4da4-844e-00b37fe98b7e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:05.723643 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a82264-883b-4d47-a568-badd604e3221 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:05.744019 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:05.767485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfd31d-58f2-422a-aca3-f8b7968c1116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:05.767485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfd31d-58f2-422a-aca3-f8b7968c1116 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:05.767485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfd31d-58f2-422a-aca3-f8b7968c1116 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:05.767485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfd31d-58f2-422a-aca3-f8b7968c1116 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:05.769701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bc62e-abbc-44a3-9111-a9ce256baedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:05.770070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bc62e-abbc-44a3-9111-a9ce256baedc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:05.770175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bc62e-abbc-44a3-9111-a9ce256baedc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:05.770448 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bc62e-abbc-44a3-9111-a9ce256baedc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:05.780630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfd31d-58f2-422a-aca3-f8b7968c1116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:05.784783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bc62e-abbc-44a3-9111-a9ce256baedc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:05.787150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bc62e-abbc-44a3-9111-a9ce256baedc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-66dfd31d-58f2-422a-aca3-f8b7968c1116 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:05.788597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:05.789521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:05.790448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:05.790448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:05.790448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:05.790448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:05.790448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:05.790448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:05.790448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:05.790448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:05.790448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:05.790448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:05.790448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:05.790448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:05.790448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 380/746] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:28:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:05.791890 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfd31d-58f2-422a-aca3-f8b7968c1116 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-353bc62e-abbc-44a3-9111-a9ce256baedc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:05.811822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:05.812810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:05.813714 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:05.813714 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:05.813714 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:05.813714 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:05.814767 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 367/747] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:05.815155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bc62e-abbc-44a3-9111-a9ce256baedc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:05.873620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:05.927053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfd31d-58f2-422a-aca3-f8b7968c1116 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:05.953377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bc62e-abbc-44a3-9111-a9ce256baedc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:05.964580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7df31-0c09-4cd4-9043-f81fc73b2fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:05.965387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7df31-0c09-4cd4-9043-f81fc73b2fd3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:05.965672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7df31-0c09-4cd4-9043-f81fc73b2fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:05.965997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7df31-0c09-4cd4-9043-f81fc73b2fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:05.978431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7df31-0c09-4cd4-9043-f81fc73b2fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:05.980010 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d7df31-0c09-4cd4-9043-f81fc73b2fd3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:05.990818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792ebcc-a3a3-4595-8f91-e65461907601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:05.991622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792ebcc-a3a3-4595-8f91-e65461907601 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:05.991971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792ebcc-a3a3-4595-8f91-e65461907601 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:05.992335 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792ebcc-a3a3-4595-8f91-e65461907601 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:05.993166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792ebcc-a3a3-4595-8f91-e65461907601 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:05.993573 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792ebcc-a3a3-4595-8f91-e65461907601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:05.995271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792ebcc-a3a3-4595-8f91-e65461907601 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-00d7df31-0c09-4cd4-9043-f81fc73b2fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:05.999594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:06.001374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:06.003381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:06.003381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:06.003381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:06.003381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:06.003381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 381/748] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:06.003381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7df31-0c09-4cd4-9043-f81fc73b2fd3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:06.008519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 368/749] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:28:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:06.010750 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792ebcc-a3a3-4595-8f91-e65461907601 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:06.035422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:06.122362 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:06.126473 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792ebcc-a3a3-4595-8f91-e65461907601 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:06.131773 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d7df31-0c09-4cd4-9043-f81fc73b2fd3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:06.164458 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca853b2a-a2fa-440d-92c0-25435209e648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:06.165202 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca853b2a-a2fa-440d-92c0-25435209e648 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:06.165579 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca853b2a-a2fa-440d-92c0-25435209e648 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:06.166080 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca853b2a-a2fa-440d-92c0-25435209e648 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:06.166905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca853b2a-a2fa-440d-92c0-25435209e648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:06.167336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca853b2a-a2fa-440d-92c0-25435209e648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:06.168816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca853b2a-a2fa-440d-92c0-25435209e648 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:06.173872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5924174-0803-4ada-9da5-9b818c21d619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:06.174761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5924174-0803-4ada-9da5-9b818c21d619 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:06.175194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5924174-0803-4ada-9da5-9b818c21d619 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:06.175644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5924174-0803-4ada-9da5-9b818c21d619 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:06.176633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5924174-0803-4ada-9da5-9b818c21d619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:06.177092 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5924174-0803-4ada-9da5-9b818c21d619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:06.178729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5924174-0803-4ada-9da5-9b818c21d619 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:06.182674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 369/750] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:06.183581 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca853b2a-a2fa-440d-92c0-25435209e648 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:06.192371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 382/751] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:06.193585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5924174-0803-4ada-9da5-9b818c21d619 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:06.297341 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca853b2a-a2fa-440d-92c0-25435209e648 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:06.311894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:06.323061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5924174-0803-4ada-9da5-9b818c21d619 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:06.334211 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2865e0c-3831-4e24-b07d-af28293d80e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:06.335154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2865e0c-3831-4e24-b07d-af28293d80e0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:06.335446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2865e0c-3831-4e24-b07d-af28293d80e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:06.335727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2865e0c-3831-4e24-b07d-af28293d80e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:06.348351 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2865e0c-3831-4e24-b07d-af28293d80e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:06.350043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2865e0c-3831-4e24-b07d-af28293d80e0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:06.365083 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92501231-64f5-45dd-a9c4-1ea56cfce56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:06.366360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92501231-64f5-45dd-a9c4-1ea56cfce56a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:06.366841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92501231-64f5-45dd-a9c4-1ea56cfce56a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:06.367323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92501231-64f5-45dd-a9c4-1ea56cfce56a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e2865e0c-3831-4e24-b07d-af28293d80e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:06.369376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:06.370476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:06.371415 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:06.371415 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:06.371415 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:06.371415 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:06.375819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 370/752] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:06.376753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2865e0c-3831-4e24-b07d-af28293d80e0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:06.378611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92501231-64f5-45dd-a9c4-1ea56cfce56a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:06.380528 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92501231-64f5-45dd-a9c4-1ea56cfce56a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:06.391283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-92501231-64f5-45dd-a9c4-1ea56cfce56a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:06.397781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:06.398676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:06.399574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:06.399574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:06.399574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:06.399574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:06.399574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:06.399574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:06.399574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:06.399574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:06.401861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 383/753] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:06.402870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92501231-64f5-45dd-a9c4-1ea56cfce56a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:06.487715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2865e0c-3831-4e24-b07d-af28293d80e0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:06.518694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92501231-64f5-45dd-a9c4-1ea56cfce56a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:06.526788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516660e-14e4-4784-b027-758a8c65b356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:06.529689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516660e-14e4-4784-b027-758a8c65b356 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:06.529689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516660e-14e4-4784-b027-758a8c65b356 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:06.529921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516660e-14e4-4784-b027-758a8c65b356 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:06.537344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516660e-14e4-4784-b027-758a8c65b356 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:06.538913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516660e-14e4-4784-b027-758a8c65b356 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-6516660e-14e4-4784-b027-758a8c65b356 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:06.553429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:06.555377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:06.556461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:06.556461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:06.556461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:06.556461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:06.556461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:06.556461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:06.556461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:06.556461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:06.556461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 371/754] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:06.559722 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516660e-14e4-4784-b027-758a8c65b356 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:06.573278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f4d97-6d35-412f-b050-ae6bcfcfc458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:06.580058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f4d97-6d35-412f-b050-ae6bcfcfc458 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:06.580058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f4d97-6d35-412f-b050-ae6bcfcfc458 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:06.580058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f4d97-6d35-412f-b050-ae6bcfcfc458 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:06.580058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f4d97-6d35-412f-b050-ae6bcfcfc458 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:06.580058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f4d97-6d35-412f-b050-ae6bcfcfc458 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:06.580058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f4d97-6d35-412f-b050-ae6bcfcfc458 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:06.593798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 384/755] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:06.594915 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f4d97-6d35-412f-b050-ae6bcfcfc458 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:06.608920 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:06.640338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:06.676161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516660e-14e4-4784-b027-758a8c65b356 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:06.710033 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f4d97-6d35-412f-b050-ae6bcfcfc458 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:06.715408 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb507325-1fa5-488d-b41f-80429b2eab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:06.716197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb507325-1fa5-488d-b41f-80429b2eab78 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:06.716587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb507325-1fa5-488d-b41f-80429b2eab78 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:06.716928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb507325-1fa5-488d-b41f-80429b2eab78 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:06.717848 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb507325-1fa5-488d-b41f-80429b2eab78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:06.718236 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb507325-1fa5-488d-b41f-80429b2eab78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:06.719812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb507325-1fa5-488d-b41f-80429b2eab78 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:06.735637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 372/756] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:06.736609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb507325-1fa5-488d-b41f-80429b2eab78 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:06.751287 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07caa9-daa7-4166-b051-4080193e6e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:06.752256 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07caa9-daa7-4166-b051-4080193e6e91 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:06.752725 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07caa9-daa7-4166-b051-4080193e6e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:06.753319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07caa9-daa7-4166-b051-4080193e6e91 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:06.754498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07caa9-daa7-4166-b051-4080193e6e91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:06.754995 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07caa9-daa7-4166-b051-4080193e6e91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:06.756664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07caa9-daa7-4166-b051-4080193e6e91 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:06.771566 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 385/757] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:06.772960 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07caa9-daa7-4166-b051-4080193e6e91 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:06.851249 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:06.853804 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb507325-1fa5-488d-b41f-80429b2eab78 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:06.885195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:06.889879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07caa9-daa7-4166-b051-4080193e6e91 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:06.894001 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44422caf-d783-4fe2-b91f-1d61012a07ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:06.894165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44422caf-d783-4fe2-b91f-1d61012a07ef None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:06.894451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44422caf-d783-4fe2-b91f-1d61012a07ef None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:06.894729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44422caf-d783-4fe2-b91f-1d61012a07ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:06.903320 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44422caf-d783-4fe2-b91f-1d61012a07ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:06.905125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44422caf-d783-4fe2-b91f-1d61012a07ef None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-44422caf-d783-4fe2-b91f-1d61012a07ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:06.921921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:06.922946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:06.923982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:06.923982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:06.923982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:06.923982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:06.923982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:06.923982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:06.923982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:06.923982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:06.923982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:28:06.923982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:06.927963 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 373/758] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 20 22:28:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:06.929037 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44422caf-d783-4fe2-b91f-1d61012a07ef None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:06.934304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac08d50-6883-41dd-bc1f-6b77ed20a6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:06.935938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac08d50-6883-41dd-bc1f-6b77ed20a6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:06.936461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac08d50-6883-41dd-bc1f-6b77ed20a6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:06.936937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac08d50-6883-41dd-bc1f-6b77ed20a6c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:06.938007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac08d50-6883-41dd-bc1f-6b77ed20a6c9 None admin] RBAC: Adding query filter params (role.id=2a5f2a34d0b341e58b642fc48dc7c5da, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=ec5aca1c7f334dab8e7ca86573118d07) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:06.938658 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac08d50-6883-41dd-bc1f-6b77ed20a6c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:06.940402 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac08d50-6883-41dd-bc1f-6b77ed20a6c9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:06.947236 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 386/759] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:28:06 2022] GET /identity/v3/role_assignments?user.id=ec5aca1c7f334dab8e7ca86573118d07&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=2a5f2a34d0b341e58b642fc48dc7c5da => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:06.948381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac08d50-6883-41dd-bc1f-6b77ed20a6c9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:07.046390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44422caf-d783-4fe2-b91f-1d61012a07ef None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:07.072637 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac08d50-6883-41dd-bc1f-6b77ed20a6c9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:07.086545 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f3fd2-7bf7-4d02-9241-4b94d1db5f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:07.087222 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f3fd2-7bf7-4d02-9241-4b94d1db5f67 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:07.087509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f3fd2-7bf7-4d02-9241-4b94d1db5f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:07.087787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f3fd2-7bf7-4d02-9241-4b94d1db5f67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:07.088647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f3fd2-7bf7-4d02-9241-4b94d1db5f67 None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=146610a7cbbc46928a4a8d710c4d1942) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:07.089705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f3fd2-7bf7-4d02-9241-4b94d1db5f67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:07.090870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f3fd2-7bf7-4d02-9241-4b94d1db5f67 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:07.098218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 374/760] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:28:06 2022] GET /identity/v3/role_assignments?user.id=146610a7cbbc46928a4a8d710c4d1942&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:07.124275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605de99-d1c4-44b6-a1d7-583b34b70ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:07.125276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605de99-d1c4-44b6-a1d7-583b34b70ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:07.125714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605de99-d1c4-44b6-a1d7-583b34b70ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:07.126170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605de99-d1c4-44b6-a1d7-583b34b70ac7 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:07.127213 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605de99-d1c4-44b6-a1d7-583b34b70ac7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:07.127696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605de99-d1c4-44b6-a1d7-583b34b70ac7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:07.129393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605de99-d1c4-44b6-a1d7-583b34b70ac7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:07.131621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:07.152145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 387/761] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 20 22:28:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:07.157641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f3fd2-7bf7-4d02-9241-4b94d1db5f67 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:07.165903 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c04b0-ba38-4df8-8f76-070dbdc74aeb None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:07.166487 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c04b0-ba38-4df8-8f76-070dbdc74aeb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:07.166945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c04b0-ba38-4df8-8f76-070dbdc74aeb None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:07.168509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 388/762] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:07.177023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c40c9-ca88-43a9-bc6d-68f11d4832c8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:07.177553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c40c9-ca88-43a9-bc6d-68f11d4832c8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:07.178096 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c40c9-ca88-43a9-bc6d-68f11d4832c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:07.197570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-711c40c9-ca88-43a9-bc6d-68f11d4832c8 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:07.199299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-711c40c9-ca88-43a9-bc6d-68f11d4832c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:07.258056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:07.283762 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 389/763] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:07.308863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c40c9-ca88-43a9-bc6d-68f11d4832c8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:07.321410 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f3fd2-7bf7-4d02-9241-4b94d1db5f67 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:07.374530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fd501-dec0-45ec-8a58-5f38b0b1d045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:07.376817 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fd501-dec0-45ec-8a58-5f38b0b1d045 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:07.377342 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fd501-dec0-45ec-8a58-5f38b0b1d045 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:07.378039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fd501-dec0-45ec-8a58-5f38b0b1d045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:07.398659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fd501-dec0-45ec-8a58-5f38b0b1d045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:07.401433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fd501-dec0-45ec-8a58-5f38b0b1d045 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ff9fd501-dec0-45ec-8a58-5f38b0b1d045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:07.425046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:07.426043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:07.426961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:07.426961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:07.426961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:07.426961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:07.429319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 375/764] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:07.439164 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fd501-dec0-45ec-8a58-5f38b0b1d045 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:07.465605 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c40c9-ca88-43a9-bc6d-68f11d4832c8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:07.494638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:07.510936 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c64f14-23f9-4eb8-8bad-c1d2110bb52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:07.512593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c64f14-23f9-4eb8-8bad-c1d2110bb52f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:07.512593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c64f14-23f9-4eb8-8bad-c1d2110bb52f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:07.512593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c64f14-23f9-4eb8-8bad-c1d2110bb52f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:07.513007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c64f14-23f9-4eb8-8bad-c1d2110bb52f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:07.519387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c64f14-23f9-4eb8-8bad-c1d2110bb52f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-07c64f14-23f9-4eb8-8bad-c1d2110bb52f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:07.548689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:07.549699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:07.550614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 390/765] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Jul 20 22:28:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:07.558733 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c64f14-23f9-4eb8-8bad-c1d2110bb52f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:07.615945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fd501-dec0-45ec-8a58-5f38b0b1d045 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:07.625816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:07.662171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547cf0a-7957-48b5-9daf-010962d82882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:07.662865 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547cf0a-7957-48b5-9daf-010962d82882 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:07.663131 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547cf0a-7957-48b5-9daf-010962d82882 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:07.663409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547cf0a-7957-48b5-9daf-010962d82882 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:07.664165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547cf0a-7957-48b5-9daf-010962d82882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:07.664462 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547cf0a-7957-48b5-9daf-010962d82882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:07.665887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547cf0a-7957-48b5-9daf-010962d82882 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:07.697786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 376/766] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:07.704113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547cf0a-7957-48b5-9daf-010962d82882 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:07.756060 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c64f14-23f9-4eb8-8bad-c1d2110bb52f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:07.795523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed8a0c-c606-4cbd-bd16-f4efa6132c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:07.796051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8a0c-c606-4cbd-bd16-f4efa6132c8d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:07.796342 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8a0c-c606-4cbd-bd16-f4efa6132c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:07.796624 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8a0c-c606-4cbd-bd16-f4efa6132c8d None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:07.797345 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed8a0c-c606-4cbd-bd16-f4efa6132c8d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:07.797661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed8a0c-c606-4cbd-bd16-f4efa6132c8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:07.799092 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed8a0c-c606-4cbd-bd16-f4efa6132c8d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:07.809746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 391/767] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Jul 20 22:28:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:07.809746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28336f1e-7df8-463a-a16e-22ccf072e1b1 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:07.809746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28336f1e-7df8-463a-a16e-22ccf072e1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:07.809746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28336f1e-7df8-463a-a16e-22ccf072e1b1 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:07.809746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 392/768] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:07.809746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28336f1e-7df8-463a-a16e-22ccf072e1b1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:07.860888 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547cf0a-7957-48b5-9daf-010962d82882 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:07.866809 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:07.900553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5efecc3-be02-4d5b-b30c-435f7bd4190f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:07.901906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efecc3-be02-4d5b-b30c-435f7bd4190f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:07.902475 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efecc3-be02-4d5b-b30c-435f7bd4190f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:07.902971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5efecc3-be02-4d5b-b30c-435f7bd4190f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:07.911721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efecc3-be02-4d5b-b30c-435f7bd4190f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:07.913608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5efecc3-be02-4d5b-b30c-435f7bd4190f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:07.920842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28336f1e-7df8-463a-a16e-22ccf072e1b1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-c5efecc3-be02-4d5b-b30c-435f7bd4190f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:07.934416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:07.936559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:07.937467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:07.937467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:07.937467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:07.937467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:07.937467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:07.937467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:07.937467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:07.937467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:07.941318 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 377/769] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:07.943241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f79e9-e821-42de-ba8a-1c8aa91746ba None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:07.943736 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f79e9-e821-42de-ba8a-1c8aa91746ba None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:07.944231 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f79e9-e821-42de-ba8a-1c8aa91746ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:07.958167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987729-b77d-423f-89cd-5c5800968d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:07.958768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987729-b77d-423f-89cd-5c5800968d23 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:07.959055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987729-b77d-423f-89cd-5c5800968d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:07.959334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd987729-b77d-423f-89cd-5c5800968d23 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:07.960053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987729-b77d-423f-89cd-5c5800968d23 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:07.960367 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987729-b77d-423f-89cd-5c5800968d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:07.961784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd987729-b77d-423f-89cd-5c5800968d23 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:07.964385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-185f79e9-e821-42de-ba8a-1c8aa91746ba None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:07.966153 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-185f79e9-e821-42de-ba8a-1c8aa91746ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:07.973166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 393/770] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Jul 20 22:28:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:07.973166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987729-b77d-423f-89cd-5c5800968d23 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:07.994918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:08.054175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 378/771] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:08.055397 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f79e9-e821-42de-ba8a-1c8aa91746ba None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:08.087202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd987729-b77d-423f-89cd-5c5800968d23 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:08.102307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:08.124535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301be47a-4cf1-4fbe-85c7-866cc45c9712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:08.125312 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301be47a-4cf1-4fbe-85c7-866cc45c9712 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:08.125597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301be47a-4cf1-4fbe-85c7-866cc45c9712 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:08.125922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301be47a-4cf1-4fbe-85c7-866cc45c9712 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:08.126713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301be47a-4cf1-4fbe-85c7-866cc45c9712 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:08.127027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301be47a-4cf1-4fbe-85c7-866cc45c9712 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:08.128479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301be47a-4cf1-4fbe-85c7-866cc45c9712 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:08.142380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 394/772] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:08.143291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301be47a-4cf1-4fbe-85c7-866cc45c9712 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:08.186576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f79e9-e821-42de-ba8a-1c8aa91746ba None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:08.227912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9e658-2ca2-41bd-87d1-0f3c0173ed5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:08.229306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9e658-2ca2-41bd-87d1-0f3c0173ed5b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:08.229820 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9e658-2ca2-41bd-87d1-0f3c0173ed5b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:08.230332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a9e658-2ca2-41bd-87d1-0f3c0173ed5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:08.231337 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9e658-2ca2-41bd-87d1-0f3c0173ed5b None admin] RBAC: Adding query filter params (interface=public, service_id=0bdfe60a1fc54c75b409e075a20994cb, region_id=RegionOne) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:08.231880 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9e658-2ca2-41bd-87d1-0f3c0173ed5b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:08.233615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a9e658-2ca2-41bd-87d1-0f3c0173ed5b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:08.248204 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301be47a-4cf1-4fbe-85c7-866cc45c9712 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:08.248835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 379/773] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 20 22:28:08 2022] GET /identity/v3/endpoints?service_id=0bdfe60a1fc54c75b409e075a20994cb&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:08.250844 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9e658-2ca2-41bd-87d1-0f3c0173ed5b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:08.278064 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:08.281858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c09cd0-3d80-48a5-89f1-01819cafa83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:08.282692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c09cd0-3d80-48a5-89f1-01819cafa83f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:08.282977 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c09cd0-3d80-48a5-89f1-01819cafa83f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:08.283268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c09cd0-3d80-48a5-89f1-01819cafa83f None admin] PATH_INFO: `/v3/services/network` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:08.284096 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c09cd0-3d80-48a5-89f1-01819cafa83f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:08.285540 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c09cd0-3d80-48a5-89f1-01819cafa83f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-81c09cd0-3d80-48a5-89f1-01819cafa83f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:08.298522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:08.299647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:08.300526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 395/774] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:08 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:08.301402 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c09cd0-3d80-48a5-89f1-01819cafa83f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:08.350461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:08.374378 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a9e658-2ca2-41bd-87d1-0f3c0173ed5b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:08.412793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e5396-b190-43cb-bb32-157984f009a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:08.414738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e5396-b190-43cb-bb32-157984f009a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:08.415483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e5396-b190-43cb-bb32-157984f009a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:08.415966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e5396-b190-43cb-bb32-157984f009a6 None admin] PATH_INFO: `/v3/projects/8cec07c864274d649ecd1944be870bd5/users/67c92c8d2b9d41e489e4c03ae4e71fe2/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:08.417116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c09cd0-3d80-48a5-89f1-01819cafa83f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:08.419894 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e5396-b190-43cb-bb32-157984f009a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cec07c864274d649ecd1944be870bd5, user_id=67c92c8d2b9d41e489e4c03ae4e71fe2, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:08.421402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e5396-b190-43cb-bb32-157984f009a6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:08.457455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda30322-f141-4390-a388-8f1193961fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:08.458170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30322-f141-4390-a388-8f1193961fbb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:08.458482 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30322-f141-4390-a388-8f1193961fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:08.458765 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30322-f141-4390-a388-8f1193961fbb None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:08.459460 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda30322-f141-4390-a388-8f1193961fbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:08.460830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda30322-f141-4390-a388-8f1193961fbb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:08.467025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 396/775] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 20 22:28:08 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:08.471387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda30322-f141-4390-a388-8f1193961fbb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:08.517167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 380/776] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:28:08 2022] PUT /identity/v3/projects/8cec07c864274d649ecd1944be870bd5/users/67c92c8d2b9d41e489e4c03ae4e71fe2/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:28:08.611665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda30322-f141-4390-a388-8f1193961fbb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:08.614070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:08.654503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d988c9-05a1-4028-9040-c740aa3c04da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:08.657074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d988c9-05a1-4028-9040-c740aa3c04da None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:08.657074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d988c9-05a1-4028-9040-c740aa3c04da None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:08.657074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d988c9-05a1-4028-9040-c740aa3c04da None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:08.657074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d988c9-05a1-4028-9040-c740aa3c04da None admin] RBAC: Adding query filter params (name=network) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:08.657074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d988c9-05a1-4028-9040-c740aa3c04da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:08.658500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d988c9-05a1-4028-9040-c740aa3c04da None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:08.664998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 397/777] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 20 22:28:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:08.671296 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e5396-b190-43cb-bb32-157984f009a6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:08.772955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:08.792394 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e5396-b190-43cb-bb32-157984f009a6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:08.830111 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f8c00-db26-43b4-914d-fc74f123110a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:08.830788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f8c00-db26-43b4-914d-fc74f123110a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:08.831072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f8c00-db26-43b4-914d-fc74f123110a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:08.831346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f8c00-db26-43b4-914d-fc74f123110a None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:08.832129 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f8c00-db26-43b4-914d-fc74f123110a None admin] RBAC: Adding query filter params (type=network) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:08.832370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f8c00-db26-43b4-914d-fc74f123110a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:08.833776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f8c00-db26-43b4-914d-fc74f123110a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:08.840553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 381/778] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 20 22:28:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:08.846164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d988c9-05a1-4028-9040-c740aa3c04da None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:08.969638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d988c9-05a1-4028-9040-c740aa3c04da None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:09.020795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43316b-6675-4db3-b55f-dd0ea9ed621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:09.020795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43316b-6675-4db3-b55f-dd0ea9ed621f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:09.020795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43316b-6675-4db3-b55f-dd0ea9ed621f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:09.020795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43316b-6675-4db3-b55f-dd0ea9ed621f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:09.021226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43316b-6675-4db3-b55f-dd0ea9ed621f None admin] RBAC: Adding query filter params (interface=public, service_id=3003d4285d354bfa8d420ddb547f4088, region_id=RegionOne) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:09.021226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43316b-6675-4db3-b55f-dd0ea9ed621f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:09.021687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43316b-6675-4db3-b55f-dd0ea9ed621f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:09.036244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 398/779] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 20 22:28:08 2022] GET /identity/v3/endpoints?service_id=3003d4285d354bfa8d420ddb547f4088&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:09.041612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f8c00-db26-43b4-914d-fc74f123110a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:09.161964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f8c00-db26-43b4-914d-fc74f123110a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:09.198402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0d086-2892-43f1-b455-c12f8119c9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:09.199387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0d086-2892-43f1-b455-c12f8119c9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:09.199848 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0d086-2892-43f1-b455-c12f8119c9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:09.200301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0d086-2892-43f1-b455-c12f8119c9b8 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:09.201261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0d086-2892-43f1-b455-c12f8119c9b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:09.203022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0d086-2892-43f1-b455-c12f8119c9b8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:09.209189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 382/780] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 20 22:28:09 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:09.526696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88003507-1a18-4514-8be3-965e201ba8da None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:09.527232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88003507-1a18-4514-8be3-965e201ba8da None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:09.527524 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88003507-1a18-4514-8be3-965e201ba8da None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:09.530156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 399/781] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:09.535222 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab9c60-fde7-4d44-885c-8c8043f4ddd3 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:09.535669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab9c60-fde7-4d44-885c-8c8043f4ddd3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:09.535979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab9c60-fde7-4d44-885c-8c8043f4ddd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:09.558199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1cab9c60-fde7-4d44-885c-8c8043f4ddd3 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:09.558199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1cab9c60-fde7-4d44-885c-8c8043f4ddd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:09.559554 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:09.649697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 383/782] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:09.685960 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88003507-1a18-4514-8be3-965e201ba8da None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:09.688896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ac84c-6f65-4bba-9d4d-77b9c6dcba5d None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:09.689187 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ac84c-6f65-4bba-9d4d-77b9c6dcba5d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:09.689467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ac84c-6f65-4bba-9d4d-77b9c6dcba5d None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:09.690903 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 384/783] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:09.697330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a8fa1-1975-4411-b931-8e4fa076b581 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:09.697623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a8fa1-1975-4411-b931-8e4fa076b581 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:09.697947 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a8fa1-1975-4411-b931-8e4fa076b581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:09.722306 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:09.726743 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-300a8fa1-1975-4411-b931-8e4fa076b581 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:09.727957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-300a8fa1-1975-4411-b931-8e4fa076b581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:09.830010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 385/784] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:09.853907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88003507-1a18-4514-8be3-965e201ba8da None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:09.872118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a8fa1-1975-4411-b931-8e4fa076b581 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:10.010368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fbf43-2be4-4265-9fff-293e6d98338b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:10.011183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fbf43-2be4-4265-9fff-293e6d98338b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:10.011463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fbf43-2be4-4265-9fff-293e6d98338b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:10.011743 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736fbf43-2be4-4265-9fff-293e6d98338b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:10.023318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736fbf43-2be4-4265-9fff-293e6d98338b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-736fbf43-2be4-4265-9fff-293e6d98338b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:10.031709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:10.032700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:10.033965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:10.033965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:10.033965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:10.033965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:10.033965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:10.033965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:10.033965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:10.033965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:10.033965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:10.033965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:10.033965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:28:10.033965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:10.033965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 400/785] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:28:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:10.046772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fbf43-2be4-4265-9fff-293e6d98338b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:10.074146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:10.096608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a8fa1-1975-4411-b931-8e4fa076b581 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:10.156335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:10.161086 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf00d3-e05b-4474-8211-f01bd33dbc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:10.162091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf00d3-e05b-4474-8211-f01bd33dbc4d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:10.162549 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf00d3-e05b-4474-8211-f01bd33dbc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:10.163024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf00d3-e05b-4474-8211-f01bd33dbc4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:10.171122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736fbf43-2be4-4265-9fff-293e6d98338b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:10.183483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf00d3-e05b-4474-8211-f01bd33dbc4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-8daf00d3-e05b-4474-8211-f01bd33dbc4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:10.193159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:10.194364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:10.195298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:10.195298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:10.195298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:10.195298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:10.195298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:10.195298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:10.195298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:10.195298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:10.195298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:10.195298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:10.195298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:10.195298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:10.198421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 386/786] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:28:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:10.207425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf00d3-e05b-4474-8211-f01bd33dbc4d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:10.243298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab981a7-7cc9-4912-be08-8799d83ae511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:10.244097 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab981a7-7cc9-4912-be08-8799d83ae511 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:10.244386 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab981a7-7cc9-4912-be08-8799d83ae511 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:10.244719 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab981a7-7cc9-4912-be08-8799d83ae511 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:10.245757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab981a7-7cc9-4912-be08-8799d83ae511 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:10.246106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab981a7-7cc9-4912-be08-8799d83ae511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:10.248162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab981a7-7cc9-4912-be08-8799d83ae511 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:10.270185 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 401/787] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:28:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:10.278922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab981a7-7cc9-4912-be08-8799d83ae511 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:10.418937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf00d3-e05b-4474-8211-f01bd33dbc4d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:10.474081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:10.484145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab981a7-7cc9-4912-be08-8799d83ae511 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:10.487469 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1365c-d53c-49bd-94e2-67e7f9f86c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:10.490109 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1365c-d53c-49bd-94e2-67e7f9f86c08 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:10.490109 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1365c-d53c-49bd-94e2-67e7f9f86c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:10.490109 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1365c-d53c-49bd-94e2-67e7f9f86c08 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:10.490109 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1365c-d53c-49bd-94e2-67e7f9f86c08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:10.490109 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1365c-d53c-49bd-94e2-67e7f9f86c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:10.491135 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f1365c-d53c-49bd-94e2-67e7f9f86c08 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:10.514236 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 387/788] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:28:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:10.518673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1365c-d53c-49bd-94e2-67e7f9f86c08 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:10.571082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b9f46-4f89-4563-bfa2-922ada87c81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:10.571897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b9f46-4f89-4563-bfa2-922ada87c81f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:10.572175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b9f46-4f89-4563-bfa2-922ada87c81f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:10.572445 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b9f46-4f89-4563-bfa2-922ada87c81f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:10.596958 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b9f46-4f89-4563-bfa2-922ada87c81f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:10.598435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b9f46-4f89-4563-bfa2-922ada87c81f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-e96b9f46-4f89-4563-bfa2-922ada87c81f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:10.632830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:10.634037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:10.634988 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:10.634988 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:10.634988 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:10.634988 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:10.635218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1365c-d53c-49bd-94e2-67e7f9f86c08 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:10.638695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 402/789] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:10.650284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b9f46-4f89-4563-bfa2-922ada87c81f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:10.660107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:10.706367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611ad73-4040-42d1-bc58-1c876ebe41a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:10.707229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611ad73-4040-42d1-bc58-1c876ebe41a6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:10.707507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611ad73-4040-42d1-bc58-1c876ebe41a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:10.709686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611ad73-4040-42d1-bc58-1c876ebe41a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:10.729053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611ad73-4040-42d1-bc58-1c876ebe41a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:10.731255 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611ad73-4040-42d1-bc58-1c876ebe41a6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-7611ad73-4040-42d1-bc58-1c876ebe41a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:10.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:10.761889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:10.762826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:10.762826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:10.762826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:10.762826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:10.764025 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 388/790] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:10.777405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611ad73-4040-42d1-bc58-1c876ebe41a6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:10.837001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b9f46-4f89-4563-bfa2-922ada87c81f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:10.857910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:10.872774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7355ef8-4a2d-47d7-8e92-5481eba05674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:10.879176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355ef8-4a2d-47d7-8e92-5481eba05674 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:10.879176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355ef8-4a2d-47d7-8e92-5481eba05674 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:10.879176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7355ef8-4a2d-47d7-8e92-5481eba05674 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:10.879176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7355ef8-4a2d-47d7-8e92-5481eba05674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:10.879176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7355ef8-4a2d-47d7-8e92-5481eba05674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:10.879176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7355ef8-4a2d-47d7-8e92-5481eba05674 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:10.915704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 403/791] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:10.931460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611ad73-4040-42d1-bc58-1c876ebe41a6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:10.934606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7355ef8-4a2d-47d7-8e92-5481eba05674 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:10.971327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e808ec2e-c61c-422d-8585-196cbc5ebff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:10.971913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808ec2e-c61c-422d-8585-196cbc5ebff5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:10.972189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808ec2e-c61c-422d-8585-196cbc5ebff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:10.972458 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e808ec2e-c61c-422d-8585-196cbc5ebff5 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:10.973182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808ec2e-c61c-422d-8585-196cbc5ebff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:10.973487 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808ec2e-c61c-422d-8585-196cbc5ebff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:10.976260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e808ec2e-c61c-422d-8585-196cbc5ebff5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:10.996283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 389/792] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:10.997989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103092a-93ab-4c27-8b62-dfd8ac218933 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:10.998283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103092a-93ab-4c27-8b62-dfd8ac218933 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:10.998665 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103092a-93ab-4c27-8b62-dfd8ac218933 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:11.001801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 390/793] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:11.002658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103092a-93ab-4c27-8b62-dfd8ac218933 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:11.056368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:11.110703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7355ef8-4a2d-47d7-8e92-5481eba05674 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:11.147869 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103092a-93ab-4c27-8b62-dfd8ac218933 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:11.149636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:11.159006 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d6207c-4656-4433-a5f7-103418518915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:11.160049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6207c-4656-4433-a5f7-103418518915 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:11.160567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6207c-4656-4433-a5f7-103418518915 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:11.161375 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d6207c-4656-4433-a5f7-103418518915 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:11.170821 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6207c-4656-4433-a5f7-103418518915 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:11.172271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d6207c-4656-4433-a5f7-103418518915 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-90d6207c-4656-4433-a5f7-103418518915 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:11.188357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:11.189334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:11.192278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:11.192278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:11.192278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:11.192278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:11.192278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:11.192278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:11.192278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:11.192278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:11.192278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 22:28:11.192278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:11.192278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 404/794] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Jul 20 22:28:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:11.192278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f063f09-4e58-4281-9e12-26951ff4486f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:11.192278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f063f09-4e58-4281-9e12-26951ff4486f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:11.193046 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f063f09-4e58-4281-9e12-26951ff4486f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:11.196944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f24609-2a17-4951-a4b2-85ed207a9ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:11.197994 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24609-2a17-4951-a4b2-85ed207a9ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:11.198288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24609-2a17-4951-a4b2-85ed207a9ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:11.199322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24609-2a17-4951-a4b2-85ed207a9ed2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:11.207436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f24609-2a17-4951-a4b2-85ed207a9ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:11.208907 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f24609-2a17-4951-a4b2-85ed207a9ed2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:11.209672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1f063f09-4e58-4281-9e12-26951ff4486f None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:11.210925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1f063f09-4e58-4281-9e12-26951ff4486f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-08f24609-2a17-4951-a4b2-85ed207a9ed2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:11.224113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:11.225072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:11.226077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:11.226077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:11.226077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:11.226077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:11.226077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:11.226077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:11.226077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:11.226077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:11.226077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 22:28:11.226077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:11.226077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 391/795] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:28:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:11.226687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ff61b-ba66-4c25-b6be-dd7dec66cee9 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:11.227374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ff61b-ba66-4c25-b6be-dd7dec66cee9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:11.227374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ff61b-ba66-4c25-b6be-dd7dec66cee9 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:11.228802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 392/796] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:11.229446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ff61b-ba66-4c25-b6be-dd7dec66cee9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:11.289472 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 405/797] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:11.290435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f063f09-4e58-4281-9e12-26951ff4486f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:11.350149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:11.356875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ff61b-ba66-4c25-b6be-dd7dec66cee9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:11.397093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fe80c1-9da9-41ce-9387-61a0249a7d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:11.397811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe80c1-9da9-41ce-9387-61a0249a7d8b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:11.398096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe80c1-9da9-41ce-9387-61a0249a7d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:11.398377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fe80c1-9da9-41ce-9387-61a0249a7d8b None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:11.399229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe80c1-9da9-41ce-9387-61a0249a7d8b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:11.399569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe80c1-9da9-41ce-9387-61a0249a7d8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:11.401111 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fe80c1-9da9-41ce-9387-61a0249a7d8b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:11.401618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f063f09-4e58-4281-9e12-26951ff4486f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:11.421005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 393/798] 10.222.0.83 () {56 vars in 1149 bytes} [Wed Jul 20 22:28:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:11.423123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604f72d-0953-4db9-93dc-52a71fe4504d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:11.423612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604f72d-0953-4db9-93dc-52a71fe4504d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:11.424090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604f72d-0953-4db9-93dc-52a71fe4504d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:11.439281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdf0cc-4216-4486-a462-d34c3d833be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:11.439951 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdf0cc-4216-4486-a462-d34c3d833be4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:11.440230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdf0cc-4216-4486-a462-d34c3d833be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:11.440506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdf0cc-4216-4486-a462-d34c3d833be4 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:11.441343 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdf0cc-4216-4486-a462-d34c3d833be4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:11.441672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdf0cc-4216-4486-a462-d34c3d833be4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:11.443091 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bdf0cc-4216-4486-a462-d34c3d833be4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:11.446705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c604f72d-0953-4db9-93dc-52a71fe4504d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:11.448103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c604f72d-0953-4db9-93dc-52a71fe4504d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:11.461535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 406/799] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Jul 20 22:28:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:11.462454 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdf0cc-4216-4486-a462-d34c3d833be4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:11.467610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:11.541832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 394/800] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:11.541832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604f72d-0953-4db9-93dc-52a71fe4504d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:11.584160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdf0cc-4216-4486-a462-d34c3d833be4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:11.599718 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:11.621997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749f1d8-2b96-432b-8872-76ddc6141e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:11.622831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749f1d8-2b96-432b-8872-76ddc6141e35 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:11.623123 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749f1d8-2b96-432b-8872-76ddc6141e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:11.623395 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749f1d8-2b96-432b-8872-76ddc6141e35 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:11.633403 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749f1d8-2b96-432b-8872-76ddc6141e35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-6749f1d8-2b96-432b-8872-76ddc6141e35 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:11.642260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:11.643459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:11.644648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:11.644648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:11.644648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:11.644648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:11.644648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:11.644648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:11.644648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:11.644648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:11.644648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:11.644648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:11.644648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:11.644648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:11.647531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 407/801] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:28:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:11.648182 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749f1d8-2b96-432b-8872-76ddc6141e35 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:11.662258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604f72d-0953-4db9-93dc-52a71fe4504d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:11.699304 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6034a8-d4bc-46f7-bba5-25c21c16b9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:11.700101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6034a8-d4bc-46f7-bba5-25c21c16b9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:11.700380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6034a8-d4bc-46f7-bba5-25c21c16b9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:11.701146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6034a8-d4bc-46f7-bba5-25c21c16b9b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:11.713654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6034a8-d4bc-46f7-bba5-25c21c16b9b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:11.715156 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6034a8-d4bc-46f7-bba5-25c21c16b9b0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-eb6034a8-d4bc-46f7-bba5-25c21c16b9b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:11.736871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:11.737909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:11.740279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:11.740279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:11.740279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:11.740279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:11.740279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 395/802] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:11.740279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6034a8-d4bc-46f7-bba5-25c21c16b9b0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:11.743456 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:11.767448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749f1d8-2b96-432b-8872-76ddc6141e35 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:11.808630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed18d32-7559-45ce-a781-daeec40140d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:11.809347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed18d32-7559-45ce-a781-daeec40140d0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:11.809629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed18d32-7559-45ce-a781-daeec40140d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:11.810455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed18d32-7559-45ce-a781-daeec40140d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:11.821084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed18d32-7559-45ce-a781-daeec40140d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:11.822564 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed18d32-7559-45ce-a781-daeec40140d0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1ed18d32-7559-45ce-a781-daeec40140d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:11.840233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:11.841192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:11.842363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:11.842363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:11.842363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:11.842363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:11.842363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 408/803] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:11.842363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed18d32-7559-45ce-a781-daeec40140d0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:11.853134 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6034a8-d4bc-46f7-bba5-25c21c16b9b0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:11.866678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:11.886986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d169d2-d379-4dd8-979c-ad30ba0ad210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:11.887804 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d169d2-d379-4dd8-979c-ad30ba0ad210 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:11.888142 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d169d2-d379-4dd8-979c-ad30ba0ad210 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:11.888950 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d169d2-d379-4dd8-979c-ad30ba0ad210 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:11.889646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d169d2-d379-4dd8-979c-ad30ba0ad210 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:11.891359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d169d2-d379-4dd8-979c-ad30ba0ad210 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-81d169d2-d379-4dd8-979c-ad30ba0ad210 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:11.903401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:11.904882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:11.905787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 396/804] 10.222.0.83 () {56 vars in 1129 bytes} [Wed Jul 20 22:28:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:11.906687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d169d2-d379-4dd8-979c-ad30ba0ad210 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:11.956383 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed18d32-7559-45ce-a781-daeec40140d0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:11.973747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:11.989750 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d34c2-0e2c-4f0e-bdc4-e37e3f0f4ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:11.990435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d34c2-0e2c-4f0e-bdc4-e37e3f0f4ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:11.990716 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d34c2-0e2c-4f0e-bdc4-e37e3f0f4ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:11.990992 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d34c2-0e2c-4f0e-bdc4-e37e3f0f4ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:11.991742 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d34c2-0e2c-4f0e-bdc4-e37e3f0f4ba3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:11.992056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d34c2-0e2c-4f0e-bdc4-e37e3f0f4ba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:11.993414 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d34c2-0e2c-4f0e-bdc4-e37e3f0f4ba3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:12.002293 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 409/805] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:28:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:12.003710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aeed1-81f7-40d6-9cd1-49f29ec3c6fa None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:12.003826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aeed1-81f7-40d6-9cd1-49f29ec3c6fa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:12.004099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aeed1-81f7-40d6-9cd1-49f29ec3c6fa None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:12.009247 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 410/806] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:12.009380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d169d2-d379-4dd8-979c-ad30ba0ad210 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:12.010112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aeed1-81f7-40d6-9cd1-49f29ec3c6fa None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:12.043276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15218eb7-ce9a-49e4-9def-2bee98e89b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:12.043938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15218eb7-ce9a-49e4-9def-2bee98e89b68 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:12.044226 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15218eb7-ce9a-49e4-9def-2bee98e89b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:12.044721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15218eb7-ce9a-49e4-9def-2bee98e89b68 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:12.045433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15218eb7-ce9a-49e4-9def-2bee98e89b68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:12.045777 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15218eb7-ce9a-49e4-9def-2bee98e89b68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:12.047161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15218eb7-ce9a-49e4-9def-2bee98e89b68 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:12.058811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 397/807] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:12.059552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15218eb7-ce9a-49e4-9def-2bee98e89b68 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:12.103672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:12.119428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aeed1-81f7-40d6-9cd1-49f29ec3c6fa None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:12.153494 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66742cb4-4d4d-4388-97f0-215bdcc61068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:12.154180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66742cb4-4d4d-4388-97f0-215bdcc61068 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:12.154463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66742cb4-4d4d-4388-97f0-215bdcc61068 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:12.154736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66742cb4-4d4d-4388-97f0-215bdcc61068 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:12.155453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66742cb4-4d4d-4388-97f0-215bdcc61068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:12.155759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66742cb4-4d4d-4388-97f0-215bdcc61068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:12.157116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66742cb4-4d4d-4388-97f0-215bdcc61068 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:12.160804 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15218eb7-ce9a-49e4-9def-2bee98e89b68 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:12.168514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 411/808] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:12.170220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66742cb4-4d4d-4388-97f0-215bdcc61068 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:12.187710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:12.196681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30fc3e-e3f7-4810-8df1-8ba2a81c8531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:12.200405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30fc3e-e3f7-4810-8df1-8ba2a81c8531 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:12.200405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30fc3e-e3f7-4810-8df1-8ba2a81c8531 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:12.200405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30fc3e-e3f7-4810-8df1-8ba2a81c8531 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:12.200405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30fc3e-e3f7-4810-8df1-8ba2a81c8531 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:12.200405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30fc3e-e3f7-4810-8df1-8ba2a81c8531 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:12.200405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb30fc3e-e3f7-4810-8df1-8ba2a81c8531 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:12.205065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 398/809] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Jul 20 22:28:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:12.206314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d725cd6-0c14-4a62-bc5b-1bec7434715b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:12.206620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d725cd6-0c14-4a62-bc5b-1bec7434715b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:12.206897 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d725cd6-0c14-4a62-bc5b-1bec7434715b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:12.222944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1d725cd6-0c14-4a62-bc5b-1bec7434715b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:12.224219 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1d725cd6-0c14-4a62-bc5b-1bec7434715b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:12.269272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66742cb4-4d4d-4388-97f0-215bdcc61068 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:12.291859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 399/810] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:12.292771 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d725cd6-0c14-4a62-bc5b-1bec7434715b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:12.312277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab32113-0633-49af-b8cb-3ab03f939187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:12.313092 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32113-0633-49af-b8cb-3ab03f939187 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:12.313376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32113-0633-49af-b8cb-3ab03f939187 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:12.313649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab32113-0633-49af-b8cb-3ab03f939187 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:12.324322 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab32113-0633-49af-b8cb-3ab03f939187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:12.325797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab32113-0633-49af-b8cb-3ab03f939187 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:12.331886 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-2ab32113-0633-49af-b8cb-3ab03f939187 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:12.342761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:12.344045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:12.345272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:12.345272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:12.345272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:12.345272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:12.345272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 412/811] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:12.346513 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab32113-0633-49af-b8cb-3ab03f939187 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:12.396526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d725cd6-0c14-4a62-bc5b-1bec7434715b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:12.416879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:12.431559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50caca-83d9-4e4f-8135-27c6bc4369d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:12.432356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50caca-83d9-4e4f-8135-27c6bc4369d5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:12.432648 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50caca-83d9-4e4f-8135-27c6bc4369d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:12.432927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50caca-83d9-4e4f-8135-27c6bc4369d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:12.440590 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50caca-83d9-4e4f-8135-27c6bc4369d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:12.442440 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50caca-83d9-4e4f-8135-27c6bc4369d5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:12.447231 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab32113-0633-49af-b8cb-3ab03f939187 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-9c50caca-83d9-4e4f-8135-27c6bc4369d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:12.456644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:12.457593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:12.458561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:12.458561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:12.458561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:12.458561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:12.458561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:12.458561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:12.458561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:12.458561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:12.458561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 400/812] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:12.459065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50caca-83d9-4e4f-8135-27c6bc4369d5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:12.485687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116a74f-9426-4bcb-b4e7-d19fdab8b809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:12.486511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a74f-9426-4bcb-b4e7-d19fdab8b809 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:12.486795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a74f-9426-4bcb-b4e7-d19fdab8b809 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:12.487072 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a74f-9426-4bcb-b4e7-d19fdab8b809 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:12.493588 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116a74f-9426-4bcb-b4e7-d19fdab8b809 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:12.495052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116a74f-9426-4bcb-b4e7-d19fdab8b809 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b116a74f-9426-4bcb-b4e7-d19fdab8b809 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:12.509768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:12.510707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:12.511621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:12.511621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:12.511621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:12.511621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:12.511621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:12.511621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:12.511621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:12.511621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:12.511621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 413/813] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:12.512123 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116a74f-9426-4bcb-b4e7-d19fdab8b809 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:12.564143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50caca-83d9-4e4f-8135-27c6bc4369d5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:12.569889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:12.599867 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49270ed-a75b-4849-8886-451ebd2fe04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:12.600531 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49270ed-a75b-4849-8886-451ebd2fe04e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:12.600820 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49270ed-a75b-4849-8886-451ebd2fe04e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:12.601096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49270ed-a75b-4849-8886-451ebd2fe04e None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:12.601829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49270ed-a75b-4849-8886-451ebd2fe04e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:12.602144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49270ed-a75b-4849-8886-451ebd2fe04e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:12.603813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49270ed-a75b-4849-8886-451ebd2fe04e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:12.609365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 401/814] 10.222.0.83 () {56 vars in 1124 bytes} [Wed Jul 20 22:28:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:12.610165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49270ed-a75b-4849-8886-451ebd2fe04e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:12.611083 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116a74f-9426-4bcb-b4e7-d19fdab8b809 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:12.647443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67a192-af9a-45b8-8761-7fd3cb822bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:12.648246 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67a192-af9a-45b8-8761-7fd3cb822bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:12.648532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67a192-af9a-45b8-8761-7fd3cb822bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:12.648809 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d67a192-af9a-45b8-8761-7fd3cb822bd3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:12.649461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67a192-af9a-45b8-8761-7fd3cb822bd3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:12.650863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d67a192-af9a-45b8-8761-7fd3cb822bd3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:12.656179 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-2d67a192-af9a-45b8-8761-7fd3cb822bd3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:12.663338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:12.664741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:12.665617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 414/815] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:12 2022] GET /identity/v3/services/network => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:12.666540 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67a192-af9a-45b8-8761-7fd3cb822bd3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:12.713704 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49270ed-a75b-4849-8886-451ebd2fe04e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:12.748280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe07533-f6cf-486d-83d1-b5eed144ac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:12.748956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe07533-f6cf-486d-83d1-b5eed144ac7b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:12.749244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe07533-f6cf-486d-83d1-b5eed144ac7b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:12.749524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe07533-f6cf-486d-83d1-b5eed144ac7b None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:12.750312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe07533-f6cf-486d-83d1-b5eed144ac7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:12.750625 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe07533-f6cf-486d-83d1-b5eed144ac7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:12.751996 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe07533-f6cf-486d-83d1-b5eed144ac7b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:12.764084 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 402/816] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:12.764891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe07533-f6cf-486d-83d1-b5eed144ac7b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:12.772324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d67a192-af9a-45b8-8761-7fd3cb822bd3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:12.795741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:12.806524 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc695e-517c-415d-aca1-e75ffd7c586b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:12.807365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc695e-517c-415d-aca1-e75ffd7c586b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:12.807649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc695e-517c-415d-aca1-e75ffd7c586b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:12.807922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc695e-517c-415d-aca1-e75ffd7c586b None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:12.808711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc695e-517c-415d-aca1-e75ffd7c586b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:12.809046 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc695e-517c-415d-aca1-e75ffd7c586b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:12.810487 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc695e-517c-415d-aca1-e75ffd7c586b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:12.822366 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 415/817] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:12.823171 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc695e-517c-415d-aca1-e75ffd7c586b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:12.864465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe07533-f6cf-486d-83d1-b5eed144ac7b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:12.866805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:12.898715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959319d-163f-4bc6-9076-9f120d9a9fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:12.899375 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959319d-163f-4bc6-9076-9f120d9a9fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:12.899654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959319d-163f-4bc6-9076-9f120d9a9fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:12.899928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959319d-163f-4bc6-9076-9f120d9a9fc3 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:12.900712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959319d-163f-4bc6-9076-9f120d9a9fc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:12.901022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959319d-163f-4bc6-9076-9f120d9a9fc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:12.902472 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a959319d-163f-4bc6-9076-9f120d9a9fc3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:12.914172 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 403/818] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:12.914960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959319d-163f-4bc6-9076-9f120d9a9fc3 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:12.928757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc695e-517c-415d-aca1-e75ffd7c586b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:12.964299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74d4f1-c8b5-4630-bcbf-0e4097bee92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:12.964955 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74d4f1-c8b5-4630-bcbf-0e4097bee92b None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:12.965232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74d4f1-c8b5-4630-bcbf-0e4097bee92b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:12.965503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74d4f1-c8b5-4630-bcbf-0e4097bee92b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:12.966934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74d4f1-c8b5-4630-bcbf-0e4097bee92b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:12.968707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74d4f1-c8b5-4630-bcbf-0e4097bee92b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:13.012773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a959319d-163f-4bc6-9076-9f120d9a9fc3 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:13.048521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f7d7f-5a19-4665-962d-4e01fe1793a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:13.049373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f7d7f-5a19-4665-962d-4e01fe1793a8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:13.049660 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f7d7f-5a19-4665-962d-4e01fe1793a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:13.050145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f7d7f-5a19-4665-962d-4e01fe1793a8 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:13.051240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f7d7f-5a19-4665-962d-4e01fe1793a8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:13.051561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f7d7f-5a19-4665-962d-4e01fe1793a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:13.052938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f7d7f-5a19-4665-962d-4e01fe1793a8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:13.054437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 416/819] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 20 22:28:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:28:13.055400 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74d4f1-c8b5-4630-bcbf-0e4097bee92b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:13.058074 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 404/820] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 20 22:28:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:13.058717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f7d7f-5a19-4665-962d-4e01fe1793a8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:13.102730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:13.110221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:13.192333 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74d4f1-c8b5-4630-bcbf-0e4097bee92b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:13.195036 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f7d7f-5a19-4665-962d-4e01fe1793a8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:13.236513 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f5cfa-4dc8-44a7-823a-4eaff3140c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:13.237361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f5cfa-4dc8-44a7-823a-4eaff3140c41 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:13.237653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f5cfa-4dc8-44a7-823a-4eaff3140c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:13.237974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f5cfa-4dc8-44a7-823a-4eaff3140c41 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:13.238788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685e0bb-f088-4af5-ae41-90c145340ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:13.239739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685e0bb-f088-4af5-ae41-90c145340ed7 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:13.240081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685e0bb-f088-4af5-ae41-90c145340ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:13.240412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685e0bb-f088-4af5-ae41-90c145340ed7 None admin] PATH_INFO: `/v3/projects/8cec07c864274d649ecd1944be870bd5/users/ec5aca1c7f334dab8e7ca86573118d07/roles/2a5f2a34d0b341e58b642fc48dc7c5da` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:13.246327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f5cfa-4dc8-44a7-823a-4eaff3140c41 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:13.248893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f5cfa-4dc8-44a7-823a-4eaff3140c41 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:13.257760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685e0bb-f088-4af5-ae41-90c145340ed7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cec07c864274d649ecd1944be870bd5, user_id=ec5aca1c7f334dab8e7ca86573118d07, role_id=2a5f2a34d0b341e58b642fc48dc7c5da)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:13.258986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4685e0bb-f088-4af5-ae41-90c145340ed7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-fe9f5cfa-4dc8-44a7-823a-4eaff3140c41 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:13.267783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:13.268999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:13.270061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:13.270061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:13.270061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:13.270061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:13.270061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:13.270061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:13.270061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:13.270061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:13.270061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:28:13.270061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:13.270061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 417/821] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 20 22:28:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:13.270705 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f5cfa-4dc8-44a7-823a-4eaff3140c41 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:13.354196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 405/822] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:28:13 2022] PUT /identity/v3/projects/8cec07c864274d649ecd1944be870bd5/users/ec5aca1c7f334dab8e7ca86573118d07/roles/2a5f2a34d0b341e58b642fc48dc7c5da => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:28:13.355414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685e0bb-f088-4af5-ae41-90c145340ed7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:13.371205 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:13.384327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f5cfa-4dc8-44a7-823a-4eaff3140c41 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:13.427272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddd4b6-6cc4-4523-8a37-18e1c350f429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:13.429201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddd4b6-6cc4-4523-8a37-18e1c350f429 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:13.429737 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddd4b6-6cc4-4523-8a37-18e1c350f429 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:13.430231 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddd4b6-6cc4-4523-8a37-18e1c350f429 None admin] PATH_INFO: `/v3/projects/8cec07c864274d649ecd1944be870bd5/users/146610a7cbbc46928a4a8d710c4d1942/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:13.433629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddd4b6-6cc4-4523-8a37-18e1c350f429 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cec07c864274d649ecd1944be870bd5, user_id=146610a7cbbc46928a4a8d710c4d1942, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:13.437051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddd4b6-6cc4-4523-8a37-18e1c350f429 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:13.471376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:13.495519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685e0bb-f088-4af5-ae41-90c145340ed7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:13.516068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 418/823] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:28:13 2022] PUT /identity/v3/projects/8cec07c864274d649ecd1944be870bd5/users/146610a7cbbc46928a4a8d710c4d1942/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:28:13.518208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddd4b6-6cc4-4523-8a37-18e1c350f429 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:13.548571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55c43c-a59f-45bd-83df-df48fa54935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:13.549565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55c43c-a59f-45bd-83df-df48fa54935e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:13.549950 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55c43c-a59f-45bd-83df-df48fa54935e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:13.550294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55c43c-a59f-45bd-83df-df48fa54935e None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:13.551271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55c43c-a59f-45bd-83df-df48fa54935e None admin] RBAC: Adding query filter params (type=network) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:13.551655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55c43c-a59f-45bd-83df-df48fa54935e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:13.553399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55c43c-a59f-45bd-83df-df48fa54935e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:13.561137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 406/824] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 20 22:28:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:13.569182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55c43c-a59f-45bd-83df-df48fa54935e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:13.679272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddd4b6-6cc4-4523-8a37-18e1c350f429 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:13.735523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254c25-b0dc-41c5-a912-4f4f66251933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:13.736254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254c25-b0dc-41c5-a912-4f4f66251933 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:13.736539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254c25-b0dc-41c5-a912-4f4f66251933 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:13.736817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db254c25-b0dc-41c5-a912-4f4f66251933 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:13.737745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db254c25-b0dc-41c5-a912-4f4f66251933 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:13.738155 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db254c25-b0dc-41c5-a912-4f4f66251933 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:13.739603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db254c25-b0dc-41c5-a912-4f4f66251933 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:13.739713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55c43c-a59f-45bd-83df-df48fa54935e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:13.762870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 419/825] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 20 22:28:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:13.764926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254c25-b0dc-41c5-a912-4f4f66251933 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:13.777202 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306185e4-1ce9-4131-bf13-5cb6f83f0375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:13.777953 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306185e4-1ce9-4131-bf13-5cb6f83f0375 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:13.778239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306185e4-1ce9-4131-bf13-5cb6f83f0375 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:13.778518 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306185e4-1ce9-4131-bf13-5cb6f83f0375 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:13.779531 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306185e4-1ce9-4131-bf13-5cb6f83f0375 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:13.780990 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306185e4-1ce9-4131-bf13-5cb6f83f0375 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:13.794115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:13.876425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db254c25-b0dc-41c5-a912-4f4f66251933 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:13.876739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:13.890851 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 407/826] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 20 22:28:13 2022] POST /identity/v3/endpoints => generated 327 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:28:13.938873 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889aa07-efeb-4425-8d88-f83d299df99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:13.939551 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889aa07-efeb-4425-8d88-f83d299df99f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:13.940178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889aa07-efeb-4425-8d88-f83d299df99f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:13.940462 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8889aa07-efeb-4425-8d88-f83d299df99f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:14.036203 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889aa07-efeb-4425-8d88-f83d299df99f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:14.037682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8889aa07-efeb-4425-8d88-f83d299df99f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:14.049936 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:14.156850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 420/827] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:28:13 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 22:28:14.162989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306185e4-1ce9-4131-bf13-5cb6f83f0375 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:14.273659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306185e4-1ce9-4131-bf13-5cb6f83f0375 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:14.313521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d9cd1-93ac-4199-b045-4931bba3ef2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:14.314372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d9cd1-93ac-4199-b045-4931bba3ef2b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:14.314664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d9cd1-93ac-4199-b045-4931bba3ef2b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:14.314944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746d9cd1-93ac-4199-b045-4931bba3ef2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:14.327217 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d9cd1-93ac-4199-b045-4931bba3ef2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:14.328657 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746d9cd1-93ac-4199-b045-4931bba3ef2b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-746d9cd1-93ac-4199-b045-4931bba3ef2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:14.348305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:14.349278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:14.350241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:14.350241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:14.350241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:14.350241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:14.350241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 408/828] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:14.355606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889aa07-efeb-4425-8d88-f83d299df99f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:14.477753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8889aa07-efeb-4425-8d88-f83d299df99f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:14.490711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:14.521180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15ff19-80af-4867-b913-d90a269f52f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:14.521898 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15ff19-80af-4867-b913-d90a269f52f7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:14.522190 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15ff19-80af-4867-b913-d90a269f52f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:14.522466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15ff19-80af-4867-b913-d90a269f52f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:14.523205 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15ff19-80af-4867-b913-d90a269f52f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:14.523578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15ff19-80af-4867-b913-d90a269f52f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:14.525171 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15ff19-80af-4867-b913-d90a269f52f7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:14.541868 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 421/829] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:14.543668 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d9cd1-93ac-4199-b045-4931bba3ef2b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:14.600362 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:14.656052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746d9cd1-93ac-4199-b045-4931bba3ef2b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:14.692083 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7b225-3eea-4d72-964a-5b490b905913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:14.692913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7b225-3eea-4d72-964a-5b490b905913 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:14.693278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7b225-3eea-4d72-964a-5b490b905913 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:14.693557 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7b225-3eea-4d72-964a-5b490b905913 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:14.701317 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7b225-3eea-4d72-964a-5b490b905913 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:14.702912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7b225-3eea-4d72-964a-5b490b905913 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-83e7b225-3eea-4d72-964a-5b490b905913 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:14.718914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:14.719927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:14.720942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:14.720942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:14.720942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:14.720942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:14.720942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:14.720942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:14.720942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:14.720942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:14.725175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 409/830] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:14.726699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15ff19-80af-4867-b913-d90a269f52f7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:14.835627 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15ff19-80af-4867-b913-d90a269f52f7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:14.874274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc819e5-08cc-4189-80e0-aa2cf00c0340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:14.875009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc819e5-08cc-4189-80e0-aa2cf00c0340 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:14.875295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc819e5-08cc-4189-80e0-aa2cf00c0340 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:14.875610 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc819e5-08cc-4189-80e0-aa2cf00c0340 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:14.876442 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc819e5-08cc-4189-80e0-aa2cf00c0340 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:14.876795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc819e5-08cc-4189-80e0-aa2cf00c0340 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:14.878263 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc819e5-08cc-4189-80e0-aa2cf00c0340 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:14.898925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 422/831] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:14.902988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7b225-3eea-4d72-964a-5b490b905913 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:15.008165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7b225-3eea-4d72-964a-5b490b905913 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:15.034226 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:15.045822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52bf27-3058-43a8-9743-48536837cc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:15.046496 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52bf27-3058-43a8-9743-48536837cc71 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:15.046782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52bf27-3058-43a8-9743-48536837cc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:15.047063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52bf27-3058-43a8-9743-48536837cc71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:15.047917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52bf27-3058-43a8-9743-48536837cc71 None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=67c92c8d2b9d41e489e4c03ae4e71fe2) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:15.048296 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52bf27-3058-43a8-9743-48536837cc71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:15.050004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52bf27-3058-43a8-9743-48536837cc71 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:15.057057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 410/832] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:28:14 2022] GET /identity/v3/role_assignments?user.id=67c92c8d2b9d41e489e4c03ae4e71fe2&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:15.367553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414540d-5583-42fe-a4db-28db2732afc9 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:15.368198 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414540d-5583-42fe-a4db-28db2732afc9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:15.368690 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414540d-5583-42fe-a4db-28db2732afc9 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:15.370526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 423/833] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:15.376934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43092c5a-8dd1-49d3-8972-914a886b7cb7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:15.377492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43092c5a-8dd1-49d3-8972-914a886b7cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:15.378013 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43092c5a-8dd1-49d3-8972-914a886b7cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:15.395207 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-43092c5a-8dd1-49d3-8972-914a886b7cb7 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:15.396700 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-43092c5a-8dd1-49d3-8972-914a886b7cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:15.473763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 411/834] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:15.492990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414540d-5583-42fe-a4db-28db2732afc9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:15.523096 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:15.607718 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414540d-5583-42fe-a4db-28db2732afc9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:15.643494 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa0643-91c1-47c0-b9cd-b9b69942d653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:15.644220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa0643-91c1-47c0-b9cd-b9b69942d653 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:15.644499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa0643-91c1-47c0-b9cd-b9b69942d653 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:15.644777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa0643-91c1-47c0-b9cd-b9b69942d653 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:15.645430 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa0643-91c1-47c0-b9cd-b9b69942d653 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:15.647040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fa0643-91c1-47c0-b9cd-b9b69942d653 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-57fa0643-91c1-47c0-b9cd-b9b69942d653 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:15.659774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:15.660858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:15.661748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 424/835] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:28:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:15.669330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43092c5a-8dd1-49d3-8972-914a886b7cb7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:15.740537 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aab2e-0636-4eec-bd24-ae4e0ec44909 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:15.741066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aab2e-0636-4eec-bd24-ae4e0ec44909 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:15.741171 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aab2e-0636-4eec-bd24-ae4e0ec44909 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:15.742921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 425/836] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:28:15.749109 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e3c6-7878-4271-a3b8-4cdf6a00921d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:15.749410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e3c6-7878-4271-a3b8-4cdf6a00921d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:15.749667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e3c6-7878-4271-a3b8-4cdf6a00921d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:15.768379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3aa1e3c6-7878-4271-a3b8-4cdf6a00921d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:15.769605 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3aa1e3c6-7878-4271-a3b8-4cdf6a00921d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:15.847305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 426/837] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:15.848845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b41fd9-9a1a-4524-9e20-ad4890e1c1df None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:15.849216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b41fd9-9a1a-4524-9e20-ad4890e1c1df None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:15.849420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b41fd9-9a1a-4524-9e20-ad4890e1c1df None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:15.851081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 427/838] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:15.856421 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b1f63-4a22-4dfb-83d1-3d330a246f7f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:15.857357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b1f63-4a22-4dfb-83d1-3d330a246f7f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:15.857662 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b1f63-4a22-4dfb-83d1-3d330a246f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:15.874823 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-040b1f63-4a22-4dfb-83d1-3d330a246f7f None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:15.876211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-040b1f63-4a22-4dfb-83d1-3d330a246f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:15.894970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:15.903431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43092c5a-8dd1-49d3-8972-914a886b7cb7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:15.906581 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:15.939438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0fd9e-0038-41e8-9a07-a69914194dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:15.940107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0fd9e-0038-41e8-9a07-a69914194dfb None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:15.940391 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0fd9e-0038-41e8-9a07-a69914194dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:15.940668 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0fd9e-0038-41e8-9a07-a69914194dfb None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:15.941391 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0fd9e-0038-41e8-9a07-a69914194dfb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:15.941690 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0fd9e-0038-41e8-9a07-a69914194dfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:15.943130 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0fd9e-0038-41e8-9a07-a69914194dfb None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:15.946029 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 428/839] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:15.947020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b1f63-4a22-4dfb-83d1-3d330a246f7f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:15.956568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 412/840] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:28:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:15.962177 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0fd9e-0038-41e8-9a07-a69914194dfb None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:16.052646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b1f63-4a22-4dfb-83d1-3d330a246f7f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:16.074678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0fd9e-0038-41e8-9a07-a69914194dfb None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:16.095004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534680d-2e3a-4397-b1ac-ece683880ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:16.095817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534680d-2e3a-4397-b1ac-ece683880ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:16.096092 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534680d-2e3a-4397-b1ac-ece683880ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:16.096365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534680d-2e3a-4397-b1ac-ece683880ea6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:16.107503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534680d-2e3a-4397-b1ac-ece683880ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:16.114508 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75c41b-b85a-4849-b974-bc846da618ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:16.115176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75c41b-b85a-4849-b974-bc846da618ab None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c534680d-2e3a-4397-b1ac-ece683880ea6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:16.115364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:16.116295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:16.117181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:16.117181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:16.117181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:16.117181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:16.117181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:16.117181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:16.117181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:16.117181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:16.117181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:16.117181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:16.117181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:28:16.117181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:16.117857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75c41b-b85a-4849-b974-bc846da618ab None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:16.117857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75c41b-b85a-4849-b974-bc846da618ab None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:16.117857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75c41b-b85a-4849-b974-bc846da618ab None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:16.118059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 429/841] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:28:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:16.118059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534680d-2e3a-4397-b1ac-ece683880ea6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:16.121755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75c41b-b85a-4849-b974-bc846da618ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:16.124373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75c41b-b85a-4849-b974-bc846da618ab None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:16.129864 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 413/842] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:28:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:16.130656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75c41b-b85a-4849-b974-bc846da618ab None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:16.150854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:16.185507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:16.251347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534680d-2e3a-4397-b1ac-ece683880ea6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:16.290513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75c41b-b85a-4849-b974-bc846da618ab None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:16.299055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d097b3-bcfc-4ca0-84ae-0a0d2b6441f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:16.299860 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d097b3-bcfc-4ca0-84ae-0a0d2b6441f8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:16.300137 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d097b3-bcfc-4ca0-84ae-0a0d2b6441f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:16.300410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d097b3-bcfc-4ca0-84ae-0a0d2b6441f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:16.313580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d097b3-bcfc-4ca0-84ae-0a0d2b6441f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-30d097b3-bcfc-4ca0-84ae-0a0d2b6441f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:16.321336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:16.322385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:16.323268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:16.323268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:16.323268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:16.323268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:16.323268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:16.323268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:16.323268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:16.323268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:16.323268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:16.323268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:16.323268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:16.323268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:16.323268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 430/843] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:28:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:16.329200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d097b3-bcfc-4ca0-84ae-0a0d2b6441f8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:16.339344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48552b-7388-4488-b942-32d2e5fb9e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:16.339574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48552b-7388-4488-b942-32d2e5fb9e51 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:16.339960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48552b-7388-4488-b942-32d2e5fb9e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:16.340236 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48552b-7388-4488-b942-32d2e5fb9e51 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:16.340989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48552b-7388-4488-b942-32d2e5fb9e51 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:16.341327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48552b-7388-4488-b942-32d2e5fb9e51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:16.342840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a48552b-7388-4488-b942-32d2e5fb9e51 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:16.352260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 414/844] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:28:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:16.359028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48552b-7388-4488-b942-32d2e5fb9e51 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:16.419270 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:16.452638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d097b3-bcfc-4ca0-84ae-0a0d2b6441f8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:16.475631 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:16.485021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48552b-7388-4488-b942-32d2e5fb9e51 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:16.490607 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad40d71-22c6-4013-bbc8-22c01fcd6f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:16.491505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad40d71-22c6-4013-bbc8-22c01fcd6f43 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:16.491961 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad40d71-22c6-4013-bbc8-22c01fcd6f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:16.492425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad40d71-22c6-4013-bbc8-22c01fcd6f43 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:16.493362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad40d71-22c6-4013-bbc8-22c01fcd6f43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:16.493933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad40d71-22c6-4013-bbc8-22c01fcd6f43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:16.495531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad40d71-22c6-4013-bbc8-22c01fcd6f43 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:16.505570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 431/845] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:28:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:16.511103 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad40d71-22c6-4013-bbc8-22c01fcd6f43 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:16.530722 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67fea1-a4ed-4e17-a097-051fec670bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:16.531830 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67fea1-a4ed-4e17-a097-051fec670bea None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:16.532330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67fea1-a4ed-4e17-a097-051fec670bea None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:16.532778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67fea1-a4ed-4e17-a097-051fec670bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:16.544381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67fea1-a4ed-4e17-a097-051fec670bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:16.546622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67fea1-a4ed-4e17-a097-051fec670bea None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-3e67fea1-a4ed-4e17-a097-051fec670bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:16.566632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:16.567643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:16.568605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:16.568605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:16.568605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:16.568605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:16.570571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 415/846] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:16.578696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67fea1-a4ed-4e17-a097-051fec670bea None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:16.626989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad40d71-22c6-4013-bbc8-22c01fcd6f43 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:16.665047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9701d3-8a8e-4296-a5a7-2632cd7addbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:16.666369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9701d3-8a8e-4296-a5a7-2632cd7addbf None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:16.666877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9701d3-8a8e-4296-a5a7-2632cd7addbf None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:16.667310 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9701d3-8a8e-4296-a5a7-2632cd7addbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:16.670127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:16.680549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9701d3-8a8e-4296-a5a7-2632cd7addbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:16.682329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9701d3-8a8e-4296-a5a7-2632cd7addbf None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:16.686430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67fea1-a4ed-4e17-a097-051fec670bea None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-9e9701d3-8a8e-4296-a5a7-2632cd7addbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:16.702115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:16.703262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:16.704392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:16.704392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:16.704392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:16.704392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:16.706408 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 432/847] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:16.712148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9701d3-8a8e-4296-a5a7-2632cd7addbf None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:16.730773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b834f4b-aef6-4300-bf23-72e704cba904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:16.732512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b834f4b-aef6-4300-bf23-72e704cba904 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:16.733100 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b834f4b-aef6-4300-bf23-72e704cba904 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:16.733515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b834f4b-aef6-4300-bf23-72e704cba904 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:16.734678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b834f4b-aef6-4300-bf23-72e704cba904 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:16.735616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b834f4b-aef6-4300-bf23-72e704cba904 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:16.737389 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b834f4b-aef6-4300-bf23-72e704cba904 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:16.754815 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 416/848] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:16.761589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b834f4b-aef6-4300-bf23-72e704cba904 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:16.772183 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:16.834783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9701d3-8a8e-4296-a5a7-2632cd7addbf None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:16.871677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d666c49-1179-4e17-b2f2-a5c69b2060dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:16.872415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d666c49-1179-4e17-b2f2-a5c69b2060dd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:16.872848 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d666c49-1179-4e17-b2f2-a5c69b2060dd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:16.873128 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d666c49-1179-4e17-b2f2-a5c69b2060dd None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:16.873994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d666c49-1179-4e17-b2f2-a5c69b2060dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:16.874303 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d666c49-1179-4e17-b2f2-a5c69b2060dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:16.875827 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d666c49-1179-4e17-b2f2-a5c69b2060dd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:16.881205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b834f4b-aef6-4300-bf23-72e704cba904 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:16.893349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 433/849] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:16.895629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d666c49-1179-4e17-b2f2-a5c69b2060dd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:16.926454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92289367-ea11-41f7-8070-efcfdc96921b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:16.927424 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289367-ea11-41f7-8070-efcfdc96921b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:16.928061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289367-ea11-41f7-8070-efcfdc96921b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:16.928458 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289367-ea11-41f7-8070-efcfdc96921b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:16.938518 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92289367-ea11-41f7-8070-efcfdc96921b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:16.940245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92289367-ea11-41f7-8070-efcfdc96921b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:16.954785 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-92289367-ea11-41f7-8070-efcfdc96921b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:16.960361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:16.966155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:16.967575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:16.967575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:16.967575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:16.967575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:16.967575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:16.967575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:16.967575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:16.967575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:16.967575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 22:28:16.967575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:16.967575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 417/850] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Jul 20 22:28:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:16.971607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92289367-ea11-41f7-8070-efcfdc96921b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:17.039222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d666c49-1179-4e17-b2f2-a5c69b2060dd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:17.043467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:17.081054 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92289367-ea11-41f7-8070-efcfdc96921b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:17.091896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045feb0f-2511-4115-9e30-ada4aa83e4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:17.093315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045feb0f-2511-4115-9e30-ada4aa83e4f5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:17.093692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045feb0f-2511-4115-9e30-ada4aa83e4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:17.094088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045feb0f-2511-4115-9e30-ada4aa83e4f5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:17.106815 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045feb0f-2511-4115-9e30-ada4aa83e4f5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:17.108335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045feb0f-2511-4115-9e30-ada4aa83e4f5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:17.128672 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffec262-a7bc-4a39-8758-c9b1d2dca1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:17.129346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffec262-a7bc-4a39-8758-c9b1d2dca1df None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:17.129628 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffec262-a7bc-4a39-8758-c9b1d2dca1df None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:17.129935 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffec262-a7bc-4a39-8758-c9b1d2dca1df None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-045feb0f-2511-4115-9e30-ada4aa83e4f5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:17.130479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:17.131396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:17.132368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:17.132368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:17.132368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:17.132368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:17.132368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:17.132368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:17.132368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:17.132368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:17.132368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 22:28:17.132368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:17.132945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffec262-a7bc-4a39-8758-c9b1d2dca1df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:17.132945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffec262-a7bc-4a39-8758-c9b1d2dca1df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:17.132945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffec262-a7bc-4a39-8758-c9b1d2dca1df None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:17.136432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 434/851] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:28:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:17.142559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045feb0f-2511-4115-9e30-ada4aa83e4f5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:17.160187 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 418/852] 10.222.0.83 () {56 vars in 1149 bytes} [Wed Jul 20 22:28:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:17.161765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffec262-a7bc-4a39-8758-c9b1d2dca1df None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:17.266370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045feb0f-2511-4115-9e30-ada4aa83e4f5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:17.272207 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffec262-a7bc-4a39-8758-c9b1d2dca1df None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:17.277704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:17.299082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:17.304048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80db1c-fe33-4c2f-a6c3-bbaf7991d9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:17.304743 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80db1c-fe33-4c2f-a6c3-bbaf7991d9cf None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:17.305011 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80db1c-fe33-4c2f-a6c3-bbaf7991d9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:17.305281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80db1c-fe33-4c2f-a6c3-bbaf7991d9cf None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:17.306151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80db1c-fe33-4c2f-a6c3-bbaf7991d9cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:17.306510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80db1c-fe33-4c2f-a6c3-bbaf7991d9cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:17.307934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80db1c-fe33-4c2f-a6c3-bbaf7991d9cf None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:17.311125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a2d48-8973-404d-9b8a-f31f6248f579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:17.311796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a2d48-8973-404d-9b8a-f31f6248f579 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:17.312973 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a2d48-8973-404d-9b8a-f31f6248f579 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:17.313266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a2d48-8973-404d-9b8a-f31f6248f579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:17.334179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 435/853] 10.222.0.83 () {56 vars in 1135 bytes} [Wed Jul 20 22:28:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:17.335752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cdfc0-00af-4fb5-8698-7b1527b888eb None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:17.336044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cdfc0-00af-4fb5-8698-7b1527b888eb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:17.336324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cdfc0-00af-4fb5-8698-7b1527b888eb None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:17.337905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 436/854] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:17.338607 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cdfc0-00af-4fb5-8698-7b1527b888eb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:17.395304 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a2d48-8973-404d-9b8a-f31f6248f579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:17.396760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a2d48-8973-404d-9b8a-f31f6248f579 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:17.451035 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cdfc0-00af-4fb5-8698-7b1527b888eb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:17.490025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8b2bc-22ea-4a64-9c69-f7a721b49340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:17.490832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b2bc-22ea-4a64-9c69-f7a721b49340 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:17.491214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b2bc-22ea-4a64-9c69-f7a721b49340 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:17.491618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b2bc-22ea-4a64-9c69-f7a721b49340 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:17.505715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 419/855] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:28:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:28:17.507234 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46f8e0-7567-40a0-8487-b15ce0791507 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:17.507523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46f8e0-7567-40a0-8487-b15ce0791507 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:17.507800 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46f8e0-7567-40a0-8487-b15ce0791507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:17.526335 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-de46f8e0-7567-40a0-8487-b15ce0791507 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:17.527459 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-de46f8e0-7567-40a0-8487-b15ce0791507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:17.529582 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:17.546831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:17.567636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8b2bc-22ea-4a64-9c69-f7a721b49340 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:17.569088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b8b2bc-22ea-4a64-9c69-f7a721b49340 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:17.609927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 420/856] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:17 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:17.609927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46f8e0-7567-40a0-8487-b15ce0791507 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:17.690120 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 437/857] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:28:17 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:28:17.691142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8b2bc-22ea-4a64-9c69-f7a721b49340 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:17.711464 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46f8e0-7567-40a0-8487-b15ce0791507 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:17.749072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6892118-70fc-49aa-9571-d163722e8840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:17.750191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6892118-70fc-49aa-9571-d163722e8840 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:17.750616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6892118-70fc-49aa-9571-d163722e8840 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:17.751143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6892118-70fc-49aa-9571-d163722e8840 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:17.762586 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6892118-70fc-49aa-9571-d163722e8840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:17.764970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:17.766391 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6892118-70fc-49aa-9571-d163722e8840 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-c6892118-70fc-49aa-9571-d163722e8840 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:17.786294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:17.787253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:17.788336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:17.788336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:17.788336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:17.788336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:17.791078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 421/858] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:17.791698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6892118-70fc-49aa-9571-d163722e8840 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:17.800972 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:17.806588 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8b2bc-22ea-4a64-9c69-f7a721b49340 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:17.844513 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222372c-ca85-43e2-bec3-12f0e26213a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:17.845335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222372c-ca85-43e2-bec3-12f0e26213a8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:17.845615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222372c-ca85-43e2-bec3-12f0e26213a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:17.845919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222372c-ca85-43e2-bec3-12f0e26213a8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:17.846582 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222372c-ca85-43e2-bec3-12f0e26213a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:17.847946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222372c-ca85-43e2-bec3-12f0e26213a8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1222372c-ca85-43e2-bec3-12f0e26213a8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:17.861030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:17.862098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:17.862973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 438/859] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Jul 20 22:28:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:17.864426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222372c-ca85-43e2-bec3-12f0e26213a8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:17.905214 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6892118-70fc-49aa-9571-d163722e8840 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:17.940188 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2209ef-f3e7-49d5-812f-5851b907dfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:17.940994 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2209ef-f3e7-49d5-812f-5851b907dfcb None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:17.941283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2209ef-f3e7-49d5-812f-5851b907dfcb None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:17.941562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2209ef-f3e7-49d5-812f-5851b907dfcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:17.953192 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2209ef-f3e7-49d5-812f-5851b907dfcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:17.954681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2209ef-f3e7-49d5-812f-5851b907dfcb None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:17.969652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222372c-ca85-43e2-bec3-12f0e26213a8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-eb2209ef-f3e7-49d5-812f-5851b907dfcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:17.972196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:17.973101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:17.974056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:17.974056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:17.974056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:17.974056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:17.974056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 422/860] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:17.974360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2209ef-f3e7-49d5-812f-5851b907dfcb None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:18.004756 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:18.015503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b8f9e-e440-4a98-ae58-cac34258a7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:18.016611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b8f9e-e440-4a98-ae58-cac34258a7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:18.016902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b8f9e-e440-4a98-ae58-cac34258a7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:18.017176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b8f9e-e440-4a98-ae58-cac34258a7d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:18.017933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b8f9e-e440-4a98-ae58-cac34258a7d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:18.018282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b8f9e-e440-4a98-ae58-cac34258a7d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:18.019732 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b8f9e-e440-4a98-ae58-cac34258a7d7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:18.039724 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 439/861] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:18.043932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:18.045065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b8f9e-e440-4a98-ae58-cac34258a7d7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:18.093178 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2209ef-f3e7-49d5-812f-5851b907dfcb None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:18.133801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a01b75-55dd-4f56-a229-0005bc7485af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:18.134622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a01b75-55dd-4f56-a229-0005bc7485af None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:18.134805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a01b75-55dd-4f56-a229-0005bc7485af None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:18.135034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a01b75-55dd-4f56-a229-0005bc7485af None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:18.135906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a01b75-55dd-4f56-a229-0005bc7485af None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:18.136098 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a01b75-55dd-4f56-a229-0005bc7485af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:18.137442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a01b75-55dd-4f56-a229-0005bc7485af None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:18.142977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 423/862] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 20 22:28:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:18.143584 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a01b75-55dd-4f56-a229-0005bc7485af None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:18.164829 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b8f9e-e440-4a98-ae58-cac34258a7d7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:18.201590 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f60b3c-4bb1-4ad1-9e2d-cc3a363fb796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:18.202301 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f60b3c-4bb1-4ad1-9e2d-cc3a363fb796 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:18.202581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f60b3c-4bb1-4ad1-9e2d-cc3a363fb796 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:18.202853 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f60b3c-4bb1-4ad1-9e2d-cc3a363fb796 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:18.203584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f60b3c-4bb1-4ad1-9e2d-cc3a363fb796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:18.203891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f60b3c-4bb1-4ad1-9e2d-cc3a363fb796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:18.205254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f60b3c-4bb1-4ad1-9e2d-cc3a363fb796 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:18.217424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 440/863] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:18.218402 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f60b3c-4bb1-4ad1-9e2d-cc3a363fb796 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:18.257257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a01b75-55dd-4f56-a229-0005bc7485af None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:18.270443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:18.279791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:18.291463 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ebf8b-225a-4276-8ed8-bb45e94eade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:18.291881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ebf8b-225a-4276-8ed8-bb45e94eade9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:18.292165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ebf8b-225a-4276-8ed8-bb45e94eade9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:18.292436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93ebf8b-225a-4276-8ed8-bb45e94eade9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:18.300738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ebf8b-225a-4276-8ed8-bb45e94eade9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:18.302212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93ebf8b-225a-4276-8ed8-bb45e94eade9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-a93ebf8b-225a-4276-8ed8-bb45e94eade9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:18.316835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:18.317927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:18.324879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:18.324879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:18.324879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:18.324879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:18.324879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:18.324879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:18.324879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:18.324879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:18.324879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 424/864] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:18.324879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ebf8b-225a-4276-8ed8-bb45e94eade9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:18.325472 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f60b3c-4bb1-4ad1-9e2d-cc3a363fb796 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:18.355255 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180b53a-9ce0-429e-8006-9b6b4be37aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:18.355925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180b53a-9ce0-429e-8006-9b6b4be37aff None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:18.356206 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180b53a-9ce0-429e-8006-9b6b4be37aff None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:18.356482 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180b53a-9ce0-429e-8006-9b6b4be37aff None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:18.357798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180b53a-9ce0-429e-8006-9b6b4be37aff None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:18.358110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180b53a-9ce0-429e-8006-9b6b4be37aff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:18.359471 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180b53a-9ce0-429e-8006-9b6b4be37aff None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:18.364404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 441/865] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 20 22:28:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:18.365917 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1eb57-495d-42d2-be0c-e8e3793b674e None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:18.366173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1eb57-495d-42d2-be0c-e8e3793b674e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:18.366457 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1eb57-495d-42d2-be0c-e8e3793b674e None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:18.369771 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 442/866] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:18.369771 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1eb57-495d-42d2-be0c-e8e3793b674e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:18.438713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93ebf8b-225a-4276-8ed8-bb45e94eade9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:18.477956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafba755-b7eb-42cc-b3a0-785a722cd564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:18.479038 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafba755-b7eb-42cc-b3a0-785a722cd564 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:18.479315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafba755-b7eb-42cc-b3a0-785a722cd564 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:18.479589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafba755-b7eb-42cc-b3a0-785a722cd564 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:18.487891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafba755-b7eb-42cc-b3a0-785a722cd564 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:18.488905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1eb57-495d-42d2-be0c-e8e3793b674e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:18.489350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafba755-b7eb-42cc-b3a0-785a722cd564 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:18.503772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-cafba755-b7eb-42cc-b3a0-785a722cd564 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:18.506939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:18.507849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:18.508784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:18.508784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:18.508784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:18.508784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:18.508784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:18.508784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:18.508784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:18.508784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:18.508784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 425/867] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:18.509763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b73ff-0cca-49ac-827b-ba9380272499 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:18.509763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b73ff-0cca-49ac-827b-ba9380272499 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:18.510136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b73ff-0cca-49ac-827b-ba9380272499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:18.529757 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b33b73ff-0cca-49ac-827b-ba9380272499 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:18.531218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b33b73ff-0cca-49ac-827b-ba9380272499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:18.535418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a0a77-b275-4612-9e27-6b31cd55a4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:18.536094 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a0a77-b275-4612-9e27-6b31cd55a4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:18.536376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a0a77-b275-4612-9e27-6b31cd55a4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:18.536650 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a0a77-b275-4612-9e27-6b31cd55a4e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:18.537528 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a0a77-b275-4612-9e27-6b31cd55a4e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:18.537830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a0a77-b275-4612-9e27-6b31cd55a4e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:18.540820 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a0a77-b275-4612-9e27-6b31cd55a4e0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:18.554415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 443/868] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:18.555319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a0a77-b275-4612-9e27-6b31cd55a4e0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:18.573858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:18.611430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 426/869] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:18.612421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b73ff-0cca-49ac-827b-ba9380272499 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:18.664757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a0a77-b275-4612-9e27-6b31cd55a4e0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:18.701019 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea83190-5f53-4c11-9f4b-30a4d2a33169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:18.701746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea83190-5f53-4c11-9f4b-30a4d2a33169 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:18.702043 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea83190-5f53-4c11-9f4b-30a4d2a33169 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:18.702328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea83190-5f53-4c11-9f4b-30a4d2a33169 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:18.703127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea83190-5f53-4c11-9f4b-30a4d2a33169 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:18.703470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea83190-5f53-4c11-9f4b-30a4d2a33169 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:18.704897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea83190-5f53-4c11-9f4b-30a4d2a33169 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:18.717473 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 444/870] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:18.718321 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea83190-5f53-4c11-9f4b-30a4d2a33169 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:18.736016 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b73ff-0cca-49ac-827b-ba9380272499 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:18.756260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:18.773201 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8f27d-72a0-4337-b4bd-4834ccb0c4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:18.773902 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8f27d-72a0-4337-b4bd-4834ccb0c4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:18.774185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8f27d-72a0-4337-b4bd-4834ccb0c4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:18.774558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8f27d-72a0-4337-b4bd-4834ccb0c4d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:18.775411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8f27d-72a0-4337-b4bd-4834ccb0c4d6 None admin] RBAC: Adding query filter params (role.id=2a5f2a34d0b341e58b642fc48dc7c5da, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=ec5aca1c7f334dab8e7ca86573118d07) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:18.775751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8f27d-72a0-4337-b4bd-4834ccb0c4d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:18.777557 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a8f27d-72a0-4337-b4bd-4834ccb0c4d6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:18.784768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 427/871] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:28:18 2022] GET /identity/v3/role_assignments?user.id=ec5aca1c7f334dab8e7ca86573118d07&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=2a5f2a34d0b341e58b642fc48dc7c5da => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:18.785805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8f27d-72a0-4337-b4bd-4834ccb0c4d6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:18.839536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:18.841933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea83190-5f53-4c11-9f4b-30a4d2a33169 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:18.883425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef51b6-f6b8-468d-a3f8-c869e02b2e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:18.884155 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef51b6-f6b8-468d-a3f8-c869e02b2e9d None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:18.884600 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef51b6-f6b8-468d-a3f8-c869e02b2e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:18.885007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef51b6-f6b8-468d-a3f8-c869e02b2e9d None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:18.886088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef51b6-f6b8-468d-a3f8-c869e02b2e9d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:18.887806 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef51b6-f6b8-468d-a3f8-c869e02b2e9d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:18.927939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8f27d-72a0-4337-b4bd-4834ccb0c4d6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:18.962009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 445/872] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 20 22:28:18 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:28:18.982695 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04ae9f-f572-4360-8702-b961bd15be8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:18.984094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04ae9f-f572-4360-8702-b961bd15be8b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:18.984554 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04ae9f-f572-4360-8702-b961bd15be8b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:18.985017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04ae9f-f572-4360-8702-b961bd15be8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:18.986089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04ae9f-f572-4360-8702-b961bd15be8b None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=146610a7cbbc46928a4a8d710c4d1942) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:18.986590 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04ae9f-f572-4360-8702-b961bd15be8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:18.988267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04ae9f-f572-4360-8702-b961bd15be8b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:18.995837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 428/873] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:28:18 2022] GET /identity/v3/role_assignments?user.id=146610a7cbbc46928a4a8d710c4d1942&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:20.436420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41333c-6f09-4b96-9cd8-b8c32bc8e7db None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:20.437033 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41333c-6f09-4b96-9cd8-b8c32bc8e7db None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:20.437033 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41333c-6f09-4b96-9cd8-b8c32bc8e7db None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:20.438628 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 446/874] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:20.443870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7b34c-b725-4f66-843f-406fa7753d69 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:20.444264 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7b34c-b725-4f66-843f-406fa7753d69 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:20.444431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7b34c-b725-4f66-843f-406fa7753d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:20.461261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-62f7b34c-b725-4f66-843f-406fa7753d69 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:20.462479 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-62f7b34c-b725-4f66-843f-406fa7753d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:20.539895 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 429/875] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:20 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:20.563231 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41333c-6f09-4b96-9cd8-b8c32bc8e7db None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:20.666421 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:20.677369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41333c-6f09-4b96-9cd8-b8c32bc8e7db None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:20.714386 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a1bf97-4b98-4461-a14c-874510c42b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:20.714977 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1bf97-4b98-4461-a14c-874510c42b73 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:20.715259 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1bf97-4b98-4461-a14c-874510c42b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:20.715551 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a1bf97-4b98-4461-a14c-874510c42b73 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:20.716509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1bf97-4b98-4461-a14c-874510c42b73 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:20.718001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a1bf97-4b98-4461-a14c-874510c42b73 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:20.820921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 447/876] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 20 22:28:20 2022] POST /identity/v3/services => generated 269 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:28:20.989392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a9b4f-1a6b-4c36-9393-6db1ba2f2b4c None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:20.989392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a9b4f-1a6b-4c36-9393-6db1ba2f2b4c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:20.989392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a9b4f-1a6b-4c36-9393-6db1ba2f2b4c None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:20.990368 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 430/877] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:20.995919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422faec-9968-4b8e-a01d-ea040741ff7b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:20.996211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422faec-9968-4b8e-a01d-ea040741ff7b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:20.996493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422faec-9968-4b8e-a01d-ea040741ff7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:21.014531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3422faec-9968-4b8e-a01d-ea040741ff7b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:21.015735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3422faec-9968-4b8e-a01d-ea040741ff7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:21.096743 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 448/878] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:21.098887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeda395-a2b9-4a69-b4e2-cde13807ec6e None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:21.099411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeda395-a2b9-4a69-b4e2-cde13807ec6e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:21.099906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeda395-a2b9-4a69-b4e2-cde13807ec6e None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:21.101689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 431/879] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:21.107929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa333b4-de05-45f8-aae5-6f404f21ef88 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:21.108468 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa333b4-de05-45f8-aae5-6f404f21ef88 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:21.108949 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa333b4-de05-45f8-aae5-6f404f21ef88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:21.121424 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeda395-a2b9-4a69-b4e2-cde13807ec6e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:21.131158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6fa333b4-de05-45f8-aae5-6f404f21ef88 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:21.132349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6fa333b4-de05-45f8-aae5-6f404f21ef88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:21.170273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:21.212717 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 449/880] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:21.214412 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7b407-d147-489f-b821-295d53dcef79 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:21.214953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7b407-d147-489f-b821-295d53dcef79 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:21.215443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7b407-d147-489f-b821-295d53dcef79 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:21.217885 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 450/881] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:21.223040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13490912-fff0-46e6-bfe5-a0b17dfb6725 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:21.223557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13490912-fff0-46e6-bfe5-a0b17dfb6725 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:21.224055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13490912-fff0-46e6-bfe5-a0b17dfb6725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:21.241853 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-13490912-fff0-46e6-bfe5-a0b17dfb6725 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:21.243114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-13490912-fff0-46e6-bfe5-a0b17dfb6725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:21.245131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:21.245387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeda395-a2b9-4a69-b4e2-cde13807ec6e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:21.283833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66ea4e-010b-4dea-919b-7480f6e48f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:21.284899 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66ea4e-010b-4dea-919b-7480f6e48f2b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:21.285370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66ea4e-010b-4dea-919b-7480f6e48f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:21.285620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66ea4e-010b-4dea-919b-7480f6e48f2b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:21.296393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66ea4e-010b-4dea-919b-7480f6e48f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-1b66ea4e-010b-4dea-919b-7480f6e48f2b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:21.304999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:21.306168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:21.307072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:21.307072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:21.307072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:21.307072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:21.307072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:21.307072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:21.307072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:21.307072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:21.307072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:21.307072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:21.307072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 22:28:21.307072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:21.307072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 432/882] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Jul 20 22:28:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:21.307788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66ea4e-010b-4dea-919b-7480f6e48f2b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:21.319641 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 451/883] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:21.320724 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13490912-fff0-46e6-bfe5-a0b17dfb6725 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:21.411142 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:21.427185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66ea4e-010b-4dea-919b-7480f6e48f2b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:21.436007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13490912-fff0-46e6-bfe5-a0b17dfb6725 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:21.464369 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f114e-6e54-4c19-8ce1-2edb7cd3f21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:21.465290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f114e-6e54-4c19-8ce1-2edb7cd3f21c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:21.465574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f114e-6e54-4c19-8ce1-2edb7cd3f21c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:21.466727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f114e-6e54-4c19-8ce1-2edb7cd3f21c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:21.467390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f114e-6e54-4c19-8ce1-2edb7cd3f21c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:21.468750 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839f114e-6e54-4c19-8ce1-2edb7cd3f21c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:21.474685 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5cf19-587f-46c8-a4b3-3c4e5dcd3a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:21.475360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5cf19-587f-46c8-a4b3-3c4e5dcd3a06 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:21.475644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5cf19-587f-46c8-a4b3-3c4e5dcd3a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:21.475921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c5cf19-587f-46c8-a4b3-3c4e5dcd3a06 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:21.476670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5cf19-587f-46c8-a4b3-3c4e5dcd3a06 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:21.476979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5cf19-587f-46c8-a4b3-3c4e5dcd3a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:21.478623 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c5cf19-587f-46c8-a4b3-3c4e5dcd3a06 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-839f114e-6e54-4c19-8ce1-2edb7cd3f21c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:21.481085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:21.482348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:21.483809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 433/884] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:28:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:21.484663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f114e-6e54-4c19-8ce1-2edb7cd3f21c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:21.484736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:21.496698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 452/885] 10.222.0.83 () {56 vars in 1115 bytes} [Wed Jul 20 22:28:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:21.496698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5cf19-587f-46c8-a4b3-3c4e5dcd3a06 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:21.596692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f114e-6e54-4c19-8ce1-2edb7cd3f21c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:21.606180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c5cf19-587f-46c8-a4b3-3c4e5dcd3a06 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:21.634244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3836588-4da1-4975-ab18-f992c7005d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:21.635107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3836588-4da1-4975-ab18-f992c7005d21 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:21.635756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3836588-4da1-4975-ab18-f992c7005d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:21.635756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3836588-4da1-4975-ab18-f992c7005d21 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:21.636356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3836588-4da1-4975-ab18-f992c7005d21 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:21.638828 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3836588-4da1-4975-ab18-f992c7005d21 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:21.645943 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38228b98-8541-4410-835f-e529f851bcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:21.646616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38228b98-8541-4410-835f-e529f851bcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:21.646905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38228b98-8541-4410-835f-e529f851bcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:21.647184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38228b98-8541-4410-835f-e529f851bcb5 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:21.647899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38228b98-8541-4410-835f-e529f851bcb5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:21.648214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38228b98-8541-4410-835f-e529f851bcb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:21.649578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38228b98-8541-4410-835f-e529f851bcb5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-b3836588-4da1-4975-ab18-f992c7005d21 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:21.651912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:21.658649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:21.659710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 434/886] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 20 22:28:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:21.660776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3836588-4da1-4975-ab18-f992c7005d21 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:21.670190 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 453/887] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:28:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:21.670190 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38228b98-8541-4410-835f-e529f851bcb5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:21.675743 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:21.742749 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:21.769528 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3836588-4da1-4975-ab18-f992c7005d21 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:21.786979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38228b98-8541-4410-835f-e529f851bcb5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:21.806332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b6a57-50b0-41a9-9e4e-05c7149a0b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:21.807137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b6a57-50b0-41a9-9e4e-05c7149a0b5b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:21.807418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b6a57-50b0-41a9-9e4e-05c7149a0b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:21.807693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b6a57-50b0-41a9-9e4e-05c7149a0b5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:21.820146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b6a57-50b0-41a9-9e4e-05c7149a0b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:21.821597 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b6a57-50b0-41a9-9e4e-05c7149a0b5b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:21.825268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c578b2-bfea-41da-8f17-fedfcf64bd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:21.826695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c578b2-bfea-41da-8f17-fedfcf64bd83 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:21.826989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c578b2-bfea-41da-8f17-fedfcf64bd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:21.827269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c578b2-bfea-41da-8f17-fedfcf64bd83 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:21.827985 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c578b2-bfea-41da-8f17-fedfcf64bd83 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:21.828295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c578b2-bfea-41da-8f17-fedfcf64bd83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:21.829736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c578b2-bfea-41da-8f17-fedfcf64bd83 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:21.834638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 454/888] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Jul 20 22:28:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:21.835429 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c578b2-bfea-41da-8f17-fedfcf64bd83 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-de0b6a57-50b0-41a9-9e4e-05c7149a0b5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:21.841529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:21.842954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:21.844077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:21.844077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:21.844077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:21.844077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:21.845644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 435/889] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:21.846579 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b6a57-50b0-41a9-9e4e-05c7149a0b5b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:21.917417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:21.952220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c578b2-bfea-41da-8f17-fedfcf64bd83 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:21.953068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b6a57-50b0-41a9-9e4e-05c7149a0b5b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:21.979094 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:21.988092 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfdc0c-3f6e-4499-8d7b-3f9051a4cb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:21.988766 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfdc0c-3f6e-4499-8d7b-3f9051a4cb38 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:21.989049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfdc0c-3f6e-4499-8d7b-3f9051a4cb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:21.989323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfdc0c-3f6e-4499-8d7b-3f9051a4cb38 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:21.989927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38761c41-c143-4a3a-bc99-095920620418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:21.990078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfdc0c-3f6e-4499-8d7b-3f9051a4cb38 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:21.990370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfdc0c-3f6e-4499-8d7b-3f9051a4cb38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:21.990596 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38761c41-c143-4a3a-bc99-095920620418 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:21.990878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38761c41-c143-4a3a-bc99-095920620418 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:21.991155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38761c41-c143-4a3a-bc99-095920620418 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:21.991872 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38761c41-c143-4a3a-bc99-095920620418 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:21.992183 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38761c41-c143-4a3a-bc99-095920620418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:21.992656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfdc0c-3f6e-4499-8d7b-3f9051a4cb38 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:21.993530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38761c41-c143-4a3a-bc99-095920620418 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:22.005762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 436/890] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Jul 20 22:28:21 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:22.005762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38761c41-c143-4a3a-bc99-095920620418 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:22.006042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 455/891] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:28:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:22.006042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfdc0c-3f6e-4499-8d7b-3f9051a4cb38 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:22.132973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfdc0c-3f6e-4499-8d7b-3f9051a4cb38 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:22.154584 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38761c41-c143-4a3a-bc99-095920620418 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:22.183340 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea8e10-628b-456b-99c0-64da25b05bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:22.184139 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea8e10-628b-456b-99c0-64da25b05bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:22.184428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea8e10-628b-456b-99c0-64da25b05bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:22.184799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eea8e10-628b-456b-99c0-64da25b05bb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:22.186035 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea8e10-628b-456b-99c0-64da25b05bb6 None admin] RBAC: Adding query filter params (interface=public, service_id=d6b339e4333b44718a2aa8de8575f391, region_id=RegionOne) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:22.186356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea8e10-628b-456b-99c0-64da25b05bb6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:22.187745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eea8e10-628b-456b-99c0-64da25b05bb6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:22.189277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:22.193387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 456/892] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 20 22:28:22 2022] GET /identity/v3/endpoints?service_id=d6b339e4333b44718a2aa8de8575f391&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:22.195409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f136e56-694a-457d-98e0-a1a870037281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:22.196081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f136e56-694a-457d-98e0-a1a870037281 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:22.196361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f136e56-694a-457d-98e0-a1a870037281 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:22.196635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f136e56-694a-457d-98e0-a1a870037281 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:22.197368 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f136e56-694a-457d-98e0-a1a870037281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:22.197675 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f136e56-694a-457d-98e0-a1a870037281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:22.199157 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f136e56-694a-457d-98e0-a1a870037281 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:22.199836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea8e10-628b-456b-99c0-64da25b05bb6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:22.215495 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 437/893] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:22.223582 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f136e56-694a-457d-98e0-a1a870037281 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:22.272090 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:22.330323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eea8e10-628b-456b-99c0-64da25b05bb6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:22.334852 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f136e56-694a-457d-98e0-a1a870037281 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:22.370760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87198153-b275-478b-9ba8-9c2223a4e4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:22.371302 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bfd5a-668b-4c4d-af0e-03d8549b3222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:22.371551 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87198153-b275-478b-9ba8-9c2223a4e4dc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:22.371841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87198153-b275-478b-9ba8-9c2223a4e4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:22.372115 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87198153-b275-478b-9ba8-9c2223a4e4dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:22.373944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bfd5a-668b-4c4d-af0e-03d8549b3222 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:22.374426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bfd5a-668b-4c4d-af0e-03d8549b3222 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:22.374896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bfd5a-668b-4c4d-af0e-03d8549b3222 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:22.375797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bfd5a-668b-4c4d-af0e-03d8549b3222 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:22.377404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bfd5a-668b-4c4d-af0e-03d8549b3222 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:22.380477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87198153-b275-478b-9ba8-9c2223a4e4dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:22.381952 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87198153-b275-478b-9ba8-9c2223a4e4dc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:22.390013 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 457/894] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 20 22:28:22 2022] GET /identity/v3/services => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-87198153-b275-478b-9ba8-9c2223a4e4dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:22.398526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:22.399561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:22.400534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:22.400534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:22.400534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:22.400534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:22.400534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:22.400534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:22.400534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:22.400534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:22.400534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 22:28:22.400534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:22.400534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 438/895] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Jul 20 22:28:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:22.408502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bfd5a-668b-4c4d-af0e-03d8549b3222 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:22.528373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bfd5a-668b-4c4d-af0e-03d8549b3222 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:22.552880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:22.570253 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a500f-dc02-4e63-93c5-54dcb02b8239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:22.570467 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a500f-dc02-4e63-93c5-54dcb02b8239 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:22.570750 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a500f-dc02-4e63-93c5-54dcb02b8239 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:22.571031 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a500f-dc02-4e63-93c5-54dcb02b8239 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:22.571885 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a500f-dc02-4e63-93c5-54dcb02b8239 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:22.572197 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a500f-dc02-4e63-93c5-54dcb02b8239 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:22.573626 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a500f-dc02-4e63-93c5-54dcb02b8239 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:22.595568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 458/896] 10.222.0.83 () {56 vars in 1149 bytes} [Wed Jul 20 22:28:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:22.601493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87198153-b275-478b-9ba8-9c2223a4e4dc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:22.656397 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:22.709225 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87198153-b275-478b-9ba8-9c2223a4e4dc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:22.745053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58f632-5cc7-49d9-8d61-bd63c53c880b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:22.745736 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58f632-5cc7-49d9-8d61-bd63c53c880b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:22.746032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58f632-5cc7-49d9-8d61-bd63c53c880b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:22.746319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58f632-5cc7-49d9-8d61-bd63c53c880b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:22.818257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58f632-5cc7-49d9-8d61-bd63c53c880b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:22.819712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58f632-5cc7-49d9-8d61-bd63c53c880b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:22.882389 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:22.922906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 439/897] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:28:22 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:28:22.928537 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a500f-dc02-4e63-93c5-54dcb02b8239 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:23.009348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b98bff-58e5-4651-8699-b18bcf66f515 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:23.009672 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b98bff-58e5-4651-8699-b18bcf66f515 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:23.009942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b98bff-58e5-4651-8699-b18bcf66f515 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:23.011465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 440/898] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:28:23.018106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779a97-1243-448c-9497-058a7d1a912d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:23.018400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779a97-1243-448c-9497-058a7d1a912d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:23.018679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01779a97-1243-448c-9497-058a7d1a912d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:23.036772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-01779a97-1243-448c-9497-058a7d1a912d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:23.038017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-01779a97-1243-448c-9497-058a7d1a912d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:23.042984 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a500f-dc02-4e63-93c5-54dcb02b8239 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:23.093300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b7323-6351-47d3-a425-8654da3766c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:23.095170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b7323-6351-47d3-a425-8654da3766c4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:23.095633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b7323-6351-47d3-a425-8654da3766c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:23.096059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b7323-6351-47d3-a425-8654da3766c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:23.111834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b7323-6351-47d3-a425-8654da3766c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:23.113292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b7323-6351-47d3-a425-8654da3766c4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:23.127659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 441/899] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d40b7323-6351-47d3-a425-8654da3766c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:23.136501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:23.137629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:23.138878 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:23.138878 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:23.138878 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:23.138878 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:23.140681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 459/900] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:23.146509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01779a97-1243-448c-9497-058a7d1a912d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:23.155366 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b7323-6351-47d3-a425-8654da3766c4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:23.194053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:23.261620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:23.281426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01779a97-1243-448c-9497-058a7d1a912d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:23.284358 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b7323-6351-47d3-a425-8654da3766c4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:23.318193 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569272f-8bc6-445a-8ccb-4adbee94fca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:23.318856 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569272f-8bc6-445a-8ccb-4adbee94fca8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:23.319383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569272f-8bc6-445a-8ccb-4adbee94fca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:23.319503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569272f-8bc6-445a-8ccb-4adbee94fca8 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:23.320209 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569272f-8bc6-445a-8ccb-4adbee94fca8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:23.320513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569272f-8bc6-445a-8ccb-4adbee94fca8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:23.322262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569272f-8bc6-445a-8ccb-4adbee94fca8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:23.328731 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a99b47-beb4-44e2-9118-f75b5613eee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:23.330263 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99b47-beb4-44e2-9118-f75b5613eee4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:23.330740 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99b47-beb4-44e2-9118-f75b5613eee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:23.331593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a99b47-beb4-44e2-9118-f75b5613eee4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:23.332701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a99b47-beb4-44e2-9118-f75b5613eee4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:23.338657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a99b47-beb4-44e2-9118-f75b5613eee4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:23.338785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 442/901] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:23.340370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569272f-8bc6-445a-8ccb-4adbee94fca8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-47a99b47-beb4-44e2-9118-f75b5613eee4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:23.352541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:23.353852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:23.354738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 460/902] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Jul 20 22:28:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:23.360877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a99b47-beb4-44e2-9118-f75b5613eee4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:23.479440 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569272f-8bc6-445a-8ccb-4adbee94fca8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:23.488151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:23.497232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a99b47-beb4-44e2-9118-f75b5613eee4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:23.528788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d1d7f-429c-457c-86f1-e9127fd85981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:23.530263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d1d7f-429c-457c-86f1-e9127fd85981 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:23.530559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d1d7f-429c-457c-86f1-e9127fd85981 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:23.530839 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d1d7f-429c-457c-86f1-e9127fd85981 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:23.540389 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d1d7f-429c-457c-86f1-e9127fd85981 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:23.542562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d1d7f-429c-457c-86f1-e9127fd85981 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:23.546377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:23.548764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac980c-073c-4bc9-ba6c-d8f524a77248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:23.550087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac980c-073c-4bc9-ba6c-d8f524a77248 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:23.550896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac980c-073c-4bc9-ba6c-d8f524a77248 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:23.551369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac980c-073c-4bc9-ba6c-d8f524a77248 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:23.552354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac980c-073c-4bc9-ba6c-d8f524a77248 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:23.552889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac980c-073c-4bc9-ba6c-d8f524a77248 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:23.554680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac980c-073c-4bc9-ba6c-d8f524a77248 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-4b3d1d7f-429c-457c-86f1-e9127fd85981 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:23.561381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:23.562576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:23.563756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:23.563756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:23.563756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:23.563756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:23.563756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:23.563756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:23.563756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:23.563756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:23.564238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 461/903] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 20 22:28:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:23.568064 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 443/904] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:23.568064 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d1d7f-429c-457c-86f1-e9127fd85981 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:23.568261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac980c-073c-4bc9-ba6c-d8f524a77248 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:23.688010 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac980c-073c-4bc9-ba6c-d8f524a77248 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:23.703716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d1d7f-429c-457c-86f1-e9127fd85981 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:23.724230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ae1c4-8653-40e4-97ff-f0682a588973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:23.724908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ae1c4-8653-40e4-97ff-f0682a588973 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:23.725195 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ae1c4-8653-40e4-97ff-f0682a588973 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:23.725477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62ae1c4-8653-40e4-97ff-f0682a588973 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:23.726265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ae1c4-8653-40e4-97ff-f0682a588973 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:23.726582 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ae1c4-8653-40e4-97ff-f0682a588973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:23.728007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62ae1c4-8653-40e4-97ff-f0682a588973 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:23.734483 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 462/905] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 20 22:28:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:23.739816 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ae1c4-8653-40e4-97ff-f0682a588973 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:23.754026 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880a076-2640-4bc6-8db5-857578cbb8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:23.754971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880a076-2640-4bc6-8db5-857578cbb8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:23.755256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880a076-2640-4bc6-8db5-857578cbb8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:23.755536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880a076-2640-4bc6-8db5-857578cbb8a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:23.757052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880a076-2640-4bc6-8db5-857578cbb8a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:23.757382 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880a076-2640-4bc6-8db5-857578cbb8a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:23.759403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880a076-2640-4bc6-8db5-857578cbb8a0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:23.766320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:23.777901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 444/906] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:23.784470 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880a076-2640-4bc6-8db5-857578cbb8a0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:23.850618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:23.854265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62ae1c4-8653-40e4-97ff-f0682a588973 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:23.891499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293c5fe-ee35-48b6-94da-4917fa907df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:23.892315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293c5fe-ee35-48b6-94da-4917fa907df1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:23.892723 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293c5fe-ee35-48b6-94da-4917fa907df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:23.893076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293c5fe-ee35-48b6-94da-4917fa907df1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:23.894157 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293c5fe-ee35-48b6-94da-4917fa907df1 None admin] RBAC: Adding query filter params (interface=public, service_id=248c8a6b671a4a0eaac38ef2ea075e73, region_id=RegionOne) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:23.894575 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293c5fe-ee35-48b6-94da-4917fa907df1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:23.896514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1293c5fe-ee35-48b6-94da-4917fa907df1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:23.897678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880a076-2640-4bc6-8db5-857578cbb8a0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:23.905768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 463/907] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 20 22:28:23 2022] GET /identity/v3/endpoints?service_id=248c8a6b671a4a0eaac38ef2ea075e73&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:23.909023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293c5fe-ee35-48b6-94da-4917fa907df1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:23.940139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08534ce-c53d-4e5f-8992-3ded28861cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:23.940881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08534ce-c53d-4e5f-8992-3ded28861cee None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:23.941236 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08534ce-c53d-4e5f-8992-3ded28861cee None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:23.941870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08534ce-c53d-4e5f-8992-3ded28861cee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:23.942656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08534ce-c53d-4e5f-8992-3ded28861cee None admin] RBAC: Adding query filter params (role.id=207ec663a0614937a744c94fe30f5ce7, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=ec5aca1c7f334dab8e7ca86573118d07) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:23.943038 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08534ce-c53d-4e5f-8992-3ded28861cee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:23.944643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08534ce-c53d-4e5f-8992-3ded28861cee None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:23.957747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 445/908] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:28:23 2022] GET /identity/v3/role_assignments?user.id=ec5aca1c7f334dab8e7ca86573118d07&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=207ec663a0614937a744c94fe30f5ce7 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:24.017370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:24.034828 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293c5fe-ee35-48b6-94da-4917fa907df1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:24.080852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635b460-8cb5-438d-b9a5-099aa1953639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:24.081985 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b460-8cb5-438d-b9a5-099aa1953639 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:24.085747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b460-8cb5-438d-b9a5-099aa1953639 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:24.085747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b460-8cb5-438d-b9a5-099aa1953639 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:24.085747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635b460-8cb5-438d-b9a5-099aa1953639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:24.085747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635b460-8cb5-438d-b9a5-099aa1953639 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:24.092282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 464/909] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 20 22:28:23 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:28:24.178975 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66130665-1147-4672-b3a1-0036e315fabe None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:24.179262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66130665-1147-4672-b3a1-0036e315fabe None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:24.179546 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66130665-1147-4672-b3a1-0036e315fabe None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:24.181330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 446/910] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:24.187009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa69a0-a145-47f9-971f-3bfef9580623 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:24.187313 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa69a0-a145-47f9-971f-3bfef9580623 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:24.187586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa69a0-a145-47f9-971f-3bfef9580623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:24.208802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1faa69a0-a145-47f9-971f-3bfef9580623 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:24.210435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1faa69a0-a145-47f9-971f-3bfef9580623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:24.288561 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 465/911] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:24.311486 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66130665-1147-4672-b3a1-0036e315fabe None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:24.422641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66130665-1147-4672-b3a1-0036e315fabe None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:24.447745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:24.459343 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64be33-ea39-4c65-b041-36b46ed992a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:24.460087 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64be33-ea39-4c65-b041-36b46ed992a2 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:24.460619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64be33-ea39-4c65-b041-36b46ed992a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:24.460900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64be33-ea39-4c65-b041-36b46ed992a2 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:24.461653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64be33-ea39-4c65-b041-36b46ed992a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:24.463071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64be33-ea39-4c65-b041-36b46ed992a2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:24.577767 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 447/912] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 20 22:28:24 2022] POST /identity/v3/services => generated 241 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:28:24.583457 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e39d5-4830-44e8-a2e9-06cd40e3e042 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:24.583986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e39d5-4830-44e8-a2e9-06cd40e3e042 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:24.584064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e39d5-4830-44e8-a2e9-06cd40e3e042 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:24.585686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 466/913] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:24.591649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8b90e-d483-4928-82e7-57f2de2476c6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:24.592053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8b90e-d483-4928-82e7-57f2de2476c6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:24.592343 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8b90e-d483-4928-82e7-57f2de2476c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:24.613982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c7f8b90e-d483-4928-82e7-57f2de2476c6 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:24.615203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c7f8b90e-d483-4928-82e7-57f2de2476c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:24.705231 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 448/914] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:24.728210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e39d5-4830-44e8-a2e9-06cd40e3e042 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:24.819804 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:24.844050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e39d5-4830-44e8-a2e9-06cd40e3e042 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:24.881220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4651d20-8ef6-4aaf-8592-95b7ea4845b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:24.882162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4651d20-8ef6-4aaf-8592-95b7ea4845b9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:24.882458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4651d20-8ef6-4aaf-8592-95b7ea4845b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:24.882742 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4651d20-8ef6-4aaf-8592-95b7ea4845b9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:24.883405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4651d20-8ef6-4aaf-8592-95b7ea4845b9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:24.884780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4651d20-8ef6-4aaf-8592-95b7ea4845b9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-c4651d20-8ef6-4aaf-8592-95b7ea4845b9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:24.897945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:24.899044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:24.899967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 467/915] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:28:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:24.910844 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8b90e-d483-4928-82e7-57f2de2476c6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:25.016758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8b90e-d483-4928-82e7-57f2de2476c6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:25.027993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:25.052306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38df80f-0e7a-4ecf-af0f-dd865b1e605d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:25.052978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df80f-0e7a-4ecf-af0f-dd865b1e605d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:25.053262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df80f-0e7a-4ecf-af0f-dd865b1e605d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:25.053542 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38df80f-0e7a-4ecf-af0f-dd865b1e605d None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:25.054290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38df80f-0e7a-4ecf-af0f-dd865b1e605d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:25.054600 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38df80f-0e7a-4ecf-af0f-dd865b1e605d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:25.055967 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38df80f-0e7a-4ecf-af0f-dd865b1e605d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:25.061201 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 449/916] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:28:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:25.066764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4651d20-8ef6-4aaf-8592-95b7ea4845b9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:25.189167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4651d20-8ef6-4aaf-8592-95b7ea4845b9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:25.226014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941d84a-2b6e-4bf7-993b-e54007a83034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:25.227055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941d84a-2b6e-4bf7-993b-e54007a83034 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:25.227557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941d84a-2b6e-4bf7-993b-e54007a83034 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:25.228059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941d84a-2b6e-4bf7-993b-e54007a83034 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:25.229235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941d84a-2b6e-4bf7-993b-e54007a83034 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:25.229782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941d84a-2b6e-4bf7-993b-e54007a83034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:25.231376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941d84a-2b6e-4bf7-993b-e54007a83034 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:25.236928 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 468/917] 10.222.0.83 () {56 vars in 1114 bytes} [Wed Jul 20 22:28:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:25.242811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38df80f-0e7a-4ecf-af0f-dd865b1e605d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:25.347293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38df80f-0e7a-4ecf-af0f-dd865b1e605d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:25.383884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec122b61-0828-4619-affb-6f9daed7ab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:25.384935 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec122b61-0828-4619-affb-6f9daed7ab02 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:25.385434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec122b61-0828-4619-affb-6f9daed7ab02 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:25.385967 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec122b61-0828-4619-affb-6f9daed7ab02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:25.386932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec122b61-0828-4619-affb-6f9daed7ab02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:25.388555 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec122b61-0828-4619-affb-6f9daed7ab02 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:25.454460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 450/918] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 20 22:28:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:28:26.147725 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cacd-07cb-4109-983b-b2eba751e8a5 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:26.148274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cacd-07cb-4109-983b-b2eba751e8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:26.148274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cacd-07cb-4109-983b-b2eba751e8a5 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:26.150023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 469/919] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:26.155400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe628-04a0-4b0e-8d29-a64025eff993 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:26.155821 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe628-04a0-4b0e-8d29-a64025eff993 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:26.155979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35fe628-04a0-4b0e-8d29-a64025eff993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:26.172759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d35fe628-04a0-4b0e-8d29-a64025eff993 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:26.173996 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d35fe628-04a0-4b0e-8d29-a64025eff993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:26.198910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:26.255424 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 451/920] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:26.276094 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589cacd-07cb-4109-983b-b2eba751e8a5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:26.287142 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432265e1-e9d3-4d1e-be60-5878f4b64c92 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:26.287453 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432265e1-e9d3-4d1e-be60-5878f4b64c92 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:26.287699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432265e1-e9d3-4d1e-be60-5878f4b64c92 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:26.288087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:26.289392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 452/921] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:28:26.295231 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1713e71-35b8-429a-9c90-9a9ef6ba4db7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:26.295514 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1713e71-35b8-429a-9c90-9a9ef6ba4db7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:26.295789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1713e71-35b8-429a-9c90-9a9ef6ba4db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:26.313244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e1713e71-35b8-429a-9c90-9a9ef6ba4db7 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:26.314468 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e1713e71-35b8-429a-9c90-9a9ef6ba4db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:26.397888 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 453/922] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:26.412741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589cacd-07cb-4109-983b-b2eba751e8a5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:26.421311 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1713e71-35b8-429a-9c90-9a9ef6ba4db7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:26.455381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140126bf-d451-484b-9a44-c535ffcc79f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:26.457247 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140126bf-d451-484b-9a44-c535ffcc79f9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:26.457797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140126bf-d451-484b-9a44-c535ffcc79f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:26.458520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140126bf-d451-484b-9a44-c535ffcc79f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:26.473236 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140126bf-d451-484b-9a44-c535ffcc79f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-140126bf-d451-484b-9a44-c535ffcc79f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:26.483080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:26.484081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:26.484963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:26.484963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:26.484963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:26.484963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:26.484963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:26.484963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:26.484963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:26.484963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:26.484963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:26.484963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:26.484963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 22:28:26.484963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:26.484963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 470/923] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Jul 20 22:28:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:26.490127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140126bf-d451-484b-9a44-c535ffcc79f9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:26.538240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:26.557865 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1713e71-35b8-429a-9c90-9a9ef6ba4db7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:26.584292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:26.601511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bf288-5c63-47e0-9a17-1bfb2f98cd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:26.602395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bf288-5c63-47e0-9a17-1bfb2f98cd6b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:26.602681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bf288-5c63-47e0-9a17-1bfb2f98cd6b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:26.602959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22bf288-5c63-47e0-9a17-1bfb2f98cd6b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:26.603879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bf288-5c63-47e0-9a17-1bfb2f98cd6b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:26.605249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22bf288-5c63-47e0-9a17-1bfb2f98cd6b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-f22bf288-5c63-47e0-9a17-1bfb2f98cd6b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:26.618873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:26.619998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:26.620961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 454/924] 10.222.0.83 () {56 vars in 1132 bytes} [Wed Jul 20 22:28:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:26.627477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bf288-5c63-47e0-9a17-1bfb2f98cd6b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:26.629700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140126bf-d451-484b-9a44-c535ffcc79f9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:26.669645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26896e-ffaa-40da-89dd-a627ec9755fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:26.670753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26896e-ffaa-40da-89dd-a627ec9755fb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:26.671496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26896e-ffaa-40da-89dd-a627ec9755fb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:26.672218 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26896e-ffaa-40da-89dd-a627ec9755fb None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:26.673141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26896e-ffaa-40da-89dd-a627ec9755fb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:26.673602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26896e-ffaa-40da-89dd-a627ec9755fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:26.676153 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a26896e-ffaa-40da-89dd-a627ec9755fb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:26.688394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 471/925] 10.222.0.83 () {56 vars in 1115 bytes} [Wed Jul 20 22:28:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:26.696915 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26896e-ffaa-40da-89dd-a627ec9755fb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:26.760372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22bf288-5c63-47e0-9a17-1bfb2f98cd6b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:26.803088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bbeb2-9ca4-4f72-9188-c984d29d7a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:26.803763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bbeb2-9ca4-4f72-9188-c984d29d7a73 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:26.804046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bbeb2-9ca4-4f72-9188-c984d29d7a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:26.804322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bbeb2-9ca4-4f72-9188-c984d29d7a73 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:26.805079 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bbeb2-9ca4-4f72-9188-c984d29d7a73 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:26.805388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bbeb2-9ca4-4f72-9188-c984d29d7a73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:26.806811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bbeb2-9ca4-4f72-9188-c984d29d7a73 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:26.816349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 455/926] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 20 22:28:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:26.816349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab996b1-7df8-41d6-9ad5-00ed685ebf0d None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:26.816349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab996b1-7df8-41d6-9ad5-00ed685ebf0d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:26.816349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab996b1-7df8-41d6-9ad5-00ed685ebf0d None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:26.816349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 456/927] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:26.818831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab996b1-7df8-41d6-9ad5-00ed685ebf0d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:26.822761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a26896e-ffaa-40da-89dd-a627ec9755fb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:26.835393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:26.855511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:26.863156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bf60c-5374-402d-83da-cdf212561125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:26.863953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bf60c-5374-402d-83da-cdf212561125 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:26.864238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bf60c-5374-402d-83da-cdf212561125 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:26.864543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bf60c-5374-402d-83da-cdf212561125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:26.875807 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bf60c-5374-402d-83da-cdf212561125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:26.877234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8bf60c-5374-402d-83da-cdf212561125 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-fe8bf60c-5374-402d-83da-cdf212561125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:26.894373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:26.895372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:26.896331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:26.896331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:26.896331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:26.896331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:26.901410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 472/928] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:26.902739 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d94ba4-ea7b-4196-9803-0bb202d474b3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:26.903023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d94ba4-ea7b-4196-9803-0bb202d474b3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:26.903299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d94ba4-ea7b-4196-9803-0bb202d474b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:26.920636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b1d94ba4-ea7b-4196-9803-0bb202d474b3 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:26.921782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b1d94ba4-ea7b-4196-9803-0bb202d474b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:26.934827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab996b1-7df8-41d6-9ad5-00ed685ebf0d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:26.969662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e772a8-72b8-4ad7-adf3-d52f8664ab2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:26.970376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e772a8-72b8-4ad7-adf3-d52f8664ab2b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:26.970661 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e772a8-72b8-4ad7-adf3-d52f8664ab2b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:26.970937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e772a8-72b8-4ad7-adf3-d52f8664ab2b None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:26.971653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e772a8-72b8-4ad7-adf3-d52f8664ab2b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:26.971958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e772a8-72b8-4ad7-adf3-d52f8664ab2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:26.973319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e772a8-72b8-4ad7-adf3-d52f8664ab2b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:26.978863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 457/929] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 20 22:28:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:26.979633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e772a8-72b8-4ad7-adf3-d52f8664ab2b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:26.996113 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 473/930] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:26.997472 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d94ba4-ea7b-4196-9803-0bb202d474b3 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:27.077954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:27.105505 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e772a8-72b8-4ad7-adf3-d52f8664ab2b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:27.112849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d94ba4-ea7b-4196-9803-0bb202d474b3 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:27.127052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:27.142986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ce228-3798-47d8-9497-551389e525ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:27.143657 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ce228-3798-47d8-9497-551389e525ec None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:27.143942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ce228-3798-47d8-9497-551389e525ec None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:27.144218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ce228-3798-47d8-9497-551389e525ec None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:27.144946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ce228-3798-47d8-9497-551389e525ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:27.145285 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ce228-3798-47d8-9497-551389e525ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:27.146750 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ce228-3798-47d8-9497-551389e525ec None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:27.150026 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df839cb-c88c-4646-a2b0-d374d67a3eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:27.150688 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df839cb-c88c-4646-a2b0-d374d67a3eb9 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:27.151017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df839cb-c88c-4646-a2b0-d374d67a3eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:27.151241 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df839cb-c88c-4646-a2b0-d374d67a3eb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:27.151987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df839cb-c88c-4646-a2b0-d374d67a3eb9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:27.153986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df839cb-c88c-4646-a2b0-d374d67a3eb9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:27.165342 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 458/931] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:27.165342 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ce228-3798-47d8-9497-551389e525ec None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:27.262230 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ce228-3798-47d8-9497-551389e525ec None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:27.297694 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648c791-b365-4ad3-9d67-1464c03d5b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:27.298516 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648c791-b365-4ad3-9d67-1464c03d5b3d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:27.298796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648c791-b365-4ad3-9d67-1464c03d5b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:27.299071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648c791-b365-4ad3-9d67-1464c03d5b3d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:27.299724 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648c791-b365-4ad3-9d67-1464c03d5b3d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:27.301083 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648c791-b365-4ad3-9d67-1464c03d5b3d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-6648c791-b365-4ad3-9d67-1464c03d5b3d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:27.313078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:27.314174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:27.315043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 459/932] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 20 22:28:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:27.316045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648c791-b365-4ad3-9d67-1464c03d5b3d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:27.322346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:27.333980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 474/933] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 20 22:28:26 2022] POST /identity/v3/endpoints => generated 347 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:28:27.335083 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df839cb-c88c-4646-a2b0-d374d67a3eb9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:27.464009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648c791-b365-4ad3-9d67-1464c03d5b3d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:27.500112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df839cb-c88c-4646-a2b0-d374d67a3eb9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:27.513818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349e247-e646-45d0-bc8a-3ff701fe2f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:27.514624 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349e247-e646-45d0-bc8a-3ff701fe2f43 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:27.514904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349e247-e646-45d0-bc8a-3ff701fe2f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:27.515183 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349e247-e646-45d0-bc8a-3ff701fe2f43 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:27.526176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349e247-e646-45d0-bc8a-3ff701fe2f43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:27.526856 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349e247-e646-45d0-bc8a-3ff701fe2f43 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:27.542382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52989399-6f3f-4ac2-976e-44d7a1e20a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:27.543058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52989399-6f3f-4ac2-976e-44d7a1e20a56 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:27.543340 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52989399-6f3f-4ac2-976e-44d7a1e20a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:27.543615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52989399-6f3f-4ac2-976e-44d7a1e20a56 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:27.544492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52989399-6f3f-4ac2-976e-44d7a1e20a56 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:27.544859 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52989399-6f3f-4ac2-976e-44d7a1e20a56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:27.546206 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52989399-6f3f-4ac2-976e-44d7a1e20a56 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-f349e247-e646-45d0-bc8a-3ff701fe2f43 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:27.546443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:27.547400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:27.548399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:27.548399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:27.548399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:27.548399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:27.548399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:27.548399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:27.548399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:27.548399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:27.548399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 22:28:27.548399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:27.548981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 460/934] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Jul 20 22:28:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:27.552109 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 475/935] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Jul 20 22:28:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:27.557367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349e247-e646-45d0-bc8a-3ff701fe2f43 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:27.559280 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52989399-6f3f-4ac2-976e-44d7a1e20a56 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:27.591582 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:27.639746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:27.667767 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52989399-6f3f-4ac2-976e-44d7a1e20a56 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:27.679940 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349e247-e646-45d0-bc8a-3ff701fe2f43 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:27.705085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a7e96-d53b-4a3c-958a-0977a70101fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:27.708274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a7e96-d53b-4a3c-958a-0977a70101fb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:27.708274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a7e96-d53b-4a3c-958a-0977a70101fb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:27.708274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a7e96-d53b-4a3c-958a-0977a70101fb None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:27.708274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a7e96-d53b-4a3c-958a-0977a70101fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:27.708274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a7e96-d53b-4a3c-958a-0977a70101fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:27.708779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a7e96-d53b-4a3c-958a-0977a70101fb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:27.713742 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 476/936] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Jul 20 22:28:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:27.715021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b642f3-1d24-4566-97d3-ef86b93cf919 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:27.715305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b642f3-1d24-4566-97d3-ef86b93cf919 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:27.715573 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b642f3-1d24-4566-97d3-ef86b93cf919 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:27.717771 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 477/937] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:27.719398 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b642f3-1d24-4566-97d3-ef86b93cf919 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:27.730398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420b1d1-7655-47d4-9739-5b920e2f60cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:27.731300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420b1d1-7655-47d4-9739-5b920e2f60cd None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:27.732656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420b1d1-7655-47d4-9739-5b920e2f60cd None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:27.732898 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420b1d1-7655-47d4-9739-5b920e2f60cd None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:27.733833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420b1d1-7655-47d4-9739-5b920e2f60cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:27.734238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420b1d1-7655-47d4-9739-5b920e2f60cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:27.735607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420b1d1-7655-47d4-9739-5b920e2f60cd None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:27.754890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 461/938] 10.222.0.83 () {56 vars in 1149 bytes} [Wed Jul 20 22:28:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:27.756147 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f354d9a-5f23-4eb4-8674-7d68891864ad None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:27.756442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f354d9a-5f23-4eb4-8674-7d68891864ad None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:27.756748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f354d9a-5f23-4eb4-8674-7d68891864ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:27.774021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0f354d9a-5f23-4eb4-8674-7d68891864ad None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:27.775141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0f354d9a-5f23-4eb4-8674-7d68891864ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:27.832865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:27.843166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b642f3-1d24-4566-97d3-ef86b93cf919 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:27.846190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 462/939] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:27.852084 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f354d9a-5f23-4eb4-8674-7d68891864ad None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:27.887382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639e309-d3c9-4678-b07d-14f18e4c5389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:27.888793 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639e309-d3c9-4678-b07d-14f18e4c5389 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:27.889072 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639e309-d3c9-4678-b07d-14f18e4c5389 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:27.889344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639e309-d3c9-4678-b07d-14f18e4c5389 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:27.890179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639e309-d3c9-4678-b07d-14f18e4c5389 None admin] RBAC: Adding query filter params (interface=public, service_id=b22632fc57c941fdb6c10027921e8cc2, region_id=RegionOne) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:27.890493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639e309-d3c9-4678-b07d-14f18e4c5389 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:27.891868 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0639e309-d3c9-4678-b07d-14f18e4c5389 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:27.901798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 478/940] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 20 22:28:27 2022] GET /identity/v3/endpoints?service_id=b22632fc57c941fdb6c10027921e8cc2&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:27.901798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639e309-d3c9-4678-b07d-14f18e4c5389 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:27.910940 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:27.964167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f354d9a-5f23-4eb4-8674-7d68891864ad None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:28.001844 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08c6e9-1a5e-49a1-b178-47f93f712539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:28.002759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08c6e9-1a5e-49a1-b178-47f93f712539 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:28.003041 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08c6e9-1a5e-49a1-b178-47f93f712539 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:28.003318 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08c6e9-1a5e-49a1-b178-47f93f712539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:28.005400 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639e309-d3c9-4678-b07d-14f18e4c5389 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:28.013940 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08c6e9-1a5e-49a1-b178-47f93f712539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:28.015600 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08c6e9-1a5e-49a1-b178-47f93f712539 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ea08c6e9-1a5e-49a1-b178-47f93f712539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:28.034530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:28.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:28.036608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:28.036608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:28.036608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:28.036608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:28.036608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 463/941] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:28.036608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08c6e9-1a5e-49a1-b178-47f93f712539 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:28.045921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e005674-f749-4eb0-9eba-d9c170815f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:28.046606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e005674-f749-4eb0-9eba-d9c170815f83 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:28.046887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e005674-f749-4eb0-9eba-d9c170815f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:28.047162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e005674-f749-4eb0-9eba-d9c170815f83 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:28.047876 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e005674-f749-4eb0-9eba-d9c170815f83 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:28.049298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e005674-f749-4eb0-9eba-d9c170815f83 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:28.050686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: WARNING keystone.server.flask.common [None req-5e005674-f749-4eb0-9eba-d9c170815f83 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 22:28:28.107831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.sql.core [None req-5e005674-f749-4eb0-9eba-d9c170815f83 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 22:28:28.107831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 22:28:28.107831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [parameters: {'id': 'fb53f5993d4f48d49bad7513af0c2ea8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 22:28:28.107831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80614) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 22:28:28.124835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5e005674-f749-4eb0-9eba-d9c170815f83 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fb53f5993d4f48d49bad7513af0c2ea8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fb53f5993d4f48d49bad7513af0c2ea8. Jul 20 22:28:28.124835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:28.124835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 22:28:28.124835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 22:28:28.124835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 22:28:28.124835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 22:28:28.124835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 22:28:28.124835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 22:28:28.124835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 22:28:28.124835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application conn.query(q) Jul 20 22:28:28.124835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 22:28:28.124835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 22:28:28.124835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result.read() Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 20 22:28:28.125946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application next(self.gen) Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application yield resource Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application next(self.gen) Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise self.value Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application session.commit() Jul 20 22:28:28.127007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.session.flush() Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application compat.raise_( Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 22:28:28.127941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 22:28:28.130040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application conn.query(q) Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result.read() Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 22:28:28.131879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [parameters: {'id': 'fb53f5993d4f48d49bad7513af0c2ea8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:28.133045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:28.134114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:28.135278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:28.135278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 20 22:28:28.135278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 20 22:28:28.135278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:28.135278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:28.135278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 20 22:28:28.135278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 20 22:28:28.135278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fb53f5993d4f48d49bad7513af0c2ea8. Jul 20 22:28:28.135278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:28.135278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 479/942] 10.222.0.83 () {60 vars in 1140 bytes} [Wed Jul 20 22:28:27 2022] POST /identity/v3/projects => generated 262 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:28.135278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e005674-f749-4eb0-9eba-d9c170815f83 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:28.151054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:28.161012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08c6e9-1a5e-49a1-b178-47f93f712539 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:28.163099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:28.196539 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968b496-4dba-4abe-b414-5118e704a38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:28.197334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968b496-4dba-4abe-b414-5118e704a38f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:28.197682 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968b496-4dba-4abe-b414-5118e704a38f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:28.198056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968b496-4dba-4abe-b414-5118e704a38f None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:28.198815 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968b496-4dba-4abe-b414-5118e704a38f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:28.200849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968b496-4dba-4abe-b414-5118e704a38f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:28.207609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 464/943] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 20 22:28:28 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:28:28.208533 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968b496-4dba-4abe-b414-5118e704a38f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:28.259868 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e005674-f749-4eb0-9eba-d9c170815f83 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:28.308407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112838ea-ff52-4215-8eec-8e197ac434d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:28.309498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112838ea-ff52-4215-8eec-8e197ac434d6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:28.310956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112838ea-ff52-4215-8eec-8e197ac434d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:28.311563 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112838ea-ff52-4215-8eec-8e197ac434d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:28.312598 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112838ea-ff52-4215-8eec-8e197ac434d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:28.313216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112838ea-ff52-4215-8eec-8e197ac434d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:28.315361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112838ea-ff52-4215-8eec-8e197ac434d6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:28.334049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968b496-4dba-4abe-b414-5118e704a38f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:28.340109 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 480/944] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:28.341682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112838ea-ff52-4215-8eec-8e197ac434d6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:28.381603 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3346dbf-5286-4dec-ac87-14100becf0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:28.383613 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3346dbf-5286-4dec-ac87-14100becf0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:28.384051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3346dbf-5286-4dec-ac87-14100becf0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:28.384500 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3346dbf-5286-4dec-ac87-14100becf0d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:28.394103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3346dbf-5286-4dec-ac87-14100becf0d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:28.396411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3346dbf-5286-4dec-ac87-14100becf0d5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-b3346dbf-5286-4dec-ac87-14100becf0d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:28.413599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:28.414616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:28.415537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:28.415537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:28.415537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:28.415537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:28.415537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:28.415537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:28.415537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:28.415537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:28.415537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 465/945] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:28.427119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3346dbf-5286-4dec-ac87-14100becf0d5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:28.430083 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:28.466768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:28.467149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112838ea-ff52-4215-8eec-8e197ac434d6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:28.508625 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ac078-57e2-465b-a2c8-33bb962d5e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:28.509978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ac078-57e2-465b-a2c8-33bb962d5e98 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:28.510268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ac078-57e2-465b-a2c8-33bb962d5e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:28.510533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ac078-57e2-465b-a2c8-33bb962d5e98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:28.519098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ac078-57e2-465b-a2c8-33bb962d5e98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:28.520546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ac078-57e2-465b-a2c8-33bb962d5e98 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-080ac078-57e2-465b-a2c8-33bb962d5e98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:28.536005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:28.537068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:28.538496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:28.538496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:28.538496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:28.538496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:28.538496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:28.538496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:28.538496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:28.538496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:28.538496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 481/946] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:28.543265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ac078-57e2-465b-a2c8-33bb962d5e98 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:28.560638 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3346dbf-5286-4dec-ac87-14100becf0d5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:28.610461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2097b-3605-4d55-92f3-d8336d08d09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:28.611393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2097b-3605-4d55-92f3-d8336d08d09e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:28.611820 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2097b-3605-4d55-92f3-d8336d08d09e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:28.612238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2097b-3605-4d55-92f3-d8336d08d09e None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:28.613173 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2097b-3605-4d55-92f3-d8336d08d09e None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:28.613659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2097b-3605-4d55-92f3-d8336d08d09e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:28.615302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2097b-3605-4d55-92f3-d8336d08d09e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:28.633969 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 466/947] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 20 22:28:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:28.663465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ac078-57e2-465b-a2c8-33bb962d5e98 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:28.698169 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:28.704934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe2db1-a2f4-4042-bacf-2e61b772d8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:28.705677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe2db1-a2f4-4042-bacf-2e61b772d8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:28.706030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe2db1-a2f4-4042-bacf-2e61b772d8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:28.706306 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe2db1-a2f4-4042-bacf-2e61b772d8b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:28.707148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe2db1-a2f4-4042-bacf-2e61b772d8b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:28.707440 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe2db1-a2f4-4042-bacf-2e61b772d8b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:28.709012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fe2db1-a2f4-4042-bacf-2e61b772d8b4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:28.725521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 482/948] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:28.733406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2097b-3605-4d55-92f3-d8336d08d09e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:28.833378 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:28.848195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2097b-3605-4d55-92f3-d8336d08d09e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:28.885827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9baa1e-518c-4ff3-9985-26946a817ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:28.886733 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9baa1e-518c-4ff3-9985-26946a817ad0 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:28.887021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9baa1e-518c-4ff3-9985-26946a817ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:28.887299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9baa1e-518c-4ff3-9985-26946a817ad0 None admin] PATH_INFO: `/v3/projects/8cec07c864274d649ecd1944be870bd5/users/ec5aca1c7f334dab8e7ca86573118d07/roles/207ec663a0614937a744c94fe30f5ce7` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:28.889911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9baa1e-518c-4ff3-9985-26946a817ad0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cec07c864274d649ecd1944be870bd5, user_id=ec5aca1c7f334dab8e7ca86573118d07, role_id=207ec663a0614937a744c94fe30f5ce7)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:28.891366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9baa1e-518c-4ff3-9985-26946a817ad0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:28.998056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 467/949] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:28:28 2022] PUT /identity/v3/projects/8cec07c864274d649ecd1944be870bd5/users/ec5aca1c7f334dab8e7ca86573118d07/roles/207ec663a0614937a744c94fe30f5ce7 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:28:29.525268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71414187-9f42-4f46-8b70-10cb4878d8ec None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:29.525846 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71414187-9f42-4f46-8b70-10cb4878d8ec None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:29.526089 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71414187-9f42-4f46-8b70-10cb4878d8ec None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:29.527822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 483/950] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:29.533316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf6737-b42f-40c7-8855-3ee2c59a1186 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:29.533768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf6737-b42f-40c7-8855-3ee2c59a1186 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:29.534093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf6737-b42f-40c7-8855-3ee2c59a1186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:29.551441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-edaf6737-b42f-40c7-8855-3ee2c59a1186 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:29.552624 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-edaf6737-b42f-40c7-8855-3ee2c59a1186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:29.621166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 468/951] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:29.644047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71414187-9f42-4f46-8b70-10cb4878d8ec None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:29.753332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71414187-9f42-4f46-8b70-10cb4878d8ec None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:29.788264 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fbc0e-9576-4de8-921d-0cef73e43460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:29.788979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fbc0e-9576-4de8-921d-0cef73e43460 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:29.789258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fbc0e-9576-4de8-921d-0cef73e43460 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:29.789537 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4fbc0e-9576-4de8-921d-0cef73e43460 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:29.790212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fbc0e-9576-4de8-921d-0cef73e43460 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:29.791564 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4fbc0e-9576-4de8-921d-0cef73e43460 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-ac4fbc0e-9576-4de8-921d-0cef73e43460 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:29.804126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:29.805394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:29.806371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 484/952] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:29.811886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf6737-b42f-40c7-8855-3ee2c59a1186 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:29.891123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:29.916480 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf6737-b42f-40c7-8855-3ee2c59a1186 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:29.952712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7d1f5-94dc-4dae-9dfb-e341406ef8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:29.953381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7d1f5-94dc-4dae-9dfb-e341406ef8da None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:29.953660 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7d1f5-94dc-4dae-9dfb-e341406ef8da None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:29.953966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7d1f5-94dc-4dae-9dfb-e341406ef8da None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:29.954732 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7d1f5-94dc-4dae-9dfb-e341406ef8da None admin] RBAC: Adding query filter params (name=compute) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:29.955039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7d1f5-94dc-4dae-9dfb-e341406ef8da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:29.956449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7d1f5-94dc-4dae-9dfb-e341406ef8da None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:29.961598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 469/953] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 20 22:28:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:29.968120 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fbc0e-9576-4de8-921d-0cef73e43460 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:30.026408 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:30.071150 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4fbc0e-9576-4de8-921d-0cef73e43460 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:30.105669 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256679e-daf1-4326-b32e-b63fde92de98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:30.106367 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256679e-daf1-4326-b32e-b63fde92de98 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:30.106367 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256679e-daf1-4326-b32e-b63fde92de98 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:30.107445 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256679e-daf1-4326-b32e-b63fde92de98 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:30.108183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256679e-daf1-4326-b32e-b63fde92de98 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:30.108490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256679e-daf1-4326-b32e-b63fde92de98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:30.109922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256679e-daf1-4326-b32e-b63fde92de98 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:30.115161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 485/954] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 20 22:28:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:30.325649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc7dae-f02e-4520-adbf-ca861cd31e23 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:30.325926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc7dae-f02e-4520-adbf-ca861cd31e23 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:30.326211 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc7dae-f02e-4520-adbf-ca861cd31e23 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:30.327830 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 470/955] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:30.333234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa8c4d-fc80-4120-b9e6-f10713061fce None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:30.333527 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa8c4d-fc80-4120-b9e6-f10713061fce None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:30.333823 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa8c4d-fc80-4120-b9e6-f10713061fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:30.352066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-44fa8c4d-fc80-4120-b9e6-f10713061fce None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:30.353856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-44fa8c4d-fc80-4120-b9e6-f10713061fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:30.424124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 486/956] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:30.446609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc7dae-f02e-4520-adbf-ca861cd31e23 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:30.558518 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc7dae-f02e-4520-adbf-ca861cd31e23 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:30.595716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6980861-1f01-45d0-a5e7-8bceedd660f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:30.596465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6980861-1f01-45d0-a5e7-8bceedd660f5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:30.597072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6980861-1f01-45d0-a5e7-8bceedd660f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:30.597072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6980861-1f01-45d0-a5e7-8bceedd660f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:30.597678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6980861-1f01-45d0-a5e7-8bceedd660f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:30.599074 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6980861-1f01-45d0-a5e7-8bceedd660f5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-c6980861-1f01-45d0-a5e7-8bceedd660f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:30.612088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:30.626181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:30.627055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 471/957] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 20 22:28:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:30.627903 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa8c4d-fc80-4120-b9e6-f10713061fce None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:30.674895 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:30.732263 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa8c4d-fc80-4120-b9e6-f10713061fce None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:30.767078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872f378-d32c-4ebe-ab41-1cdcfc1ec18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:30.767757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872f378-d32c-4ebe-ab41-1cdcfc1ec18f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:30.768039 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872f378-d32c-4ebe-ab41-1cdcfc1ec18f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:30.768313 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872f378-d32c-4ebe-ab41-1cdcfc1ec18f None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:30.769025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872f378-d32c-4ebe-ab41-1cdcfc1ec18f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:30.769331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872f378-d32c-4ebe-ab41-1cdcfc1ec18f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:30.770727 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872f378-d32c-4ebe-ab41-1cdcfc1ec18f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:30.776174 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 487/958] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Jul 20 22:28:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:30.782448 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6980861-1f01-45d0-a5e7-8bceedd660f5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:30.786694 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:30.892657 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6980861-1f01-45d0-a5e7-8bceedd660f5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:30.914401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12299a51-1e2d-493f-a697-a2c9baa2c8ca None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:30.914723 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12299a51-1e2d-493f-a697-a2c9baa2c8ca None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:30.914973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12299a51-1e2d-493f-a697-a2c9baa2c8ca None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:30.916619 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 488/959] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:30.921880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd17bb1-8a47-4fae-acfa-97a11c158b45 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:30.922172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd17bb1-8a47-4fae-acfa-97a11c158b45 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:30.922457 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd17bb1-8a47-4fae-acfa-97a11c158b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:30.929679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82876bad-aea2-4378-a4e0-c6e5fe4be91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:30.930383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82876bad-aea2-4378-a4e0-c6e5fe4be91e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:30.930661 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82876bad-aea2-4378-a4e0-c6e5fe4be91e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:30.930936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82876bad-aea2-4378-a4e0-c6e5fe4be91e None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:30.931650 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82876bad-aea2-4378-a4e0-c6e5fe4be91e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:30.931957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82876bad-aea2-4378-a4e0-c6e5fe4be91e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:30.933326 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82876bad-aea2-4378-a4e0-c6e5fe4be91e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:30.939356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 472/960] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Jul 20 22:28:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:30.940510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-cfd17bb1-8a47-4fae-acfa-97a11c158b45 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:30.941732 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cfd17bb1-8a47-4fae-acfa-97a11c158b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:30.944708 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82876bad-aea2-4378-a4e0-c6e5fe4be91e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:31.026465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:31.033780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 489/961] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:31.062283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd17bb1-8a47-4fae-acfa-97a11c158b45 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:31.074833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82876bad-aea2-4378-a4e0-c6e5fe4be91e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:31.121179 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a2a01-de8b-4d17-9c70-fd152cd87a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:31.123560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a2a01-de8b-4d17-9c70-fd152cd87a43 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:31.124301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a2a01-de8b-4d17-9c70-fd152cd87a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:31.124802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a2a01-de8b-4d17-9c70-fd152cd87a43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:31.125582 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:31.125981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a2a01-de8b-4d17-9c70-fd152cd87a43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:31.128110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a2a01-de8b-4d17-9c70-fd152cd87a43 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:31.190056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd17bb1-8a47-4fae-acfa-97a11c158b45 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:31.223344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 473/962] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 20 22:28:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:28:31.235402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345605-88d8-46ef-b954-323c3c76141a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:31.235699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345605-88d8-46ef-b954-323c3c76141a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:31.235919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46438b05-fcbe-4d9a-b21a-b5b7d2fb71a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:31.236026 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a345605-88d8-46ef-b954-323c3c76141a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:31.236602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46438b05-fcbe-4d9a-b21a-b5b7d2fb71a2 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:31.236883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46438b05-fcbe-4d9a-b21a-b5b7d2fb71a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:31.237159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46438b05-fcbe-4d9a-b21a-b5b7d2fb71a2 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:31.237338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 474/963] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:31.238056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46438b05-fcbe-4d9a-b21a-b5b7d2fb71a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:31.239526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46438b05-fcbe-4d9a-b21a-b5b7d2fb71a2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:31.245240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dce7e-f02b-4ded-8ab5-a48700fe41db None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:31.245240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dce7e-f02b-4ded-8ab5-a48700fe41db None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:31.245240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382dce7e-f02b-4ded-8ab5-a48700fe41db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:31.266890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-382dce7e-f02b-4ded-8ab5-a48700fe41db None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:31.268172 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-382dce7e-f02b-4ded-8ab5-a48700fe41db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:31.298791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.sql.core [None req-46438b05-fcbe-4d9a-b21a-b5b7d2fb71a2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 22:28:31.298791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 22:28:31.298791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [parameters: {'user_id': '26e2bf89b647460589ca40ee71248a5a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 22:28:31.298791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80614) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-46438b05-fcbe-4d9a-b21a-b5b7d2fb71a2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application conn.query(q) Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result.read() Jul 20 22:28:31.311526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 22:28:31.312713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application next(self.gen) Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application yield resource Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application next(self.gen) Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise self.value Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application session.commit() Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 22:28:31.314036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.session.flush() Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application compat.raise_( Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 22:28:31.315167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 22:28:31.316294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application conn.query(q) Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application result.read() Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 22:28:31.317907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [parameters: {'user_id': '26e2bf89b647460589ca40ee71248a5a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:31.320712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 20 22:28:31.322380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 20 22:28:31.324918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 20 22:28:31.324918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 20 22:28:31.324918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 22:28:31.324918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 22:28:31.324918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 22:28:31.324918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:31.327293 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 490/964] 10.222.0.83 () {60 vars in 1131 bytes} [Wed Jul 20 22:28:31 2022] POST /identity/v3/users => generated 160 bytes in 266 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:31.332927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46438b05-fcbe-4d9a-b21a-b5b7d2fb71a2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:31.366693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 475/965] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:31.398678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dce7e-f02b-4ded-8ab5-a48700fe41db None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:31.471659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:31.477775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46438b05-fcbe-4d9a-b21a-b5b7d2fb71a2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:31.481068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:31.517489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382dce7e-f02b-4ded-8ab5-a48700fe41db None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:31.523202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfdfde-cfb1-4b11-9598-2237cb395518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:31.524374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfdfde-cfb1-4b11-9598-2237cb395518 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:31.524841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfdfde-cfb1-4b11-9598-2237cb395518 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:31.525284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfdfde-cfb1-4b11-9598-2237cb395518 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:31.535510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfdfde-cfb1-4b11-9598-2237cb395518 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:31.537919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfdfde-cfb1-4b11-9598-2237cb395518 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:31.554444 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07b9ee-1c0e-4223-b840-1ef5b5d89ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:31.555403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07b9ee-1c0e-4223-b840-1ef5b5d89ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:31.555759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07b9ee-1c0e-4223-b840-1ef5b5d89ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:31.556107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e07b9ee-1c0e-4223-b840-1ef5b5d89ae2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-5abfdfde-cfb1-4b11-9598-2237cb395518 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:31.558285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:31.559405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:31.561880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:31.561880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:31.561880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:31.561880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:31.561880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:31.561880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:31.561880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:31.561880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:31.561880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 22:28:31.561880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:31.569739 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 491/966] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:28:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:31.571336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfdfde-cfb1-4b11-9598-2237cb395518 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:31.574253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e07b9ee-1c0e-4223-b840-1ef5b5d89ae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-9e07b9ee-1c0e-4223-b840-1ef5b5d89ae2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:31.591617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:31.592666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:31.594032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:31.594032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:31.594032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:31.594032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:31.594032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:31.594032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:31.594032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:31.594032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:31.594032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:31.594032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:31.594032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 22:28:31.594032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:31.596681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 476/967] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Jul 20 22:28:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:31.603324 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07b9ee-1c0e-4223-b840-1ef5b5d89ae2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:31.710706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfdfde-cfb1-4b11-9598-2237cb395518 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:31.726719 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e07b9ee-1c0e-4223-b840-1ef5b5d89ae2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:31.742883 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:31.751843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd9320-5ff8-4b50-8eb3-2ef3d8b19fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:31.752747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd9320-5ff8-4b50-8eb3-2ef3d8b19fec None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:31.753291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd9320-5ff8-4b50-8eb3-2ef3d8b19fec None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:31.753579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd9320-5ff8-4b50-8eb3-2ef3d8b19fec None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:31.754440 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd9320-5ff8-4b50-8eb3-2ef3d8b19fec None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:31.754759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd9320-5ff8-4b50-8eb3-2ef3d8b19fec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:31.756226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd9320-5ff8-4b50-8eb3-2ef3d8b19fec None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:31.767109 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e33493-a060-40f7-a2da-f4db5bcc66d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:31.767788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e33493-a060-40f7-a2da-f4db5bcc66d5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:31.768079 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e33493-a060-40f7-a2da-f4db5bcc66d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:31.768408 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e33493-a060-40f7-a2da-f4db5bcc66d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:31.769179 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e33493-a060-40f7-a2da-f4db5bcc66d5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:31.769614 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e33493-a060-40f7-a2da-f4db5bcc66d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:31.771044 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e33493-a060-40f7-a2da-f4db5bcc66d5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:31.780624 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 477/968] 10.222.0.83 () {56 vars in 1115 bytes} [Wed Jul 20 22:28:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:31.786959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e33493-a060-40f7-a2da-f4db5bcc66d5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:31.805881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 492/969] 10.222.0.83 () {56 vars in 1101 bytes} [Wed Jul 20 22:28:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:31.912963 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e33493-a060-40f7-a2da-f4db5bcc66d5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:31.952641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab83c6-97a5-4f69-b677-269345f759fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:31.953895 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab83c6-97a5-4f69-b677-269345f759fa None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:31.954434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab83c6-97a5-4f69-b677-269345f759fa None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:31.954912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab83c6-97a5-4f69-b677-269345f759fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:31.966789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab83c6-97a5-4f69-b677-269345f759fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:31.968674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab83c6-97a5-4f69-b677-269345f759fa None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-78ab83c6-97a5-4f69-b677-269345f759fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:31.994922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:31.995992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:31.998218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:31.998218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:31.998218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:31.998218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:31.998218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 478/970] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:32.003397 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd9320-5ff8-4b50-8eb3-2ef3d8b19fec None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:32.027314 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:32.124513 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd9320-5ff8-4b50-8eb3-2ef3d8b19fec None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:32.160935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c0531-2dd4-4912-8c75-df14a4e215c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:32.161610 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c0531-2dd4-4912-8c75-df14a4e215c3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:32.161930 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c0531-2dd4-4912-8c75-df14a4e215c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:32.162188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c0531-2dd4-4912-8c75-df14a4e215c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:32.162914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c0531-2dd4-4912-8c75-df14a4e215c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:32.163223 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c0531-2dd4-4912-8c75-df14a4e215c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:32.164610 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c0531-2dd4-4912-8c75-df14a4e215c3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:32.177206 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 493/971] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:32.182904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab83c6-97a5-4f69-b677-269345f759fa None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:32.212277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:32.240118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19a7e3-1ebd-4f86-9ba1-ed0f7e694d1e None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:32.240429 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19a7e3-1ebd-4f86-9ba1-ed0f7e694d1e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:32.240681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19a7e3-1ebd-4f86-9ba1-ed0f7e694d1e None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:32.242212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 494/972] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:32.247390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092dc79-aadc-48aa-9838-ebe6f7538c43 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:32.247568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092dc79-aadc-48aa-9838-ebe6f7538c43 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:32.247786 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092dc79-aadc-48aa-9838-ebe6f7538c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:32.264246 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8092dc79-aadc-48aa-9838-ebe6f7538c43 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:32.265772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8092dc79-aadc-48aa-9838-ebe6f7538c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:32.291069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab83c6-97a5-4f69-b677-269345f759fa None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:32.327707 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026de45-5c79-4771-9bb7-8c846448572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:32.328531 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026de45-5c79-4771-9bb7-8c846448572b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:32.328813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026de45-5c79-4771-9bb7-8c846448572b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:32.329090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026de45-5c79-4771-9bb7-8c846448572b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:32.333429 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 495/973] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:32.336371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026de45-5c79-4771-9bb7-8c846448572b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:32.337840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026de45-5c79-4771-9bb7-8c846448572b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-f026de45-5c79-4771-9bb7-8c846448572b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:32.354327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:32.355393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:32.361949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:32.361949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:32.361949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:32.361949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:32.361949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:32.361949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:32.361949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:32.361949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:32.361949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 22:28:32.361949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:32.361949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 479/974] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Jul 20 22:28:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:32.362618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092dc79-aadc-48aa-9838-ebe6f7538c43 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:32.362696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026de45-5c79-4771-9bb7-8c846448572b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:32.373125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:32.456290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:32.468998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092dc79-aadc-48aa-9838-ebe6f7538c43 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:32.469422 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026de45-5c79-4771-9bb7-8c846448572b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:32.504821 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60d35b-fab3-43e4-96f4-89ed66d671fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:32.505414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60d35b-fab3-43e4-96f4-89ed66d671fc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:32.505697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60d35b-fab3-43e4-96f4-89ed66d671fc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:32.506011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60d35b-fab3-43e4-96f4-89ed66d671fc None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:32.506858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60d35b-fab3-43e4-96f4-89ed66d671fc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:32.507166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60d35b-fab3-43e4-96f4-89ed66d671fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:32.508450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed740ad8-d0d1-474e-8f04-788f9ccfcd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:32.508630 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60d35b-fab3-43e4-96f4-89ed66d671fc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:32.509432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed740ad8-d0d1-474e-8f04-788f9ccfcd2a None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:32.509890 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed740ad8-d0d1-474e-8f04-788f9ccfcd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:32.510378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed740ad8-d0d1-474e-8f04-788f9ccfcd2a None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:32.511390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed740ad8-d0d1-474e-8f04-788f9ccfcd2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:32.513289 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed740ad8-d0d1-474e-8f04-788f9ccfcd2a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:32.526249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 480/975] 10.222.0.83 () {56 vars in 1149 bytes} [Wed Jul 20 22:28:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:32.532535 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60d35b-fab3-43e4-96f4-89ed66d671fc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:32.572885 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 496/976] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 20 22:28:32 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:28:32.646468 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60d35b-fab3-43e4-96f4-89ed66d671fc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:32.690618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74fbaa-16c2-4a3c-ab89-36b2e2ad16b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:32.691296 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74fbaa-16c2-4a3c-ab89-36b2e2ad16b0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:32.691575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74fbaa-16c2-4a3c-ab89-36b2e2ad16b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:32.691850 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74fbaa-16c2-4a3c-ab89-36b2e2ad16b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:32.705632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:32.771498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74fbaa-16c2-4a3c-ab89-36b2e2ad16b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:32.772238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74fbaa-16c2-4a3c-ab89-36b2e2ad16b0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:32.880278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 481/977] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:28:32 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:28:32.886083 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed740ad8-d0d1-474e-8f04-788f9ccfcd2a None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:32.958596 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:32.989510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed740ad8-d0d1-474e-8f04-788f9ccfcd2a None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:33.023929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f323e-df08-4338-885f-0fae1b2300a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:33.024647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f323e-df08-4338-885f-0fae1b2300a9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:33.024930 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f323e-df08-4338-885f-0fae1b2300a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:33.025204 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f323e-df08-4338-885f-0fae1b2300a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:33.037062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f323e-df08-4338-885f-0fae1b2300a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:33.038544 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1f323e-df08-4338-885f-0fae1b2300a9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-fe1f323e-df08-4338-885f-0fae1b2300a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:33.056028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:33.057053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:33.058062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:33.058062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:33.058062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:33.058062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:33.058062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 497/978] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:33.064807 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74fbaa-16c2-4a3c-ab89-36b2e2ad16b0 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:33.111765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:33.170119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74fbaa-16c2-4a3c-ab89-36b2e2ad16b0 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:33.209061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a33789-69b7-4470-8754-62e1732050a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:33.209744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a33789-69b7-4470-8754-62e1732050a2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:33.210036 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a33789-69b7-4470-8754-62e1732050a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:33.210314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a33789-69b7-4470-8754-62e1732050a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:33.211042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a33789-69b7-4470-8754-62e1732050a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:33.211352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a33789-69b7-4470-8754-62e1732050a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:33.212726 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a33789-69b7-4470-8754-62e1732050a2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:33.229311 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 482/979] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:33.230994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f323e-df08-4338-885f-0fae1b2300a9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:33.342315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f323e-df08-4338-885f-0fae1b2300a9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:33.366040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:33.377479 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a9f2a-e6db-4a71-840d-dadfc562cb0f None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:33.377797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a9f2a-e6db-4a71-840d-dadfc562cb0f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:33.380658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a9f2a-e6db-4a71-840d-dadfc562cb0f None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:33.380763 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17075b1c-70f6-466e-8024-a7f85e08a91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:33.380862 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 483/980] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:28:33.380974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17075b1c-70f6-466e-8024-a7f85e08a91e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:33.380974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17075b1c-70f6-466e-8024-a7f85e08a91e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:33.381421 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17075b1c-70f6-466e-8024-a7f85e08a91e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:33.384409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71045a-3a23-4af3-a1b7-e4f68f973441 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:33.384703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71045a-3a23-4af3-a1b7-e4f68f973441 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:33.384987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71045a-3a23-4af3-a1b7-e4f68f973441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:33.389767 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17075b1c-70f6-466e-8024-a7f85e08a91e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:33.392448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17075b1c-70f6-466e-8024-a7f85e08a91e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:33.402047 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ef71045a-3a23-4af3-a1b7-e4f68f973441 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:33.403279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ef71045a-3a23-4af3-a1b7-e4f68f973441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-17075b1c-70f6-466e-8024-a7f85e08a91e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:33.410220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:33.411232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:33.412170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:33.412170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:33.412170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:33.412170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:33.412170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:33.412170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:33.412170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:33.412170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:33.412624 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 498/981] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:33.418309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17075b1c-70f6-466e-8024-a7f85e08a91e None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:33.476678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 484/982] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:33.501372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71045a-3a23-4af3-a1b7-e4f68f973441 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:33.524028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17075b1c-70f6-466e-8024-a7f85e08a91e None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:33.532956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:33.567942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c7637-7f10-47d6-bf1a-b64292d12c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:33.568612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c7637-7f10-47d6-bf1a-b64292d12c82 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:33.568915 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c7637-7f10-47d6-bf1a-b64292d12c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:33.569208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c7637-7f10-47d6-bf1a-b64292d12c82 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:33.570030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c7637-7f10-47d6-bf1a-b64292d12c82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:33.570379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c7637-7f10-47d6-bf1a-b64292d12c82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:33.571992 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c7637-7f10-47d6-bf1a-b64292d12c82 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:33.584533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 499/983] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:33.590432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c7637-7f10-47d6-bf1a-b64292d12c82 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:33.615192 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71045a-3a23-4af3-a1b7-e4f68f973441 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:33.634691 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:33.646015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438d83-c12f-4bd3-b6ff-9fe58cbf0bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:33.649645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438d83-c12f-4bd3-b6ff-9fe58cbf0bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:33.649645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438d83-c12f-4bd3-b6ff-9fe58cbf0bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:33.649645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b438d83-c12f-4bd3-b6ff-9fe58cbf0bb5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:33.649645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b438d83-c12f-4bd3-b6ff-9fe58cbf0bb5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:33.649645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b438d83-c12f-4bd3-b6ff-9fe58cbf0bb5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-5b438d83-c12f-4bd3-b6ff-9fe58cbf0bb5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:33.666676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:33.667739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:33.675003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 485/984] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 20 22:28:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:33.676048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438d83-c12f-4bd3-b6ff-9fe58cbf0bb5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:33.695233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c7637-7f10-47d6-bf1a-b64292d12c82 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:33.735263 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49861d19-5bec-48ee-846d-6abef5657ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:33.735944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49861d19-5bec-48ee-846d-6abef5657ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:33.736236 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49861d19-5bec-48ee-846d-6abef5657ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:33.736516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49861d19-5bec-48ee-846d-6abef5657ee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:33.737381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49861d19-5bec-48ee-846d-6abef5657ee0 None admin] RBAC: Adding query filter params (role.id=207ec663a0614937a744c94fe30f5ce7, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=ec5aca1c7f334dab8e7ca86573118d07) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:33.737699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49861d19-5bec-48ee-846d-6abef5657ee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:33.739175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49861d19-5bec-48ee-846d-6abef5657ee0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:33.745679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 500/985] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:28:33 2022] GET /identity/v3/role_assignments?user.id=ec5aca1c7f334dab8e7ca86573118d07&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=207ec663a0614937a744c94fe30f5ce7 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:33.789518 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:33.796280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b438d83-c12f-4bd3-b6ff-9fe58cbf0bb5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:33.843670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e98999-61eb-4b10-965c-149afa3c5901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:33.844359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98999-61eb-4b10-965c-149afa3c5901 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:33.844643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98999-61eb-4b10-965c-149afa3c5901 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:33.844922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e98999-61eb-4b10-965c-149afa3c5901 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:33.845651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e98999-61eb-4b10-965c-149afa3c5901 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:33.845995 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e98999-61eb-4b10-965c-149afa3c5901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:33.847402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e98999-61eb-4b10-965c-149afa3c5901 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:33.857983 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 486/986] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Jul 20 22:28:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:33.859873 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49861d19-5bec-48ee-846d-6abef5657ee0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:33.971474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49861d19-5bec-48ee-846d-6abef5657ee0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:33.979217 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:34.006148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1a70b-686c-430b-9e64-8b1f793bdf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:34.006815 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1a70b-686c-430b-9e64-8b1f793bdf1f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:34.007099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1a70b-686c-430b-9e64-8b1f793bdf1f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:34.007376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1a70b-686c-430b-9e64-8b1f793bdf1f None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:34.008084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1a70b-686c-430b-9e64-8b1f793bdf1f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:34.008392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1a70b-686c-430b-9e64-8b1f793bdf1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:34.009774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1a70b-686c-430b-9e64-8b1f793bdf1f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:34.019613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 501/987] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Jul 20 22:28:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:34.020821 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e98999-61eb-4b10-965c-149afa3c5901 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:34.133158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e98999-61eb-4b10-965c-149afa3c5901 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:34.167682 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd728c9-fcc1-476a-a8a6-daab567bc5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:34.168352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd728c9-fcc1-476a-a8a6-daab567bc5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:34.168638 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd728c9-fcc1-476a-a8a6-daab567bc5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:34.169422 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd728c9-fcc1-476a-a8a6-daab567bc5e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:34.170273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd728c9-fcc1-476a-a8a6-daab567bc5e4 None admin] RBAC: Adding query filter params (interface=admin, service_id=b22632fc57c941fdb6c10027921e8cc2, region_id=RegionOne) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:34.170596 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd728c9-fcc1-476a-a8a6-daab567bc5e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:34.171992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd728c9-fcc1-476a-a8a6-daab567bc5e4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:34.182204 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 487/988] 10.222.0.83 () {56 vars in 1249 bytes} [Wed Jul 20 22:28:34 2022] GET /identity/v3/endpoints?service_id=b22632fc57c941fdb6c10027921e8cc2&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:34.183236 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1a70b-686c-430b-9e64-8b1f793bdf1f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:34.288628 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1a70b-686c-430b-9e64-8b1f793bdf1f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:34.323382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e66a1f-5d7b-4e7d-946d-bdb166ae5d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:34.324058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e66a1f-5d7b-4e7d-946d-bdb166ae5d35 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:34.324341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e66a1f-5d7b-4e7d-946d-bdb166ae5d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:34.324635 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e66a1f-5d7b-4e7d-946d-bdb166ae5d35 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:34.326066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e66a1f-5d7b-4e7d-946d-bdb166ae5d35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:34.327520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e66a1f-5d7b-4e7d-946d-bdb166ae5d35 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:34.341845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 502/989] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 20 22:28:34 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:28:34.696535 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4118c-2484-43c6-b708-53ba95228f5d None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:34.697059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4118c-2484-43c6-b708-53ba95228f5d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:34.697141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4118c-2484-43c6-b708-53ba95228f5d None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:34.698627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 488/990] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:34.704204 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd4810-ac1a-4937-89d1-812bf6a4b4ef None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:34.704504 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd4810-ac1a-4937-89d1-812bf6a4b4ef None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:34.704783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd4810-ac1a-4937-89d1-812bf6a4b4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:34.721715 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d1dd4810-ac1a-4937-89d1-812bf6a4b4ef None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:34.722909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d1dd4810-ac1a-4937-89d1-812bf6a4b4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:34.751458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:34.796281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 503/991] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:34.817857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4118c-2484-43c6-b708-53ba95228f5d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:34.851290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:34.934030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4118c-2484-43c6-b708-53ba95228f5d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:34.969505 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acb29d-f6ef-46b7-8e63-e96a2f3a4c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:34.970254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acb29d-f6ef-46b7-8e63-e96a2f3a4c3b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:34.970535 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acb29d-f6ef-46b7-8e63-e96a2f3a4c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:34.970807 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acb29d-f6ef-46b7-8e63-e96a2f3a4c3b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:34.971459 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acb29d-f6ef-46b7-8e63-e96a2f3a4c3b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:34.972825 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acb29d-f6ef-46b7-8e63-e96a2f3a4c3b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-d1acb29d-f6ef-46b7-8e63-e96a2f3a4c3b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:34.985829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:34.986901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:34.987785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:34.987785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:34.987785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:34.987785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:34.987785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:34.987785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:34.987785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:34.987785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:34.987785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:34.987785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:34.987785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:34.987785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:34.987785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 22:28:34.987785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:34.990044 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 489/992] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:34.992931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd4810-ac1a-4937-89d1-812bf6a4b4ef None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:35.100183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd4810-ac1a-4937-89d1-812bf6a4b4ef None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:35.135570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942e7ec-09d5-4a24-8b37-f5bbbb498bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:35.136542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e7ec-09d5-4a24-8b37-f5bbbb498bcd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:35.137033 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e7ec-09d5-4a24-8b37-f5bbbb498bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:35.137588 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942e7ec-09d5-4a24-8b37-f5bbbb498bcd None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:35.138679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942e7ec-09d5-4a24-8b37-f5bbbb498bcd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:35.139142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942e7ec-09d5-4a24-8b37-f5bbbb498bcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:35.140667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942e7ec-09d5-4a24-8b37-f5bbbb498bcd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:35.150085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 504/993] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 20 22:28:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:35.151611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acb29d-f6ef-46b7-8e63-e96a2f3a4c3b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:35.248835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:35.260949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acb29d-f6ef-46b7-8e63-e96a2f3a4c3b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:35.298971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a3200-86cc-49c9-8012-2a9b2e9a7eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:35.299730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a3200-86cc-49c9-8012-2a9b2e9a7eab None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:35.300077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a3200-86cc-49c9-8012-2a9b2e9a7eab None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:35.300416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a3200-86cc-49c9-8012-2a9b2e9a7eab None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:35.301190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a3200-86cc-49c9-8012-2a9b2e9a7eab None admin] RBAC: Adding query filter params (type=compute) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:35.301565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a3200-86cc-49c9-8012-2a9b2e9a7eab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:35.303030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a3200-86cc-49c9-8012-2a9b2e9a7eab None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:35.310356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 490/994] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 20 22:28:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:35.314967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942e7ec-09d5-4a24-8b37-f5bbbb498bcd None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:35.344651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:35.418584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942e7ec-09d5-4a24-8b37-f5bbbb498bcd None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:35.455736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca59a12-e880-4e7a-980c-456f599803eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:35.456578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca59a12-e880-4e7a-980c-456f599803eb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:35.456980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca59a12-e880-4e7a-980c-456f599803eb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:35.457350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca59a12-e880-4e7a-980c-456f599803eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:35.458309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca59a12-e880-4e7a-980c-456f599803eb None admin] RBAC: Adding query filter params (interface=public, service_id=608cb95326364917ba6f4a2c150ca35c, region_id=RegionOne) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:35.458723 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca59a12-e880-4e7a-980c-456f599803eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:35.460211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca59a12-e880-4e7a-980c-456f599803eb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:35.471586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 505/995] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 20 22:28:35 2022] GET /identity/v3/endpoints?service_id=608cb95326364917ba6f4a2c150ca35c&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:35.472857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a3200-86cc-49c9-8012-2a9b2e9a7eab None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:35.577211 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a3200-86cc-49c9-8012-2a9b2e9a7eab None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:35.611776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9854f823-9a32-4223-8470-1dd4ccb2614b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:35.612450 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854f823-9a32-4223-8470-1dd4ccb2614b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:35.612734 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854f823-9a32-4223-8470-1dd4ccb2614b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:35.613012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9854f823-9a32-4223-8470-1dd4ccb2614b None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:35.613696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854f823-9a32-4223-8470-1dd4ccb2614b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:35.615089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9854f823-9a32-4223-8470-1dd4ccb2614b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:35.626996 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 491/996] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 20 22:28:35 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:28:35.830926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e980b82-963a-46e0-baec-297d7e168bac None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:35.831124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e980b82-963a-46e0-baec-297d7e168bac None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:35.831396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e980b82-963a-46e0-baec-297d7e168bac None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:35.832831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 506/997] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:35.838187 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a9159-8c28-4702-8dc5-90a632a2e973 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:35.838648 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a9159-8c28-4702-8dc5-90a632a2e973 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:35.838758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a9159-8c28-4702-8dc5-90a632a2e973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:35.856306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c82a9159-8c28-4702-8dc5-90a632a2e973 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:35.858084 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c82a9159-8c28-4702-8dc5-90a632a2e973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:35.869268 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:35.928891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 492/998] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:35.950736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e980b82-963a-46e0-baec-297d7e168bac None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:36.047862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:36.058557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e980b82-963a-46e0-baec-297d7e168bac None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:36.101087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c370-3dce-4add-847b-110e6f72e0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:36.101933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c370-3dce-4add-847b-110e6f72e0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:36.102218 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c370-3dce-4add-847b-110e6f72e0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:36.102493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235c370-3dce-4add-847b-110e6f72e0c6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:36.103152 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235c370-3dce-4add-847b-110e6f72e0c6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:36.104889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235c370-3dce-4add-847b-110e6f72e0c6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-7235c370-3dce-4add-847b-110e6f72e0c6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:36.117294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:36.123490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:36.124456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 507/999] 10.222.0.83 () {56 vars in 1105 bytes} [Wed Jul 20 22:28:35 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:36.125296 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a9159-8c28-4702-8dc5-90a632a2e973 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:36.235490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a9159-8c28-4702-8dc5-90a632a2e973 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:36.270334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb88e63-1e16-4041-9313-3ce5982450b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:36.271004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb88e63-1e16-4041-9313-3ce5982450b5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:36.271285 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb88e63-1e16-4041-9313-3ce5982450b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:36.271558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb88e63-1e16-4041-9313-3ce5982450b5 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:36.272265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb88e63-1e16-4041-9313-3ce5982450b5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:36.272574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb88e63-1e16-4041-9313-3ce5982450b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:36.273956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb88e63-1e16-4041-9313-3ce5982450b5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:36.283987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 493/1000] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:36.285260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c370-3dce-4add-847b-110e6f72e0c6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:36.389228 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3310ee-1f8b-4460-b5a7-df7e3da1890f None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:36.389432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3310ee-1f8b-4460-b5a7-df7e3da1890f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:36.389744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3310ee-1f8b-4460-b5a7-df7e3da1890f None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:36.391152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 494/1001] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:28:36.393073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235c370-3dce-4add-847b-110e6f72e0c6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:36.396201 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d704d-cf6a-4cbb-9dbe-4e2ca33f87f3 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:36.396466 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d704d-cf6a-4cbb-9dbe-4e2ca33f87f3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:36.396741 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d704d-cf6a-4cbb-9dbe-4e2ca33f87f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:36.414335 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-719d704d-cf6a-4cbb-9dbe-4e2ca33f87f3 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:36.415523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-719d704d-cf6a-4cbb-9dbe-4e2ca33f87f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:36.419608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:36.429934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b092e0a-4e68-495c-b91e-0957e170a10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:36.434016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092e0a-4e68-495c-b91e-0957e170a10d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:36.434016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092e0a-4e68-495c-b91e-0957e170a10d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:36.434016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092e0a-4e68-495c-b91e-0957e170a10d None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:36.434016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b092e0a-4e68-495c-b91e-0957e170a10d None admin] RBAC: Adding query filter params (type=image) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:36.434016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b092e0a-4e68-495c-b91e-0957e170a10d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:36.434016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b092e0a-4e68-495c-b91e-0957e170a10d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:36.438745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 508/1002] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:36.490127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 495/1003] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:36 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:36.514034 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b092e0a-4e68-495c-b91e-0957e170a10d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:36.538938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:36.626614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b092e0a-4e68-495c-b91e-0957e170a10d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:36.662192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c77b93-8365-4b85-9223-ca10829b03c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:36.662926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c77b93-8365-4b85-9223-ca10829b03c7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:36.663208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c77b93-8365-4b85-9223-ca10829b03c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:36.663482 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c77b93-8365-4b85-9223-ca10829b03c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:36.664132 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c77b93-8365-4b85-9223-ca10829b03c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:36.665494 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c77b93-8365-4b85-9223-ca10829b03c7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d8c77b93-8365-4b85-9223-ca10829b03c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:36.677680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:36.678735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:36.679615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 509/1004] 10.222.0.83 () {56 vars in 1126 bytes} [Wed Jul 20 22:28:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:36.685828 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d704d-cf6a-4cbb-9dbe-4e2ca33f87f3 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:36.786422 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719d704d-cf6a-4cbb-9dbe-4e2ca33f87f3 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:36.822699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19e05b-de33-48c0-b583-b963520ce331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:36.823372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19e05b-de33-48c0-b583-b963520ce331 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:36.823653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19e05b-de33-48c0-b583-b963520ce331 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:36.823929 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19e05b-de33-48c0-b583-b963520ce331 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:36.824641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19e05b-de33-48c0-b583-b963520ce331 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:36.824951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19e05b-de33-48c0-b583-b963520ce331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:36.826890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19e05b-de33-48c0-b583-b963520ce331 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:36.836428 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 496/1005] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Jul 20 22:28:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:36.837706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c77b93-8365-4b85-9223-ca10829b03c7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:36.925130 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:36.941775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c77b93-8365-4b85-9223-ca10829b03c7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:36.976338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17240e3-f4f0-4a12-8dcb-8b7059151203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:36.977008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17240e3-f4f0-4a12-8dcb-8b7059151203 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:36.977292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17240e3-f4f0-4a12-8dcb-8b7059151203 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:36.977568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17240e3-f4f0-4a12-8dcb-8b7059151203 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:36.978306 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17240e3-f4f0-4a12-8dcb-8b7059151203 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:36.978872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17240e3-f4f0-4a12-8dcb-8b7059151203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:36.980230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17240e3-f4f0-4a12-8dcb-8b7059151203 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:36.990852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 510/1006] 10.222.0.83 () {56 vars in 1122 bytes} [Wed Jul 20 22:28:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:36.991644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19e05b-de33-48c0-b583-b963520ce331 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:36.995543 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:37.099331 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19e05b-de33-48c0-b583-b963520ce331 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:37.134085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e5a6e-1386-4465-acee-76eb8dd72fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:37.134754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5a6e-1386-4465-acee-76eb8dd72fd5 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:37.135034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5a6e-1386-4465-acee-76eb8dd72fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:37.135309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e5a6e-1386-4465-acee-76eb8dd72fd5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:37.136063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e5a6e-1386-4465-acee-76eb8dd72fd5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:37.137431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e5a6e-1386-4465-acee-76eb8dd72fd5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:37.233826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 497/1007] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 20 22:28:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:28:37.751704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57da5b-6b76-4dd3-ac60-700061583d65 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:37.752730 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57da5b-6b76-4dd3-ac60-700061583d65 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:37.753245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57da5b-6b76-4dd3-ac60-700061583d65 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:37.755168 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 511/1008] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:37.760064 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5b98-25b7-4b07-b190-f69dbf8706f8 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:37.760963 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5b98-25b7-4b07-b190-f69dbf8706f8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:37.761248 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b5b98-25b7-4b07-b190-f69dbf8706f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:37.779170 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-652b5b98-25b7-4b07-b190-f69dbf8706f8 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:37.780414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-652b5b98-25b7-4b07-b190-f69dbf8706f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:37.838356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:37.853078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 498/1009] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:37 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:37.876901 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57da5b-6b76-4dd3-ac60-700061583d65 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:37.988241 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57da5b-6b76-4dd3-ac60-700061583d65 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:38.024274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240919b4-29e0-443c-94d0-193cd91a3f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:38.024991 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240919b4-29e0-443c-94d0-193cd91a3f0f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:38.025272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240919b4-29e0-443c-94d0-193cd91a3f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:38.025544 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240919b4-29e0-443c-94d0-193cd91a3f0f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:38.026226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240919b4-29e0-443c-94d0-193cd91a3f0f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:38.027577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240919b4-29e0-443c-94d0-193cd91a3f0f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-240919b4-29e0-443c-94d0-193cd91a3f0f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:38.039506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:38.040515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:38.041506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:38.041506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:38.041506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:38.041506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:38.041506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:38.041506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:38.041506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:38.041506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:38.041506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:38.041506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:38.041506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:38.041506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:38.041506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 22:28:38.041506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:38.045693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 512/1010] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:38.046951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b5b98-25b7-4b07-b190-f69dbf8706f8 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:38.153042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b5b98-25b7-4b07-b190-f69dbf8706f8 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:38.188703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0789e1c-199e-49bb-8ad4-834e4ade2cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:38.189420 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0789e1c-199e-49bb-8ad4-834e4ade2cca None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:38.189703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0789e1c-199e-49bb-8ad4-834e4ade2cca None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:38.190002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0789e1c-199e-49bb-8ad4-834e4ade2cca None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:38.190709 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0789e1c-199e-49bb-8ad4-834e4ade2cca None admin] RBAC: Adding query filter params (name=compute) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:38.191017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0789e1c-199e-49bb-8ad4-834e4ade2cca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:38.192379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0789e1c-199e-49bb-8ad4-834e4ade2cca None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:38.202210 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 499/1011] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 20 22:28:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:38.203832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240919b4-29e0-443c-94d0-193cd91a3f0f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:38.219409 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:38.305284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240919b4-29e0-443c-94d0-193cd91a3f0f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:38.340267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cfd422-0889-4bfc-b224-6105dfd71e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:38.341676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfd422-0889-4bfc-b224-6105dfd71e44 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:38.341989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfd422-0889-4bfc-b224-6105dfd71e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:38.342267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cfd422-0889-4bfc-b224-6105dfd71e44 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:38.342984 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfd422-0889-4bfc-b224-6105dfd71e44 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:38.343293 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfd422-0889-4bfc-b224-6105dfd71e44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:38.344667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cfd422-0889-4bfc-b224-6105dfd71e44 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:38.356056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 513/1012] 10.222.0.83 () {56 vars in 1112 bytes} [Wed Jul 20 22:28:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:38.356819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0789e1c-199e-49bb-8ad4-834e4ade2cca None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:38.419076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:38.464725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0789e1c-199e-49bb-8ad4-834e4ade2cca None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:38.500424 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2bedd-eff4-4edd-a552-1bf4399e0165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:38.501094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2bedd-eff4-4edd-a552-1bf4399e0165 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:38.501380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2bedd-eff4-4edd-a552-1bf4399e0165 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:38.501658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2bedd-eff4-4edd-a552-1bf4399e0165 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:38.502436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2bedd-eff4-4edd-a552-1bf4399e0165 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:38.503808 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2bedd-eff4-4edd-a552-1bf4399e0165 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:38.507212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcdd90-1435-4bd5-a2ba-27334fa6e9a4 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:38.507506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcdd90-1435-4bd5-a2ba-27334fa6e9a4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:38.507794 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcdd90-1435-4bd5-a2ba-27334fa6e9a4 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:38.509171 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 514/1013] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:38.515064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d5f24-f72b-48ea-ba65-5563af39a642 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:38.515350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d5f24-f72b-48ea-ba65-5563af39a642 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:38.515630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d5f24-f72b-48ea-ba65-5563af39a642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:38.532703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f76d5f24-f72b-48ea-ba65-5563af39a642 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:38.533918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f76d5f24-f72b-48ea-ba65-5563af39a642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:38.600117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 500/1014] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 20 22:28:38 2022] POST /identity/v3/endpoints => generated 334 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:28:38.616520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 515/1015] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:38 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:38.640703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2bedd-eff4-4edd-a552-1bf4399e0165 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:38.782379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2bedd-eff4-4edd-a552-1bf4399e0165 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:38.794794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:38.820172 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5188d4-8dbf-40b9-a13e-3986f6a55b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:38.820846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5188d4-8dbf-40b9-a13e-3986f6a55b64 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:38.821130 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5188d4-8dbf-40b9-a13e-3986f6a55b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:38.821408 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5188d4-8dbf-40b9-a13e-3986f6a55b64 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:38.822177 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5188d4-8dbf-40b9-a13e-3986f6a55b64 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:38.823604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5188d4-8dbf-40b9-a13e-3986f6a55b64 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:38.934019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 501/1016] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 20 22:28:38 2022] POST /identity/v3/services => generated 242 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:28:39.311563 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed82868-a1af-4033-9c6b-45bfd80d2d23 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:39.312064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed82868-a1af-4033-9c6b-45bfd80d2d23 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:39.312064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed82868-a1af-4033-9c6b-45bfd80d2d23 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:39.313529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 516/1017] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:39.318659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9e3be-d328-4d4a-b9e5-0982f03b3aef None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:39.319052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9e3be-d328-4d4a-b9e5-0982f03b3aef None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:39.319216 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9e3be-d328-4d4a-b9e5-0982f03b3aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:39.336900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1da9e3be-d328-4d4a-b9e5-0982f03b3aef None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:39.338111 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1da9e3be-d328-4d4a-b9e5-0982f03b3aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:39.413279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 502/1018] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:39.436854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed82868-a1af-4033-9c6b-45bfd80d2d23 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:39.439759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:39.539704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed82868-a1af-4033-9c6b-45bfd80d2d23 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:39.573099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89f76a-f9a3-433e-979f-305e01c7af7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:39.573861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89f76a-f9a3-433e-979f-305e01c7af7a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:39.574143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89f76a-f9a3-433e-979f-305e01c7af7a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:39.574416 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89f76a-f9a3-433e-979f-305e01c7af7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:39.576116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89f76a-f9a3-433e-979f-305e01c7af7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:39.577582 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89f76a-f9a3-433e-979f-305e01c7af7a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:39.584024 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 517/1019] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:39.585233 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9e3be-d328-4d4a-b9e5-0982f03b3aef None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:39.679718 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:39.686503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9e3be-d328-4d4a-b9e5-0982f03b3aef None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:39.721688 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c7e4f-ee42-49c0-856d-385302fd0670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:39.722382 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c7e4f-ee42-49c0-856d-385302fd0670 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:39.722661 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c7e4f-ee42-49c0-856d-385302fd0670 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:39.722933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c7e4f-ee42-49c0-856d-385302fd0670 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:39.723654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c7e4f-ee42-49c0-856d-385302fd0670 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:39.725076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c7e4f-ee42-49c0-856d-385302fd0670 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:39.837955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 503/1020] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 20 22:28:39 2022] POST /identity/v3/projects => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:28:40.766707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa515ba7-48cb-4a2a-909b-02b76424186c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:40.767305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa515ba7-48cb-4a2a-909b-02b76424186c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:40.767305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa515ba7-48cb-4a2a-909b-02b76424186c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:40.768789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 518/1021] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:40.773802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84406832-0fbc-4e8c-bff6-ba69fcf01acd None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:40.774191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84406832-0fbc-4e8c-bff6-ba69fcf01acd None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:40.774375 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84406832-0fbc-4e8c-bff6-ba69fcf01acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:40.792833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-84406832-0fbc-4e8c-bff6-ba69fcf01acd None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:40.794841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-84406832-0fbc-4e8c-bff6-ba69fcf01acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:40.863197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 504/1022] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:40.886704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa515ba7-48cb-4a2a-909b-02b76424186c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:40.957855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:40.990892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa515ba7-48cb-4a2a-909b-02b76424186c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:41.021254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f51976-60f4-4b9f-b132-5cd5e77727b2 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:41.021444 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f51976-60f4-4b9f-b132-5cd5e77727b2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:41.021745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f51976-60f4-4b9f-b132-5cd5e77727b2 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:41.025828 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 505/1023] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:28:41.026660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1467c5-62ed-4034-a81d-f9f9196ba1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:41.027554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1467c5-62ed-4034-a81d-f9f9196ba1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:41.027836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1467c5-62ed-4034-a81d-f9f9196ba1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:41.028730 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1467c5-62ed-4034-a81d-f9f9196ba1a3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:41.028832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3fc21-e9e7-4726-9796-1c0baed1cc77 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:41.029048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3fc21-e9e7-4726-9796-1c0baed1cc77 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:41.029400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3fc21-e9e7-4726-9796-1c0baed1cc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:41.039746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1467c5-62ed-4034-a81d-f9f9196ba1a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:41.046453 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-04a3fc21-e9e7-4726-9796-1c0baed1cc77 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:41.047642 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-04a3fc21-e9e7-4726-9796-1c0baed1cc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-7c1467c5-62ed-4034-a81d-f9f9196ba1a3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:41.048511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:41.049456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:41.050347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:41.050347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:41.050347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:41.050347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:41.050347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:41.050347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:41.050347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:41.050347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:41.050347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:41.050347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:41.050347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 22:28:41.050347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:41.050347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 519/1024] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Jul 20 22:28:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:41.055674 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1467c5-62ed-4034-a81d-f9f9196ba1a3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:41.127060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 506/1025] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:41.150187 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3fc21-e9e7-4726-9796-1c0baed1cc77 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:41.164132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:41.165041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1467c5-62ed-4034-a81d-f9f9196ba1a3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:41.194842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:41.201555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82611c-a5bd-4616-9449-4e5ca092b1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:41.202267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82611c-a5bd-4616-9449-4e5ca092b1ba None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:41.202546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82611c-a5bd-4616-9449-4e5ca092b1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:41.202874 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82611c-a5bd-4616-9449-4e5ca092b1ba None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:41.203629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82611c-a5bd-4616-9449-4e5ca092b1ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:41.204054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82611c-a5bd-4616-9449-4e5ca092b1ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:41.205427 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82611c-a5bd-4616-9449-4e5ca092b1ba None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:41.214846 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 520/1026] 10.222.0.83 () {56 vars in 1115 bytes} [Wed Jul 20 22:28:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:41.221309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82611c-a5bd-4616-9449-4e5ca092b1ba None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:41.267474 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3fc21-e9e7-4726-9796-1c0baed1cc77 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:41.303586 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed93cc-bdaa-4c0e-823b-1fcb4a7f1e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:41.304742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed93cc-bdaa-4c0e-823b-1fcb4a7f1e9d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:41.305024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed93cc-bdaa-4c0e-823b-1fcb4a7f1e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:41.305297 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed93cc-bdaa-4c0e-823b-1fcb4a7f1e9d None admin] PATH_INFO: `/v3/services/image` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:41.305988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed93cc-bdaa-4c0e-823b-1fcb4a7f1e9d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:41.307738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ed93cc-bdaa-4c0e-823b-1fcb4a7f1e9d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-78ed93cc-bdaa-4c0e-823b-1fcb4a7f1e9d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:41.320390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:41.321783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:41.323355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 507/1027] 10.222.0.83 () {56 vars in 1105 bytes} [Wed Jul 20 22:28:41 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:41.327957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed93cc-bdaa-4c0e-823b-1fcb4a7f1e9d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:41.339693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82611c-a5bd-4616-9449-4e5ca092b1ba None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:41.378912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79334e-a760-4663-95c6-4613948ee3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:41.379693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79334e-a760-4663-95c6-4613948ee3db None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:41.379978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79334e-a760-4663-95c6-4613948ee3db None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:41.380258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b79334e-a760-4663-95c6-4613948ee3db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:41.390935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79334e-a760-4663-95c6-4613948ee3db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:41.392383 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b79334e-a760-4663-95c6-4613948ee3db None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:41.405526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-8b79334e-a760-4663-95c6-4613948ee3db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:41.411261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:41.417391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:41.418424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:41.418424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:41.418424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:41.418424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:41.418424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 521/1028] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:41.418424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79334e-a760-4663-95c6-4613948ee3db None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:41.443031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed93cc-bdaa-4c0e-823b-1fcb4a7f1e9d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:41.474298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:41.482885 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b03110-97f0-4d1d-b1c5-84b8550b23b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:41.483583 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b03110-97f0-4d1d-b1c5-84b8550b23b2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:41.483987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b03110-97f0-4d1d-b1c5-84b8550b23b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:41.490971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b03110-97f0-4d1d-b1c5-84b8550b23b2 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:41.490971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b03110-97f0-4d1d-b1c5-84b8550b23b2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:41.490971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b03110-97f0-4d1d-b1c5-84b8550b23b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:41.490971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b03110-97f0-4d1d-b1c5-84b8550b23b2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:41.492436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 508/1029] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:41.498110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b03110-97f0-4d1d-b1c5-84b8550b23b2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:41.542157 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b79334e-a760-4663-95c6-4613948ee3db None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:41.584512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebc38d-ac7a-4284-8006-f7623a9a266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:41.585099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebc38d-ac7a-4284-8006-f7623a9a266f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:41.585378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebc38d-ac7a-4284-8006-f7623a9a266f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:41.585653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebc38d-ac7a-4284-8006-f7623a9a266f None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:41.586410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebc38d-ac7a-4284-8006-f7623a9a266f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:41.586722 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebc38d-ac7a-4284-8006-f7623a9a266f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:41.588085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebc38d-ac7a-4284-8006-f7623a9a266f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:41.606806 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 522/1030] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:41.610972 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebc38d-ac7a-4284-8006-f7623a9a266f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:41.617485 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b03110-97f0-4d1d-b1c5-84b8550b23b2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:41.659404 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c273210-64f1-4202-a30d-3e904b107247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:41.660095 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c273210-64f1-4202-a30d-3e904b107247 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:41.660748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c273210-64f1-4202-a30d-3e904b107247 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:41.661035 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c273210-64f1-4202-a30d-3e904b107247 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:41.662101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c273210-64f1-4202-a30d-3e904b107247 None admin] RBAC: Adding query filter params (type=image) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:41.662426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c273210-64f1-4202-a30d-3e904b107247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:41.664145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c273210-64f1-4202-a30d-3e904b107247 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:41.667181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:41.670826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 509/1031] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:41.676878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c273210-64f1-4202-a30d-3e904b107247 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:41.747518 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebc38d-ac7a-4284-8006-f7623a9a266f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:41.752122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:41.799161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba7df4-70f5-4e3b-bcb5-f41a33a12b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:41.800701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba7df4-70f5-4e3b-bcb5-f41a33a12b2d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:41.800990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba7df4-70f5-4e3b-bcb5-f41a33a12b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:41.801256 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba7df4-70f5-4e3b-bcb5-f41a33a12b2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:41.804540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c273210-64f1-4202-a30d-3e904b107247 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:41.809117 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba7df4-70f5-4e3b-bcb5-f41a33a12b2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:41.811448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba7df4-70f5-4e3b-bcb5-f41a33a12b2d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-31ba7df4-70f5-4e3b-bcb5-f41a33a12b2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:41.827307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:41.828490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:41.829484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:41.829484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:41.829484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:41.829484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:41.829484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:41.829484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:41.829484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:41.829484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:41.829484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:28:41.829484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:41.833659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 523/1032] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 20 22:28:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:41.834735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba7df4-70f5-4e3b-bcb5-f41a33a12b2d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:41.854929 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732835e-924c-4985-aca4-1b89fbcfe34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:41.855758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732835e-924c-4985-aca4-1b89fbcfe34e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:41.856049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732835e-924c-4985-aca4-1b89fbcfe34e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:41.856515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732835e-924c-4985-aca4-1b89fbcfe34e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:41.857370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732835e-924c-4985-aca4-1b89fbcfe34e None admin] RBAC: Adding query filter params (interface=public, service_id=a08a96a46737403393d6fb273165de6b, region_id=RegionOne) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:41.857691 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732835e-924c-4985-aca4-1b89fbcfe34e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:41.859428 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732835e-924c-4985-aca4-1b89fbcfe34e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:41.866148 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 510/1033] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 20 22:28:41 2022] GET /identity/v3/endpoints?service_id=a08a96a46737403393d6fb273165de6b&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:41.871527 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732835e-924c-4985-aca4-1b89fbcfe34e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:41.942198 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:41.950559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba7df4-70f5-4e3b-bcb5-f41a33a12b2d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:41.982327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732835e-924c-4985-aca4-1b89fbcfe34e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:41.987991 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a4b1b-23df-4fe4-8eeb-d0ffe487f08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:41.988671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a4b1b-23df-4fe4-8eeb-d0ffe487f08f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:41.988956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a4b1b-23df-4fe4-8eeb-d0ffe487f08f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:41.989233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a4b1b-23df-4fe4-8eeb-d0ffe487f08f None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:41.990118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a4b1b-23df-4fe4-8eeb-d0ffe487f08f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:41.990432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a4b1b-23df-4fe4-8eeb-d0ffe487f08f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:41.991865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a4b1b-23df-4fe4-8eeb-d0ffe487f08f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:42.010645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 524/1034] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 20 22:28:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:42.011985 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a36637-e3fb-4d9c-97f0-e73542840064 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:42.012273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a36637-e3fb-4d9c-97f0-e73542840064 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:42.013119 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a36637-e3fb-4d9c-97f0-e73542840064 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:42.014765 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 525/1035] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:42.019330 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a36637-e3fb-4d9c-97f0-e73542840064 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:42.023710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d42aef-0ba2-49d8-a080-914acac2997b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:42.024389 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d42aef-0ba2-49d8-a080-914acac2997b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:42.024681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d42aef-0ba2-49d8-a080-914acac2997b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:42.024961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d42aef-0ba2-49d8-a080-914acac2997b None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:42.025655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d42aef-0ba2-49d8-a080-914acac2997b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:42.027159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d42aef-0ba2-49d8-a080-914acac2997b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:42.034105 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 511/1036] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 20 22:28:41 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:28:42.035375 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821272ea-8340-4f69-92f6-244d9288f519 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:42.035667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821272ea-8340-4f69-92f6-244d9288f519 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:42.036244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821272ea-8340-4f69-92f6-244d9288f519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:42.046362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:42.061308 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-821272ea-8340-4f69-92f6-244d9288f519 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:42.062605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-821272ea-8340-4f69-92f6-244d9288f519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:42.148016 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 512/1037] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:42.156226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a36637-e3fb-4d9c-97f0-e73542840064 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:42.173627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821272ea-8340-4f69-92f6-244d9288f519 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:42.204449 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460d065-b6ca-4491-8588-735a18f75c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:42.205129 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460d065-b6ca-4491-8588-735a18f75c61 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:42.205413 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460d065-b6ca-4491-8588-735a18f75c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:42.205691 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460d065-b6ca-4491-8588-735a18f75c61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:42.242355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:42.294225 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460d065-b6ca-4491-8588-735a18f75c61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:42.295429 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460d065-b6ca-4491-8588-735a18f75c61 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:42.301103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821272ea-8340-4f69-92f6-244d9288f519 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:42.322239 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:42.341399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85999b-b19c-48f2-a14c-45eb5d862cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:42.342672 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85999b-b19c-48f2-a14c-45eb5d862cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:42.343240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85999b-b19c-48f2-a14c-45eb5d862cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:42.343527 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85999b-b19c-48f2-a14c-45eb5d862cf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:42.345033 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85999b-b19c-48f2-a14c-45eb5d862cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:42.347312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85999b-b19c-48f2-a14c-45eb5d862cf8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:42.351711 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 513/1038] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:42.355540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85999b-b19c-48f2-a14c-45eb5d862cf8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:42.416761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 526/1039] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:28:42 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 22:28:42.423290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460d065-b6ca-4491-8588-735a18f75c61 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:42.490010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85999b-b19c-48f2-a14c-45eb5d862cf8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:42.521668 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:42.531443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261932a6-15be-429c-a322-715bdefa4670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:42.532125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261932a6-15be-429c-a322-715bdefa4670 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:42.532408 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261932a6-15be-429c-a322-715bdefa4670 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:42.532685 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261932a6-15be-429c-a322-715bdefa4670 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:42.533435 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261932a6-15be-429c-a322-715bdefa4670 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:42.535624 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261932a6-15be-429c-a322-715bdefa4670 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:42.539653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460d065-b6ca-4491-8588-735a18f75c61 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:42.565190 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:42.577264 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259b9f1-aba3-46ef-a87d-143f1970ec77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:42.578090 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259b9f1-aba3-46ef-a87d-143f1970ec77 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:42.578372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259b9f1-aba3-46ef-a87d-143f1970ec77 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:42.578641 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259b9f1-aba3-46ef-a87d-143f1970ec77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:42.588963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259b9f1-aba3-46ef-a87d-143f1970ec77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:42.590419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259b9f1-aba3-46ef-a87d-143f1970ec77 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-3259b9f1-aba3-46ef-a87d-143f1970ec77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:42.609305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:42.610506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:42.611479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:42.611479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:42.611479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:42.611479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:42.611479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 527/1040] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:42.616406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259b9f1-aba3-46ef-a87d-143f1970ec77 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:42.658578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 514/1041] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:28:42 2022] POST /identity/v3/users => generated 285 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:28:42.750564 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259b9f1-aba3-46ef-a87d-143f1970ec77 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:42.786704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5537677-5cab-472e-83be-eb9c9325aab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:42.787389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5537677-5cab-472e-83be-eb9c9325aab4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:42.787671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5537677-5cab-472e-83be-eb9c9325aab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:42.787947 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5537677-5cab-472e-83be-eb9c9325aab4 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:42.788685 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5537677-5cab-472e-83be-eb9c9325aab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:42.788994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5537677-5cab-472e-83be-eb9c9325aab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:42.790477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5537677-5cab-472e-83be-eb9c9325aab4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:42.809064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 528/1042] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:42.811477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261932a6-15be-429c-a322-715bdefa4670 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:42.924338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261932a6-15be-429c-a322-715bdefa4670 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:42.958467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62675a9-1dae-4a20-9e4b-7332fb8ca9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:42.959267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62675a9-1dae-4a20-9e4b-7332fb8ca9fc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:42.959550 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62675a9-1dae-4a20-9e4b-7332fb8ca9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:42.959822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62675a9-1dae-4a20-9e4b-7332fb8ca9fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:42.967385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62675a9-1dae-4a20-9e4b-7332fb8ca9fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:42.968851 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62675a9-1dae-4a20-9e4b-7332fb8ca9fc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-c62675a9-1dae-4a20-9e4b-7332fb8ca9fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:42.983955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:42.984926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:42.986502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:42.986502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:42.986502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:42.986502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:42.986502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:42.986502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:42.986502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:42.986502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:42.986502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 515/1043] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:42.990956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5537677-5cab-472e-83be-eb9c9325aab4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:43.026420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:43.102286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5537677-5cab-472e-83be-eb9c9325aab4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:43.139054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0f1c9-b134-4f2c-b442-73abdae39492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:43.139713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0f1c9-b134-4f2c-b442-73abdae39492 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:43.139993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0f1c9-b134-4f2c-b442-73abdae39492 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:43.140265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0f1c9-b134-4f2c-b442-73abdae39492 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:43.141051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0f1c9-b134-4f2c-b442-73abdae39492 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:43.141359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0f1c9-b134-4f2c-b442-73abdae39492 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:43.142797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0f1c9-b134-4f2c-b442-73abdae39492 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:43.157788 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 529/1044] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:43.161978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62675a9-1dae-4a20-9e4b-7332fb8ca9fc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:43.209028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:43.270499 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62675a9-1dae-4a20-9e4b-7332fb8ca9fc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:43.304959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d743135-2753-4e4a-81e9-6aa3138fe48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:43.305529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d743135-2753-4e4a-81e9-6aa3138fe48b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:43.305833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d743135-2753-4e4a-81e9-6aa3138fe48b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:43.306107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d743135-2753-4e4a-81e9-6aa3138fe48b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:43.306935 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d743135-2753-4e4a-81e9-6aa3138fe48b None admin] RBAC: Adding query filter params (role.id=207ec663a0614937a744c94fe30f5ce7, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=67c92c8d2b9d41e489e4c03ae4e71fe2) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:43.307249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d743135-2753-4e4a-81e9-6aa3138fe48b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:43.308683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d743135-2753-4e4a-81e9-6aa3138fe48b None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:43.321755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 516/1045] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:28:43 2022] GET /identity/v3/role_assignments?user.id=67c92c8d2b9d41e489e4c03ae4e71fe2&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=207ec663a0614937a744c94fe30f5ce7 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:44.165612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f74d-fac9-4c1a-b473-bdbf82475721 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:44.166149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f74d-fac9-4c1a-b473-bdbf82475721 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:44.166228 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927f74d-fac9-4c1a-b473-bdbf82475721 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:44.167744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 530/1046] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:44.173366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4974fb-4204-46e6-bcc6-07086ab4359d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:44.173882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4974fb-4204-46e6-bcc6-07086ab4359d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:44.173972 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4974fb-4204-46e6-bcc6-07086ab4359d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:44.191083 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0b4974fb-4204-46e6-bcc6-07086ab4359d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:44.192280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0b4974fb-4204-46e6-bcc6-07086ab4359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:44.262756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 517/1047] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:44.286882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927f74d-fac9-4c1a-b473-bdbf82475721 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:44.386172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:44.395140 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927f74d-fac9-4c1a-b473-bdbf82475721 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:44.431839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb8692-0ce8-4967-8240-d6f47d48335b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:44.432645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb8692-0ce8-4967-8240-d6f47d48335b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:44.432930 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb8692-0ce8-4967-8240-d6f47d48335b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:44.433209 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb8692-0ce8-4967-8240-d6f47d48335b None admin] PATH_INFO: `/v3/services/image` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:44.433905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb8692-0ce8-4967-8240-d6f47d48335b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:44.435327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb8692-0ce8-4967-8240-d6f47d48335b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-31cb8692-0ce8-4967-8240-d6f47d48335b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:44.447088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:44.448212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:44.449082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:44.449082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:44.449082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:44.449082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:44.449082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:44.449082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:44.449082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:44.449082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:44.449082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:44.449082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:44.449082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:28:44.449082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:28:44.449082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 22:28:44.449082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:44.453944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 531/1048] 10.222.0.83 () {56 vars in 1105 bytes} [Wed Jul 20 22:28:44 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:44.455297 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4974fb-4204-46e6-bcc6-07086ab4359d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:44.491817 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:44.557832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4974fb-4204-46e6-bcc6-07086ab4359d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:44.593648 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac9ba4-4260-49d0-9a13-0212147d74f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:44.594374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac9ba4-4260-49d0-9a13-0212147d74f2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:44.594657 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac9ba4-4260-49d0-9a13-0212147d74f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:44.594936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac9ba4-4260-49d0-9a13-0212147d74f2 None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:44.595655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac9ba4-4260-49d0-9a13-0212147d74f2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:44.595969 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac9ba4-4260-49d0-9a13-0212147d74f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:44.597343 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac9ba4-4260-49d0-9a13-0212147d74f2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:44.605973 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 518/1049] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:44 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:44.609424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb8692-0ce8-4967-8240-d6f47d48335b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:44.714021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb8692-0ce8-4967-8240-d6f47d48335b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:44.750086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64289447-156f-483c-89de-79712231467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:44.750764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289447-156f-483c-89de-79712231467f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:44.751047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289447-156f-483c-89de-79712231467f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:44.751325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64289447-156f-483c-89de-79712231467f None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:44.752066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289447-156f-483c-89de-79712231467f None admin] RBAC: Adding query filter params (type=image) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:44.752378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289447-156f-483c-89de-79712231467f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:44.753769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64289447-156f-483c-89de-79712231467f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:44.758933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 532/1050] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:44 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:44.764956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac9ba4-4260-49d0-9a13-0212147d74f2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:44.769367 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080c13-ba3f-4d60-a22e-362fa4002574 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:44.769659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080c13-ba3f-4d60-a22e-362fa4002574 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:44.769997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d080c13-ba3f-4d60-a22e-362fa4002574 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:44.771387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 533/1051] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:44.777103 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc9d33-47fc-4b34-aaf0-b1a0786e2962 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:44.777503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc9d33-47fc-4b34-aaf0-b1a0786e2962 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:44.777815 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc9d33-47fc-4b34-aaf0-b1a0786e2962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:44.795551 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2edc9d33-47fc-4b34-aaf0-b1a0786e2962 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:44.796956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2edc9d33-47fc-4b34-aaf0-b1a0786e2962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:44.815428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:44.865014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:44.868579 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac9ba4-4260-49d0-9a13-0212147d74f2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:44.869146 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 534/1052] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:44 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:44.893679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc9d33-47fc-4b34-aaf0-b1a0786e2962 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:44.909561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca031618-e3a6-42a6-b203-46811f8f7597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:44.910749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca031618-e3a6-42a6-b203-46811f8f7597 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:44.911244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca031618-e3a6-42a6-b203-46811f8f7597 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:44.911717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca031618-e3a6-42a6-b203-46811f8f7597 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:44.912735 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca031618-e3a6-42a6-b203-46811f8f7597 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:44.914291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca031618-e3a6-42a6-b203-46811f8f7597 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:44.995493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc9d33-47fc-4b34-aaf0-b1a0786e2962 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:45.008985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 519/1053] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 20 22:28:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:28:45.050147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358f5c-886d-4204-b870-99aa30646c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:45.050967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358f5c-886d-4204-b870-99aa30646c70 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:45.051246 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358f5c-886d-4204-b870-99aa30646c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:45.051523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88358f5c-886d-4204-b870-99aa30646c70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:45.064036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88358f5c-886d-4204-b870-99aa30646c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-88358f5c-886d-4204-b870-99aa30646c70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:45.071996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:45.073125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:45.083067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:45.083067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:45.083067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:45.083067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:45.083067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:45.083067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:45.083067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:45.083067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:45.083067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:45.083067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:45.083067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:45.083067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:45.083067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 535/1054] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:45.086217 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca031618-e3a6-42a6-b203-46811f8f7597 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:45.199751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca031618-e3a6-42a6-b203-46811f8f7597 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:45.234644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c9dec-c74e-401a-93d7-b8b3cc63ad76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:45.235322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9dec-c74e-401a-93d7-b8b3cc63ad76 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:45.235604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9dec-c74e-401a-93d7-b8b3cc63ad76 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:45.235881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c9dec-c74e-401a-93d7-b8b3cc63ad76 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:45.236638 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c9dec-c74e-401a-93d7-b8b3cc63ad76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:45.236944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c9dec-c74e-401a-93d7-b8b3cc63ad76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:45.238365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c9dec-c74e-401a-93d7-b8b3cc63ad76 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:45.247866 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 520/1055] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:28:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:45.253553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358f5c-886d-4204-b870-99aa30646c70 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:45.269485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:45.359145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88358f5c-886d-4204-b870-99aa30646c70 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:45.371530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1297b5f-6c74-40e6-b2d5-ab67d07a841b None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:45.372477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1297b5f-6c74-40e6-b2d5-ab67d07a841b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:45.372767 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1297b5f-6c74-40e6-b2d5-ab67d07a841b None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:45.374273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 521/1056] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:28:45.379409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582cd0c-5108-4c79-93c1-67f616a0ed19 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:45.379699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582cd0c-5108-4c79-93c1-67f616a0ed19 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:45.379970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582cd0c-5108-4c79-93c1-67f616a0ed19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:45.396958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4582cd0c-5108-4c79-93c1-67f616a0ed19 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:45.398191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4582cd0c-5108-4c79-93c1-67f616a0ed19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:45.399081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b277c6-d116-4368-bde7-fb0404f87cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:45.399974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b277c6-d116-4368-bde7-fb0404f87cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:45.400269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b277c6-d116-4368-bde7-fb0404f87cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:45.400549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b277c6-d116-4368-bde7-fb0404f87cc8 None admin] PATH_INFO: `/v3/users/263b9af6473c43e58dbec365c91ca379` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:45.415250 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:45.418480 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b277c6-d116-4368-bde7-fb0404f87cc8 None admin] RBAC: Authorizing `identity:get_user(user_id=263b9af6473c43e58dbec365c91ca379)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:45.420488 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b277c6-d116-4368-bde7-fb0404f87cc8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:45.422479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 536/1057] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:28:45 2022] GET /identity/v3/users/263b9af6473c43e58dbec365c91ca379 => generated 285 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:45.427920 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b277c6-d116-4368-bde7-fb0404f87cc8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:45.475184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 522/1058] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:45.500018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582cd0c-5108-4c79-93c1-67f616a0ed19 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:45.502963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:45.540891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b277c6-d116-4368-bde7-fb0404f87cc8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:45.578959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2f37b-db3a-4d0c-a95e-068a5a0337e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:45.579617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f37b-db3a-4d0c-a95e-068a5a0337e6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:45.579893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f37b-db3a-4d0c-a95e-068a5a0337e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:45.580166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2f37b-db3a-4d0c-a95e-068a5a0337e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:45.612805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582cd0c-5108-4c79-93c1-67f616a0ed19 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:45.650248 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1f43c-f4df-40a2-ae68-c4ec1944f4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:45.650758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2f37b-db3a-4d0c-a95e-068a5a0337e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:45.651067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1f43c-f4df-40a2-ae68-c4ec1944f4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:45.651353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1f43c-f4df-40a2-ae68-c4ec1944f4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:45.651632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1f43c-f4df-40a2-ae68-c4ec1944f4a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:45.652207 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2f37b-db3a-4d0c-a95e-068a5a0337e6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:45.665046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1f43c-f4df-40a2-ae68-c4ec1944f4a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-45a1f43c-f4df-40a2-ae68-c4ec1944f4a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:45.674066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:45.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:45.679040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:45.679040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:45.679040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:45.679040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:45.679040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:45.679040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:45.679040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:45.679040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:45.679040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:45.679040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:45.679040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 22:28:45.679040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:45.679040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 523/1059] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Jul 20 22:28:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:45.681183 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1f43c-f4df-40a2-ae68-c4ec1944f4a5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:45.693218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:45.741354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:45.782497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 537/1060] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:28:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 22:28:45.788337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2f37b-db3a-4d0c-a95e-068a5a0337e6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:45.807440 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1f43c-f4df-40a2-ae68-c4ec1944f4a5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:45.851806 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb7cc1-7cdb-4660-bf31-dc73a38833a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:45.852491 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb7cc1-7cdb-4660-bf31-dc73a38833a5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:45.852781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb7cc1-7cdb-4660-bf31-dc73a38833a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:45.853059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb7cc1-7cdb-4660-bf31-dc73a38833a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:45.854110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb7cc1-7cdb-4660-bf31-dc73a38833a5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:45.854418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb7cc1-7cdb-4660-bf31-dc73a38833a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:45.855797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb7cc1-7cdb-4660-bf31-dc73a38833a5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:45.870220 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 524/1061] 10.222.0.83 () {56 vars in 1115 bytes} [Wed Jul 20 22:28:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:45.871137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb7cc1-7cdb-4660-bf31-dc73a38833a5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:45.901195 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2f37b-db3a-4d0c-a95e-068a5a0337e6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:45.939693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dde544-c4fe-4b37-ac83-8d3598966492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:45.940909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde544-c4fe-4b37-ac83-8d3598966492 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:45.941377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde544-c4fe-4b37-ac83-8d3598966492 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:45.941870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dde544-c4fe-4b37-ac83-8d3598966492 None admin] PATH_INFO: `/v3/projects/1415b4cf2c674dec8fae3279787f8f75` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:45.943234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dde544-c4fe-4b37-ac83-8d3598966492 None admin] RBAC: Authorizing `identity:get_project(project_id=1415b4cf2c674dec8fae3279787f8f75)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:45.944829 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dde544-c4fe-4b37-ac83-8d3598966492 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:45.947081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 538/1062] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:28:45 2022] GET /identity/v3/projects/1415b4cf2c674dec8fae3279787f8f75 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:45.953429 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dde544-c4fe-4b37-ac83-8d3598966492 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:45.957126 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:45.989712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb7cc1-7cdb-4660-bf31-dc73a38833a5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:45.990578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:46.026464 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee822a7-9986-4676-8955-56a760ad929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:46.027450 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee822a7-9986-4676-8955-56a760ad929c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:46.027740 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee822a7-9986-4676-8955-56a760ad929c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:46.028644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee822a7-9986-4676-8955-56a760ad929c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:46.043294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee822a7-9986-4676-8955-56a760ad929c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:46.047205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee822a7-9986-4676-8955-56a760ad929c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:46.068244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dde544-c4fe-4b37-ac83-8d3598966492 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-7ee822a7-9986-4676-8955-56a760ad929c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:46.071139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:46.072242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:46.073260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:46.073260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:46.073260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:46.073260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:46.073260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 525/1063] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:46.077693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee822a7-9986-4676-8955-56a760ad929c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:46.117782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09271ba0-717d-4e5b-8a70-d8faefe06a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:46.118452 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09271ba0-717d-4e5b-8a70-d8faefe06a2f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:46.118769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09271ba0-717d-4e5b-8a70-d8faefe06a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:46.119077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09271ba0-717d-4e5b-8a70-d8faefe06a2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:46.119848 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09271ba0-717d-4e5b-8a70-d8faefe06a2f None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=1415b4cf2c674dec8fae3279787f8f75, user.id=263b9af6473c43e58dbec365c91ca379) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:46.120161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09271ba0-717d-4e5b-8a70-d8faefe06a2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:46.121598 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09271ba0-717d-4e5b-8a70-d8faefe06a2f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:46.128550 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 539/1064] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:28:45 2022] GET /identity/v3/role_assignments?user.id=263b9af6473c43e58dbec365c91ca379&scope.project.id=1415b4cf2c674dec8fae3279787f8f75&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:46.216049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee822a7-9986-4676-8955-56a760ad929c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:46.250478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:46.263759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14316f90-3907-47b5-9dc8-67f6211104ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:46.264576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14316f90-3907-47b5-9dc8-67f6211104ee None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:46.267302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14316f90-3907-47b5-9dc8-67f6211104ee None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:46.267302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14316f90-3907-47b5-9dc8-67f6211104ee None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:46.267302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14316f90-3907-47b5-9dc8-67f6211104ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:46.267302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14316f90-3907-47b5-9dc8-67f6211104ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:46.267630 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14316f90-3907-47b5-9dc8-67f6211104ee None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:46.282038 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 526/1065] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:46.287980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09271ba0-717d-4e5b-8a70-d8faefe06a2f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:46.387011 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:46.391521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09271ba0-717d-4e5b-8a70-d8faefe06a2f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:46.425486 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd232a-c09c-4438-af2c-c1834778411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:46.426319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd232a-c09c-4438-af2c-c1834778411b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:46.426601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd232a-c09c-4438-af2c-c1834778411b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:46.426876 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd232a-c09c-4438-af2c-c1834778411b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:46.434111 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd232a-c09c-4438-af2c-c1834778411b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:46.435693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd232a-c09c-4438-af2c-c1834778411b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-dabd232a-c09c-4438-af2c-c1834778411b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:46.450904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:46.451927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:46.452950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:46.452950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:46.452950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:46.452950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:46.452950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:46.452950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:46.452950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:46.452950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:46.452950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:28:46.452950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:46.452950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 540/1066] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 20 22:28:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:46.459704 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14316f90-3907-47b5-9dc8-67f6211104ee None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:46.565985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14316f90-3907-47b5-9dc8-67f6211104ee None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:46.603516 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecea281-735b-4a90-b79e-a8c3575b8b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:46.604565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea281-735b-4a90-b79e-a8c3575b8b22 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:46.604844 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea281-735b-4a90-b79e-a8c3575b8b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:46.605113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecea281-735b-4a90-b79e-a8c3575b8b22 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:46.605981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecea281-735b-4a90-b79e-a8c3575b8b22 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:46.607140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecea281-735b-4a90-b79e-a8c3575b8b22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:46.608677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecea281-735b-4a90-b79e-a8c3575b8b22 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:46.631120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 527/1067] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 20 22:28:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:46.632586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd232a-c09c-4438-af2c-c1834778411b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:46.735423 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd232a-c09c-4438-af2c-c1834778411b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:46.769121 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128ba7f-3ef2-4e4a-a655-3dd8d97be9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:46.769942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128ba7f-3ef2-4e4a-a655-3dd8d97be9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:46.770226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128ba7f-3ef2-4e4a-a655-3dd8d97be9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:46.770497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128ba7f-3ef2-4e4a-a655-3dd8d97be9a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:46.781362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128ba7f-3ef2-4e4a-a655-3dd8d97be9a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:46.782839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128ba7f-3ef2-4e4a-a655-3dd8d97be9a6 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b128ba7f-3ef2-4e4a-a655-3dd8d97be9a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:46.800621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:46.801559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:46.802867 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:46.802867 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:46.802867 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:46.802867 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:46.806041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 541/1068] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:46.807446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecea281-735b-4a90-b79e-a8c3575b8b22 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:46.854185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:46.914787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecea281-735b-4a90-b79e-a8c3575b8b22 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:46.948804 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec3d86-15b5-45de-8129-75b3bcd64e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:46.949619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3d86-15b5-45de-8129-75b3bcd64e13 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:46.950647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3d86-15b5-45de-8129-75b3bcd64e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:46.951042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec3d86-15b5-45de-8129-75b3bcd64e13 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:46.951843 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec3d86-15b5-45de-8129-75b3bcd64e13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:46.952250 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec3d86-15b5-45de-8129-75b3bcd64e13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:46.953744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec3d86-15b5-45de-8129-75b3bcd64e13 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:46.970901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 528/1069] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:46.971815 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128ba7f-3ef2-4e4a-a655-3dd8d97be9a6 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:46.984455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:47.085093 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128ba7f-3ef2-4e4a-a655-3dd8d97be9a6 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:47.119340 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94373135-199b-4175-b93a-e0e837fa3faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:47.120282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94373135-199b-4175-b93a-e0e837fa3faf None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:47.120655 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94373135-199b-4175-b93a-e0e837fa3faf None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:47.121043 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94373135-199b-4175-b93a-e0e837fa3faf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:47.128656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94373135-199b-4175-b93a-e0e837fa3faf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:47.130232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94373135-199b-4175-b93a-e0e837fa3faf None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-94373135-199b-4175-b93a-e0e837fa3faf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:47.144490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:47.145581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:47.146729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:47.146729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:47.146729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:47.146729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:47.146729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:47.146729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:47.146729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:47.146729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:47.148504 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 542/1070] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:47.154060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec3d86-15b5-45de-8129-75b3bcd64e13 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:47.171569 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4993f-2ec6-469c-9b1c-17d2bc955794 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:47.171851 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4993f-2ec6-469c-9b1c-17d2bc955794 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:47.172127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4993f-2ec6-469c-9b1c-17d2bc955794 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:47.173741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 543/1071] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:28:47.178543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b316b-c478-453f-bbcd-589d59604e8e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:47.178826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b316b-c478-453f-bbcd-589d59604e8e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:47.179098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35b316b-c478-453f-bbcd-589d59604e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:47.196133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e35b316b-c478-453f-bbcd-589d59604e8e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:47.197303 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e35b316b-c478-453f-bbcd-589d59604e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:47.263809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:47.267577 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec3d86-15b5-45de-8129-75b3bcd64e13 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:47.271679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:47.276778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 544/1072] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:47.298857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b316b-c478-453f-bbcd-589d59604e8e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:47.304979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473888ee-249f-4ebb-bbf1-b32d55538a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:47.305651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473888ee-249f-4ebb-bbf1-b32d55538a15 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:47.306032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473888ee-249f-4ebb-bbf1-b32d55538a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:47.306311 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473888ee-249f-4ebb-bbf1-b32d55538a15 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:47.307150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473888ee-249f-4ebb-bbf1-b32d55538a15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:47.307459 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473888ee-249f-4ebb-bbf1-b32d55538a15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:47.308897 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473888ee-249f-4ebb-bbf1-b32d55538a15 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:47.323910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 529/1073] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:47.330960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473888ee-249f-4ebb-bbf1-b32d55538a15 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:47.408405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35b316b-c478-453f-bbcd-589d59604e8e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:47.445749 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8991e51-b7c4-4934-a462-793089678e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:47.446421 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991e51-b7c4-4934-a462-793089678e5b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:47.446703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991e51-b7c4-4934-a462-793089678e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:47.446864 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473888ee-249f-4ebb-bbf1-b32d55538a15 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:47.446965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8991e51-b7c4-4934-a462-793089678e5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:47.485132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995fd9e-d375-48e8-8f2d-eb8114cd6473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:47.486053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995fd9e-d375-48e8-8f2d-eb8114cd6473 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:47.486337 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995fd9e-d375-48e8-8f2d-eb8114cd6473 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:47.486612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995fd9e-d375-48e8-8f2d-eb8114cd6473 None admin] PATH_INFO: `/v3/projects/8cec07c864274d649ecd1944be870bd5/users/67c92c8d2b9d41e489e4c03ae4e71fe2/roles/207ec663a0614937a744c94fe30f5ce7` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:47.488827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995fd9e-d375-48e8-8f2d-eb8114cd6473 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cec07c864274d649ecd1944be870bd5, user_id=67c92c8d2b9d41e489e4c03ae4e71fe2, role_id=207ec663a0614937a744c94fe30f5ce7)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:47.490307 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995fd9e-d375-48e8-8f2d-eb8114cd6473 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:47.514838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:47.517189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8991e51-b7c4-4934-a462-793089678e5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:47.518668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8991e51-b7c4-4934-a462-793089678e5b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:47.562332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 530/1074] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:28:47 2022] PUT /identity/v3/projects/8cec07c864274d649ecd1944be870bd5/users/67c92c8d2b9d41e489e4c03ae4e71fe2/roles/207ec663a0614937a744c94fe30f5ce7 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:28:47.634511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 545/1075] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:28:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 22:28:47.635795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995fd9e-d375-48e8-8f2d-eb8114cd6473 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:47.678345 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:47.766758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995fd9e-d375-48e8-8f2d-eb8114cd6473 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:47.802257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5ebb9-1f14-4d5d-80c4-06b9d9d0fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:47.803057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5ebb9-1f14-4d5d-80c4-06b9d9d0fd32 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:47.803342 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5ebb9-1f14-4d5d-80c4-06b9d9d0fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:47.803617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5ebb9-1f14-4d5d-80c4-06b9d9d0fd32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:47.814069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5ebb9-1f14-4d5d-80c4-06b9d9d0fd32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:47.815523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5ebb9-1f14-4d5d-80c4-06b9d9d0fd32 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-c4b5ebb9-1f14-4d5d-80c4-06b9d9d0fd32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:47.833082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:47.834325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:47.835291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:47.835291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:47.835291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:47.835291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:47.835291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 531/1076] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:47.842862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8991e51-b7c4-4934-a462-793089678e5b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:47.941010 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:47.944502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8991e51-b7c4-4934-a462-793089678e5b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:47.979579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b96ef-fbc2-4314-9686-e08bd98a1312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:47.980249 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b96ef-fbc2-4314-9686-e08bd98a1312 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:47.980532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b96ef-fbc2-4314-9686-e08bd98a1312 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:47.980813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b96ef-fbc2-4314-9686-e08bd98a1312 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:47.982165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b96ef-fbc2-4314-9686-e08bd98a1312 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:47.982469 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b96ef-fbc2-4314-9686-e08bd98a1312 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:47.983829 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b96ef-fbc2-4314-9686-e08bd98a1312 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:47.995415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 546/1077] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:48.199682 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33631afd-41bb-4945-80dc-93edffface47 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:48.199978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33631afd-41bb-4945-80dc-93edffface47 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:48.200265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33631afd-41bb-4945-80dc-93edffface47 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:48.201656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 532/1078] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:48.207253 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae6df-e9c6-47e7-b006-429cde589073 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:48.207546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae6df-e9c6-47e7-b006-429cde589073 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:48.207824 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ae6df-e9c6-47e7-b006-429cde589073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:48.225269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a18ae6df-e9c6-47e7-b006-429cde589073 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:48.226526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a18ae6df-e9c6-47e7-b006-429cde589073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:48.304062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 547/1079] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:48.328287 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33631afd-41bb-4945-80dc-93edffface47 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:48.400330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:48.431422 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33631afd-41bb-4945-80dc-93edffface47 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:48.465262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce578a67-22dc-4dbc-b393-cc5eb9e0677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:48.466575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce578a67-22dc-4dbc-b393-cc5eb9e0677b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:48.466861 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce578a67-22dc-4dbc-b393-cc5eb9e0677b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:48.467136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce578a67-22dc-4dbc-b393-cc5eb9e0677b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:48.476914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce578a67-22dc-4dbc-b393-cc5eb9e0677b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-ce578a67-22dc-4dbc-b393-cc5eb9e0677b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:48.484793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:48.485945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:48.486841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:48.486841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:48.486841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:48.486841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:48.486841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:48.486841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:48.486841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:48.486841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:48.486841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:48.486841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:48.486841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:48.486841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:48.486841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 533/1080] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:28:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:48.492050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ae6df-e9c6-47e7-b006-429cde589073 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:48.578892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:48.588064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ae6df-e9c6-47e7-b006-429cde589073 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:48.620543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed071084-01f9-4837-a456-b8470545c076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:48.621210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed071084-01f9-4837-a456-b8470545c076 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:48.621492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed071084-01f9-4837-a456-b8470545c076 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:48.622331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed071084-01f9-4837-a456-b8470545c076 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:48.623086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed071084-01f9-4837-a456-b8470545c076 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:48.623603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed071084-01f9-4837-a456-b8470545c076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:48.625284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed071084-01f9-4837-a456-b8470545c076 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:48.633500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 548/1081] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:28:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:48.640643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce578a67-22dc-4dbc-b393-cc5eb9e0677b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:48.760426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce578a67-22dc-4dbc-b393-cc5eb9e0677b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:48.788827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:48.794087 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cd9b5-a3ac-499f-8cda-d5e883c2f7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:48.794966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cd9b5-a3ac-499f-8cda-d5e883c2f7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:48.795249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cd9b5-a3ac-499f-8cda-d5e883c2f7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:48.804869 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cd9b5-a3ac-499f-8cda-d5e883c2f7d7 None admin] PATH_INFO: `/v3/users/263b9af6473c43e58dbec365c91ca379` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:48.804869 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cd9b5-a3ac-499f-8cda-d5e883c2f7d7 None admin] RBAC: Authorizing `identity:get_user(user_id=263b9af6473c43e58dbec365c91ca379)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:48.804869 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cd9b5-a3ac-499f-8cda-d5e883c2f7d7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:48.804869 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 534/1082] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:28:48 2022] GET /identity/v3/users/263b9af6473c43e58dbec365c91ca379 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:48.806932 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed071084-01f9-4837-a456-b8470545c076 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:48.908301 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed071084-01f9-4837-a456-b8470545c076 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:48.940966 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47607d28-e8a2-4ff1-827e-b3321ea4687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:48.941857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607d28-e8a2-4ff1-827e-b3321ea4687a None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:48.942141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607d28-e8a2-4ff1-827e-b3321ea4687a None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:48.942413 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47607d28-e8a2-4ff1-827e-b3321ea4687a None admin] PATH_INFO: `/v3/projects/1415b4cf2c674dec8fae3279787f8f75` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:48.943574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47607d28-e8a2-4ff1-827e-b3321ea4687a None admin] RBAC: Authorizing `identity:get_project(project_id=1415b4cf2c674dec8fae3279787f8f75)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:48.944984 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47607d28-e8a2-4ff1-827e-b3321ea4687a None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:48.946705 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 549/1083] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:28:48 2022] GET /identity/v3/projects/1415b4cf2c674dec8fae3279787f8f75 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:48.955582 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cd9b5-a3ac-499f-8cda-d5e883c2f7d7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:49.058945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cd9b5-a3ac-499f-8cda-d5e883c2f7d7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:49.095946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bc5f1-1b90-4796-bc8c-b36ee13f0988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:49.096840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bc5f1-1b90-4796-bc8c-b36ee13f0988 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:49.097121 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bc5f1-1b90-4796-bc8c-b36ee13f0988 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:49.097396 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bc5f1-1b90-4796-bc8c-b36ee13f0988 None admin] PATH_INFO: `/v3/projects/1415b4cf2c674dec8fae3279787f8f75/users/263b9af6473c43e58dbec365c91ca379/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:49.099357 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bc5f1-1b90-4796-bc8c-b36ee13f0988 None admin] RBAC: Authorizing `identity:create_grant(project_id=1415b4cf2c674dec8fae3279787f8f75, user_id=263b9af6473c43e58dbec365c91ca379, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:49.100787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bc5f1-1b90-4796-bc8c-b36ee13f0988 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:49.185766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 535/1084] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:28:48 2022] PUT /identity/v3/projects/1415b4cf2c674dec8fae3279787f8f75/users/263b9af6473c43e58dbec365c91ca379/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:28:49.659914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bedff5-d77c-475a-a829-9352a1fbe2f9 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:49.660448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bedff5-d77c-475a-a829-9352a1fbe2f9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:49.660448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bedff5-d77c-475a-a829-9352a1fbe2f9 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:49.661907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 550/1085] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:49.667369 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209f734-de04-44bf-b9cb-6a9ca39ca130 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:49.667778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209f734-de04-44bf-b9cb-6a9ca39ca130 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:49.668018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209f734-de04-44bf-b9cb-6a9ca39ca130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:49.686296 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c209f734-de04-44bf-b9cb-6a9ca39ca130 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:49.687496 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c209f734-de04-44bf-b9cb-6a9ca39ca130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:49.743165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:49.754897 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 536/1086] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:49.778588 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bedff5-d77c-475a-a829-9352a1fbe2f9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:49.801547 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:49.880382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bedff5-d77c-475a-a829-9352a1fbe2f9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:49.912892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41486e2c-25d0-4d2f-9a0b-c9d48912db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:49.913625 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41486e2c-25d0-4d2f-9a0b-c9d48912db0b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:49.913931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41486e2c-25d0-4d2f-9a0b-c9d48912db0b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:49.914204 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41486e2c-25d0-4d2f-9a0b-c9d48912db0b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:49.925688 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41486e2c-25d0-4d2f-9a0b-c9d48912db0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-41486e2c-25d0-4d2f-9a0b-c9d48912db0b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:49.933866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:49.936288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:49.937257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:49.937257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:49.937257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:49.937257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:49.937257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:49.937257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:49.937257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:49.937257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:49.937257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:49.937257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:49.937257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 22:28:49.937257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:49.937257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 551/1087] 10.222.0.83 () {56 vars in 1120 bytes} [Wed Jul 20 22:28:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:49.942061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209f734-de04-44bf-b9cb-6a9ca39ca130 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:50.038517 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209f734-de04-44bf-b9cb-6a9ca39ca130 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:50.071814 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9042c-7f9c-4aac-bf7d-35610ff08004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:50.072487 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9042c-7f9c-4aac-bf7d-35610ff08004 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:50.072771 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9042c-7f9c-4aac-bf7d-35610ff08004 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:50.073048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9042c-7f9c-4aac-bf7d-35610ff08004 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:50.073832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9042c-7f9c-4aac-bf7d-35610ff08004 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:50.074463 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9042c-7f9c-4aac-bf7d-35610ff08004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:50.075647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9042c-7f9c-4aac-bf7d-35610ff08004 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:50.086503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 537/1088] 10.222.0.83 () {56 vars in 1115 bytes} [Wed Jul 20 22:28:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:50.092731 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41486e2c-25d0-4d2f-9a0b-c9d48912db0b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:50.174416 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:50.192790 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41486e2c-25d0-4d2f-9a0b-c9d48912db0b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:50.225957 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21a058-91ee-4652-9bad-c5193649a82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:50.226937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21a058-91ee-4652-9bad-c5193649a82f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:50.227375 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21a058-91ee-4652-9bad-c5193649a82f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:50.228038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21a058-91ee-4652-9bad-c5193649a82f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:50.239690 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21a058-91ee-4652-9bad-c5193649a82f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:50.241125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21a058-91ee-4652-9bad-c5193649a82f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-be21a058-91ee-4652-9bad-c5193649a82f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:50.257964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:50.258887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:50.259796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:50.259796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:50.259796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:50.259796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:50.259796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 552/1089] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:50.265078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9042c-7f9c-4aac-bf7d-35610ff08004 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:50.321135 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:50.368356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9042c-7f9c-4aac-bf7d-35610ff08004 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:50.401860 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebddab2-562f-4d8b-b621-e96f50e124ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:50.402527 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebddab2-562f-4d8b-b621-e96f50e124ec None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:50.402829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebddab2-562f-4d8b-b621-e96f50e124ec None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:50.403664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebddab2-562f-4d8b-b621-e96f50e124ec None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:50.404396 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebddab2-562f-4d8b-b621-e96f50e124ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:50.404705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebddab2-562f-4d8b-b621-e96f50e124ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:50.406094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebddab2-562f-4d8b-b621-e96f50e124ec None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:50.418224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 538/1090] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:50.423927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21a058-91ee-4652-9bad-c5193649a82f None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:50.521220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21a058-91ee-4652-9bad-c5193649a82f None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:50.549692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:50.554613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25440be0-1a94-4053-8e52-d9f1808951c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:50.555411 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25440be0-1a94-4053-8e52-d9f1808951c2 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:50.555696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25440be0-1a94-4053-8e52-d9f1808951c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:50.555973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25440be0-1a94-4053-8e52-d9f1808951c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:50.563258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25440be0-1a94-4053-8e52-d9f1808951c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:50.572419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25440be0-1a94-4053-8e52-d9f1808951c2 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-25440be0-1a94-4053-8e52-d9f1808951c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:28:50.579173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:50.580240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:50.581235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:50.581235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:50.581235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:28:50.581235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:28:50.581235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:28:50.581235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:28:50.581235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:28:50.581235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:28:50.581235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 22:28:50.581235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:50.581235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 553/1091] 10.222.0.83 () {56 vars in 1093 bytes} [Wed Jul 20 22:28:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:50.586477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebddab2-562f-4d8b-b621-e96f50e124ec None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:50.685153 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebddab2-562f-4d8b-b621-e96f50e124ec None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:50.697986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:50.719236 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59b39e-58a2-4297-baac-01f689c12fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:50.719912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59b39e-58a2-4297-baac-01f689c12fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:50.720195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59b39e-58a2-4297-baac-01f689c12fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:50.720471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59b39e-58a2-4297-baac-01f689c12fe2 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:50.721313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59b39e-58a2-4297-baac-01f689c12fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:50.721624 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59b39e-58a2-4297-baac-01f689c12fe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:50.723086 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59b39e-58a2-4297-baac-01f689c12fe2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:50.741368 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 539/1092] 10.222.0.83 () {56 vars in 1133 bytes} [Wed Jul 20 22:28:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:50.748091 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25440be0-1a94-4053-8e52-d9f1808951c2 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:50.847688 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25440be0-1a94-4053-8e52-d9f1808951c2 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:50.882017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccadda-e6e8-464c-ac44-0e02c62785fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:50.882664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccadda-e6e8-464c-ac44-0e02c62785fb None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:50.882946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccadda-e6e8-464c-ac44-0e02c62785fb None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:50.883220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccadda-e6e8-464c-ac44-0e02c62785fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:50.941126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:50.951351 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccadda-e6e8-464c-ac44-0e02c62785fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:50.952789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccadda-e6e8-464c-ac44-0e02c62785fb None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:51.049128 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 554/1093] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:28:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:28:51.054871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59b39e-58a2-4297-baac-01f689c12fe2 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:51.160404 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59b39e-58a2-4297-baac-01f689c12fe2 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:51.194339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c3293-ceb3-4e32-9361-7771f403e102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:51.195186 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c3293-ceb3-4e32-9361-7771f403e102 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:51.195474 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c3293-ceb3-4e32-9361-7771f403e102 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:51.195749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c3293-ceb3-4e32-9361-7771f403e102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:51.206134 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c3293-ceb3-4e32-9361-7771f403e102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:51.207612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c3293-ceb3-4e32-9361-7771f403e102 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-f18c3293-ceb3-4e32-9361-7771f403e102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:28:51.224788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:51.225943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:51.226901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:28:51.226901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:28:51.226901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:28:51.226901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:51.226901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 540/1094] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:28:51.232690 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccadda-e6e8-464c-ac44-0e02c62785fb None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:51.239407 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684373-78ee-4388-98df-02d65ad3e99a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:51.239693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684373-78ee-4388-98df-02d65ad3e99a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:51.239972 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684373-78ee-4388-98df-02d65ad3e99a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:51.241330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 541/1095] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:28:51.246208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6482b7-b02b-46e6-b370-f9db7dfd59e2 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:51.246498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6482b7-b02b-46e6-b370-f9db7dfd59e2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:51.247433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6482b7-b02b-46e6-b370-f9db7dfd59e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:51.263809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-5b6482b7-b02b-46e6-b370-f9db7dfd59e2 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:51.265008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5b6482b7-b02b-46e6-b370-f9db7dfd59e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:51.282264 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:51.326371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:51.339230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccadda-e6e8-464c-ac44-0e02c62785fb None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:51.346913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 542/1096] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:51.371175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6482b7-b02b-46e6-b370-f9db7dfd59e2 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:51.375688 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb422be-d281-44a4-9352-6d7e21d2311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:51.376361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb422be-d281-44a4-9352-6d7e21d2311b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:51.376646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb422be-d281-44a4-9352-6d7e21d2311b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:51.376924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb422be-d281-44a4-9352-6d7e21d2311b None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:51.377653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb422be-d281-44a4-9352-6d7e21d2311b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:51.377995 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb422be-d281-44a4-9352-6d7e21d2311b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:51.379354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb422be-d281-44a4-9352-6d7e21d2311b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:51.391623 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 555/1097] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:51.397307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb422be-d281-44a4-9352-6d7e21d2311b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:51.474397 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6482b7-b02b-46e6-b370-f9db7dfd59e2 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:51.498260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb422be-d281-44a4-9352-6d7e21d2311b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:51.508956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecdd96-5ebb-48eb-a0ad-999302045953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:51.509785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecdd96-5ebb-48eb-a0ad-999302045953 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:51.510068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecdd96-5ebb-48eb-a0ad-999302045953 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:51.510347 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecdd96-5ebb-48eb-a0ad-999302045953 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:51.520636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecdd96-5ebb-48eb-a0ad-999302045953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-faecdd96-5ebb-48eb-a0ad-999302045953 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:28:51.528904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:51.529913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:51.531280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:51.531280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:51.531280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:51.531280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:51.531280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:28:51.531280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:28:51.531280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:28:51.531280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:28:51.531280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:28:51.531280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:28:51.531280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:28:51.531280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:28:51.531280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 543/1098] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:28:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:51.532014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc973c94-357d-4c21-a504-4a6efb037c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:51.532784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc973c94-357d-4c21-a504-4a6efb037c07 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:51.533086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc973c94-357d-4c21-a504-4a6efb037c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:51.533364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc973c94-357d-4c21-a504-4a6efb037c07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:51.536012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecdd96-5ebb-48eb-a0ad-999302045953 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:51.540248 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc973c94-357d-4c21-a504-4a6efb037c07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:51.541698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc973c94-357d-4c21-a504-4a6efb037c07 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:51.551286 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-dc973c94-357d-4c21-a504-4a6efb037c07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:28:51.555856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:28:51.556950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:28:51.557976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:28:51.557976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:28:51.557976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:28:51.557976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:28:51.557976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:28:51.557976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:28:51.557976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:28:51.557976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:28:51.557976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 556/1099] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:28:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:28:51.563458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc973c94-357d-4c21-a504-4a6efb037c07 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:51.578039 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:51.641512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecdd96-5ebb-48eb-a0ad-999302045953 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:51.665821 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc973c94-357d-4c21-a504-4a6efb037c07 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:51.677568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1893d1-78a7-48da-9ddd-faa1f69c8fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:51.678348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1893d1-78a7-48da-9ddd-faa1f69c8fed None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:51.678702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1893d1-78a7-48da-9ddd-faa1f69c8fed None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:51.678986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1893d1-78a7-48da-9ddd-faa1f69c8fed None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:51.679738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1893d1-78a7-48da-9ddd-faa1f69c8fed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:51.680055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1893d1-78a7-48da-9ddd-faa1f69c8fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:51.681441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1893d1-78a7-48da-9ddd-faa1f69c8fed None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:51.689635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 544/1100] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:28:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:51.695307 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1893d1-78a7-48da-9ddd-faa1f69c8fed None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:51.701370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2db96c-daae-4ba1-8596-274788af5462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:51.702079 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2db96c-daae-4ba1-8596-274788af5462 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:51.702362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2db96c-daae-4ba1-8596-274788af5462 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:51.702636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2db96c-daae-4ba1-8596-274788af5462 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:51.703428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2db96c-daae-4ba1-8596-274788af5462 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:51.703738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2db96c-daae-4ba1-8596-274788af5462 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:51.705583 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2db96c-daae-4ba1-8596-274788af5462 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:51.722634 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 557/1101] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:28:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:51.723613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2db96c-daae-4ba1-8596-274788af5462 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:51.769787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:51.792612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:51.794856 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1893d1-78a7-48da-9ddd-faa1f69c8fed None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:51.823406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2db96c-daae-4ba1-8596-274788af5462 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:51.830662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30717a-165e-48f8-968e-a4dd691e02d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:51.831546 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30717a-165e-48f8-968e-a4dd691e02d7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:51.831827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30717a-165e-48f8-968e-a4dd691e02d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:51.832110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30717a-165e-48f8-968e-a4dd691e02d7 None admin] PATH_INFO: `/v3/users/263b9af6473c43e58dbec365c91ca379` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:51.833394 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30717a-165e-48f8-968e-a4dd691e02d7 None admin] RBAC: Authorizing `identity:get_user(user_id=263b9af6473c43e58dbec365c91ca379)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:51.834872 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e30717a-165e-48f8-968e-a4dd691e02d7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:51.836663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 545/1102] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:28:51 2022] GET /identity/v3/users/263b9af6473c43e58dbec365c91ca379 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:51.842806 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30717a-165e-48f8-968e-a4dd691e02d7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:51.862888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c54d4d-4370-4b62-99c1-5029bd2551d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:51.863546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c54d4d-4370-4b62-99c1-5029bd2551d1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:51.863833 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c54d4d-4370-4b62-99c1-5029bd2551d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:51.864114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c54d4d-4370-4b62-99c1-5029bd2551d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:51.864955 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c54d4d-4370-4b62-99c1-5029bd2551d1 None admin] RBAC: Adding query filter params (role.id=207ec663a0614937a744c94fe30f5ce7, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=67c92c8d2b9d41e489e4c03ae4e71fe2) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:51.865276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c54d4d-4370-4b62-99c1-5029bd2551d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:51.866726 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c54d4d-4370-4b62-99c1-5029bd2551d1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:51.873464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 558/1103] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:28:51 2022] GET /identity/v3/role_assignments?user.id=67c92c8d2b9d41e489e4c03ae4e71fe2&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=207ec663a0614937a744c94fe30f5ce7 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:51.949352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30717a-165e-48f8-968e-a4dd691e02d7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:51.986425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c1fca-467a-4292-896c-4fcdda7ee848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:51.987352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1fca-467a-4292-896c-4fcdda7ee848 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:51.987862 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1fca-467a-4292-896c-4fcdda7ee848 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:51.988272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737c1fca-467a-4292-896c-4fcdda7ee848 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:52.002613 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:52.061350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c1fca-467a-4292-896c-4fcdda7ee848 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:52.062755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737c1fca-467a-4292-896c-4fcdda7ee848 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:52.163686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 546/1104] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:28:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 22:28:52.170318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c54d4d-4370-4b62-99c1-5029bd2551d1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:52.274736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c54d4d-4370-4b62-99c1-5029bd2551d1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:52.309817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329d9352-ca89-4330-ae9d-56d34974e2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:52.310691 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d9352-ca89-4330-ae9d-56d34974e2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:52.310971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d9352-ca89-4330-ae9d-56d34974e2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:52.311241 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329d9352-ca89-4330-ae9d-56d34974e2a1 None admin] PATH_INFO: `/v3/projects/1415b4cf2c674dec8fae3279787f8f75` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:52.313894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d9352-ca89-4330-ae9d-56d34974e2a1 None admin] RBAC: Authorizing `identity:get_project(project_id=1415b4cf2c674dec8fae3279787f8f75)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:52.315273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329d9352-ca89-4330-ae9d-56d34974e2a1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:52.316986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 559/1105] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:28:52 2022] GET /identity/v3/projects/1415b4cf2c674dec8fae3279787f8f75 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:52.323122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c1fca-467a-4292-896c-4fcdda7ee848 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:52.368722 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:52.427308 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737c1fca-467a-4292-896c-4fcdda7ee848 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:52.463212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25927dff-7182-454e-ac10-9a32793a8332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:52.463996 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25927dff-7182-454e-ac10-9a32793a8332 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:52.464345 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25927dff-7182-454e-ac10-9a32793a8332 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:52.464699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25927dff-7182-454e-ac10-9a32793a8332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:52.466344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25927dff-7182-454e-ac10-9a32793a8332 None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=1415b4cf2c674dec8fae3279787f8f75, user.id=263b9af6473c43e58dbec365c91ca379) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:52.466755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25927dff-7182-454e-ac10-9a32793a8332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:52.468206 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25927dff-7182-454e-ac10-9a32793a8332 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:52.474351 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 547/1106] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:28:52 2022] GET /identity/v3/role_assignments?user.id=263b9af6473c43e58dbec365c91ca379&scope.project.id=1415b4cf2c674dec8fae3279787f8f75&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:28:54.570646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151bedd-1ddd-4cc8-9e9e-efbae60db7c2 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:54.571200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151bedd-1ddd-4cc8-9e9e-efbae60db7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:54.571200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e151bedd-1ddd-4cc8-9e9e-efbae60db7c2 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:54.572569 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 560/1107] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:54.577968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57ce4c-8314-422e-a8f5-2bea74bdb62a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:54.578418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57ce4c-8314-422e-a8f5-2bea74bdb62a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:54.578515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57ce4c-8314-422e-a8f5-2bea74bdb62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:54.595778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ad57ce4c-8314-422e-a8f5-2bea74bdb62a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:54.597012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ad57ce4c-8314-422e-a8f5-2bea74bdb62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:54.664773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 548/1108] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:28:54.690196 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151bedd-1ddd-4cc8-9e9e-efbae60db7c2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:54.693990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:54.790679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e151bedd-1ddd-4cc8-9e9e-efbae60db7c2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:54.823256 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5285603-48de-40e7-92db-9dc2d902c36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:54.823981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285603-48de-40e7-92db-9dc2d902c36d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:54.824266 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285603-48de-40e7-92db-9dc2d902c36d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:54.824545 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5285603-48de-40e7-92db-9dc2d902c36d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:54.825745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5285603-48de-40e7-92db-9dc2d902c36d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:54.827184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5285603-48de-40e7-92db-9dc2d902c36d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:54.828799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 561/1109] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:28:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:54.834522 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57ce4c-8314-422e-a8f5-2bea74bdb62a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:54.868813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:54.931117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57ce4c-8314-422e-a8f5-2bea74bdb62a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:54.964820 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c661d2d-412a-47d8-9c13-8bc16eab8ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:54.965993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c661d2d-412a-47d8-9c13-8bc16eab8ef8 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:54.966786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c661d2d-412a-47d8-9c13-8bc16eab8ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:54.967060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c661d2d-412a-47d8-9c13-8bc16eab8ef8 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:54.967783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c661d2d-412a-47d8-9c13-8bc16eab8ef8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:54.969205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c661d2d-412a-47d8-9c13-8bc16eab8ef8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:55.063855 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 549/1110] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:28:54 2022] POST /identity/v3/users => generated 286 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:28:57.138047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559c1c8-1ee8-46ae-be92-6fb8789c8d4e None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:57.138604 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559c1c8-1ee8-46ae-be92-6fb8789c8d4e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:57.138604 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559c1c8-1ee8-46ae-be92-6fb8789c8d4e None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:57.139963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 562/1111] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:28:57.145810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97288e-1934-4916-be3e-67ea13573442 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:57.146258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97288e-1934-4916-be3e-67ea13573442 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:57.146359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97288e-1934-4916-be3e-67ea13573442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:57.162872 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3a97288e-1934-4916-be3e-67ea13573442 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:28:57.164057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3a97288e-1934-4916-be3e-67ea13573442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:28:57.228702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 550/1112] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:28:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:28:57.253814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559c1c8-1ee8-46ae-be92-6fb8789c8d4e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:57.322511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:57.352850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559c1c8-1ee8-46ae-be92-6fb8789c8d4e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:57.386034 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce26331-c9d4-456a-a8e3-5a747bc6be96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:57.386879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce26331-c9d4-456a-a8e3-5a747bc6be96 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:57.387767 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce26331-c9d4-456a-a8e3-5a747bc6be96 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:57.388037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce26331-c9d4-456a-a8e3-5a747bc6be96 None admin] PATH_INFO: `/v3/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:57.389600 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce26331-c9d4-456a-a8e3-5a747bc6be96 None admin] RBAC: Authorizing `identity:get_role(role_id=5e5bc4ce5d004cd1bb07ef755bf3bb48)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:57.390991 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce26331-c9d4-456a-a8e3-5a747bc6be96 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:57.392354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 563/1113] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:28:57 2022] GET /identity/v3/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:57.398192 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97288e-1934-4916-be3e-67ea13573442 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:57.423304 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:57.498374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97288e-1934-4916-be3e-67ea13573442 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:57.531896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ca8fc-1da9-46e5-ad68-b168d7603124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:57.532762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca8fc-1da9-46e5-ad68-b168d7603124 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:57.533053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca8fc-1da9-46e5-ad68-b168d7603124 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:57.533327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ca8fc-1da9-46e5-ad68-b168d7603124 None admin] PATH_INFO: `/v3/users/eea20739b5c74b188d7dee29676f95ee` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:57.548218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ca8fc-1da9-46e5-ad68-b168d7603124 None admin] RBAC: Authorizing `identity:get_user(user_id=eea20739b5c74b188d7dee29676f95ee)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:57.549651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ca8fc-1da9-46e5-ad68-b168d7603124 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:57.551305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 551/1114] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:28:57 2022] GET /identity/v3/users/eea20739b5c74b188d7dee29676f95ee => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:57.557065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce26331-c9d4-456a-a8e3-5a747bc6be96 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:57.654323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce26331-c9d4-456a-a8e3-5a747bc6be96 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:57.688202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dbba3-9218-4538-ad6c-f5b723148454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:57.688843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dbba3-9218-4538-ad6c-f5b723148454 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:57.689127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dbba3-9218-4538-ad6c-f5b723148454 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:57.689410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dbba3-9218-4538-ad6c-f5b723148454 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:57.727058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:57.782758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dbba3-9218-4538-ad6c-f5b723148454 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:57.784197 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dbba3-9218-4538-ad6c-f5b723148454 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:57.880965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 564/1115] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:28:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:28:57.887516 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ca8fc-1da9-46e5-ad68-b168d7603124 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:57.970635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:57.989150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ca8fc-1da9-46e5-ad68-b168d7603124 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:58.023530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0b124-c058-47c8-937e-499fa72b2d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:58.033133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0b124-c058-47c8-937e-499fa72b2d69 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:58.033133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0b124-c058-47c8-937e-499fa72b2d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:58.033133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0b124-c058-47c8-937e-499fa72b2d69 None admin] PATH_INFO: `/v3/projects/1415b4cf2c674dec8fae3279787f8f75` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:58.033133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0b124-c058-47c8-937e-499fa72b2d69 None admin] RBAC: Authorizing `identity:get_project(project_id=1415b4cf2c674dec8fae3279787f8f75)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:58.033133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0b124-c058-47c8-937e-499fa72b2d69 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:58.033133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 552/1116] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:28:57 2022] GET /identity/v3/projects/1415b4cf2c674dec8fae3279787f8f75 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:28:58.036562 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dbba3-9218-4538-ad6c-f5b723148454 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:28:58.077938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:28:58.138811 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dbba3-9218-4538-ad6c-f5b723148454 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:28:58.172871 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5be6a84-50e2-47a4-b2af-604460647229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:28:58.173527 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be6a84-50e2-47a4-b2af-604460647229 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:28:58.173842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be6a84-50e2-47a4-b2af-604460647229 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:28:58.174122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5be6a84-50e2-47a4-b2af-604460647229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:28:58.174954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be6a84-50e2-47a4-b2af-604460647229 None admin] RBAC: Adding query filter params (role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48, scope.project.id=1415b4cf2c674dec8fae3279787f8f75, user.id=eea20739b5c74b188d7dee29676f95ee) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:28:58.175268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be6a84-50e2-47a4-b2af-604460647229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:28:58.176725 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5be6a84-50e2-47a4-b2af-604460647229 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:28:58.182179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 565/1117] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:28:58 2022] GET /identity/v3/role_assignments?user.id=eea20739b5c74b188d7dee29676f95ee&scope.project.id=1415b4cf2c674dec8fae3279787f8f75&role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:00.191471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6a6a4-7cac-4f9c-a1f8-45c294db4ebf None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:00.192022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6a6a4-7cac-4f9c-a1f8-45c294db4ebf None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:00.192022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6a6a4-7cac-4f9c-a1f8-45c294db4ebf None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:00.193386 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 553/1118] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:29:00.198629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a8772-e95a-4255-b1e6-853f134c4fab None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:00.199081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a8772-e95a-4255-b1e6-853f134c4fab None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:00.199189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a8772-e95a-4255-b1e6-853f134c4fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:00.216530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a61a8772-e95a-4255-b1e6-853f134c4fab None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:29:00.217845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a61a8772-e95a-4255-b1e6-853f134c4fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:29:00.283508 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 566/1119] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:29:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:29:00.305939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6a6a4-7cac-4f9c-a1f8-45c294db4ebf None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:00.408442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6a6a4-7cac-4f9c-a1f8-45c294db4ebf None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:00.441096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a7b1b-df77-4c3e-8a70-365dd49cd18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:00.441980 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a7b1b-df77-4c3e-8a70-365dd49cd18f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:00.442266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a7b1b-df77-4c3e-8a70-365dd49cd18f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:00.442545 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a7b1b-df77-4c3e-8a70-365dd49cd18f None admin] PATH_INFO: `/v3/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:00.444024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a7b1b-df77-4c3e-8a70-365dd49cd18f None admin] RBAC: Authorizing `identity:get_role(role_id=5e5bc4ce5d004cd1bb07ef755bf3bb48)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:00.445387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a7b1b-df77-4c3e-8a70-365dd49cd18f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:00.446776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 554/1120] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:29:00 2022] GET /identity/v3/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:00.453259 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a8772-e95a-4255-b1e6-853f134c4fab None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:00.486741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:00.551357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a8772-e95a-4255-b1e6-853f134c4fab None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:00.586419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8f059-cddb-4588-bd0e-8de89901327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:00.587280 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8f059-cddb-4588-bd0e-8de89901327d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:00.587560 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8f059-cddb-4588-bd0e-8de89901327d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:00.587833 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8f059-cddb-4588-bd0e-8de89901327d None admin] PATH_INFO: `/v3/users/eea20739b5c74b188d7dee29676f95ee` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:00.589022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8f059-cddb-4588-bd0e-8de89901327d None admin] RBAC: Authorizing `identity:get_user(user_id=eea20739b5c74b188d7dee29676f95ee)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:00.590693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b8f059-cddb-4588-bd0e-8de89901327d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:00.592325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 567/1121] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:29:00 2022] GET /identity/v3/users/eea20739b5c74b188d7dee29676f95ee => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:00.598131 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a7b1b-df77-4c3e-8a70-365dd49cd18f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:00.616127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:00.696315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a7b1b-df77-4c3e-8a70-365dd49cd18f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:00.730144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85ccd8-b677-4452-8b20-f7593558d784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:00.731457 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85ccd8-b677-4452-8b20-f7593558d784 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:00.731738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85ccd8-b677-4452-8b20-f7593558d784 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:00.732010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85ccd8-b677-4452-8b20-f7593558d784 None admin] PATH_INFO: `/v3/projects/1415b4cf2c674dec8fae3279787f8f75` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:00.733171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85ccd8-b677-4452-8b20-f7593558d784 None admin] RBAC: Authorizing `identity:get_project(project_id=1415b4cf2c674dec8fae3279787f8f75)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:00.734618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85ccd8-b677-4452-8b20-f7593558d784 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:00.736280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 555/1122] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:29:00 2022] GET /identity/v3/projects/1415b4cf2c674dec8fae3279787f8f75 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:00.742374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8f059-cddb-4588-bd0e-8de89901327d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:00.839572 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8f059-cddb-4588-bd0e-8de89901327d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:00.841095 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:00.872670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c15934-1a41-45d8-bde6-61a4735cf5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:00.873783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15934-1a41-45d8-bde6-61a4735cf5d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:00.874375 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15934-1a41-45d8-bde6-61a4735cf5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:00.874657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c15934-1a41-45d8-bde6-61a4735cf5d8 None admin] PATH_INFO: `/v3/projects/1415b4cf2c674dec8fae3279787f8f75/users/eea20739b5c74b188d7dee29676f95ee/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:00.876857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c15934-1a41-45d8-bde6-61a4735cf5d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1415b4cf2c674dec8fae3279787f8f75, user_id=eea20739b5c74b188d7dee29676f95ee, role_id=5e5bc4ce5d004cd1bb07ef755bf3bb48)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:00.878304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c15934-1a41-45d8-bde6-61a4735cf5d8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:00.935532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 568/1123] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:29:00 2022] PUT /identity/v3/projects/1415b4cf2c674dec8fae3279787f8f75/users/eea20739b5c74b188d7dee29676f95ee/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:29:03.003061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880df77-8f2f-476a-9a73-0e94bf37b4b5 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:03.003619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880df77-8f2f-476a-9a73-0e94bf37b4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:03.003619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880df77-8f2f-476a-9a73-0e94bf37b4b5 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:03.004984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 556/1124] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:29:03.010205 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528b29f-2681-4f65-a456-ed9da6566242 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:03.010617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528b29f-2681-4f65-a456-ed9da6566242 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:03.010761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528b29f-2681-4f65-a456-ed9da6566242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:03.027731 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3528b29f-2681-4f65-a456-ed9da6566242 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:29:03.028948 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3528b29f-2681-4f65-a456-ed9da6566242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:29:03.093667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 569/1125] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:29:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:29:03.117329 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880df77-8f2f-476a-9a73-0e94bf37b4b5 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:03.202715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:03.219433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880df77-8f2f-476a-9a73-0e94bf37b4b5 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:03.253586 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2844cc-a2b0-4714-bf09-72a6f1968ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:03.254398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2844cc-a2b0-4714-bf09-72a6f1968ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:03.254685 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2844cc-a2b0-4714-bf09-72a6f1968ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:03.254971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2844cc-a2b0-4714-bf09-72a6f1968ed6 None admin] PATH_INFO: `/v3/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:03.256449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2844cc-a2b0-4714-bf09-72a6f1968ed6 None admin] RBAC: Authorizing `identity:get_role(role_id=5e5bc4ce5d004cd1bb07ef755bf3bb48)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:03.257857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2844cc-a2b0-4714-bf09-72a6f1968ed6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:03.259281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 557/1126] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:29:03 2022] GET /identity/v3/roles/5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:03.265461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528b29f-2681-4f65-a456-ed9da6566242 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:03.352617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:03.361924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528b29f-2681-4f65-a456-ed9da6566242 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:03.396236 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374a02f-4d40-45c2-b02b-aa56324235df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:03.397106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a02f-4d40-45c2-b02b-aa56324235df None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:03.397391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a02f-4d40-45c2-b02b-aa56324235df None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:03.397666 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a02f-4d40-45c2-b02b-aa56324235df None admin] PATH_INFO: `/v3/users/eea20739b5c74b188d7dee29676f95ee` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:03.398929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374a02f-4d40-45c2-b02b-aa56324235df None admin] RBAC: Authorizing `identity:get_user(user_id=eea20739b5c74b188d7dee29676f95ee)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:03.400358 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374a02f-4d40-45c2-b02b-aa56324235df None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:03.402044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 570/1127] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:29:03 2022] GET /identity/v3/users/eea20739b5c74b188d7dee29676f95ee => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:29:03.408061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2844cc-a2b0-4714-bf09-72a6f1968ed6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:03.505391 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2844cc-a2b0-4714-bf09-72a6f1968ed6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:03.538669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba42ee5-fb5f-4484-ad0f-cd3ba2831ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:03.539305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba42ee5-fb5f-4484-ad0f-cd3ba2831ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:03.539588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba42ee5-fb5f-4484-ad0f-cd3ba2831ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:03.539867 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba42ee5-fb5f-4484-ad0f-cd3ba2831ea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:03.561097 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:03.607465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba42ee5-fb5f-4484-ad0f-cd3ba2831ea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:03.608914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba42ee5-fb5f-4484-ad0f-cd3ba2831ea5 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:03.703702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 558/1128] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:29:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:29:03.709764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374a02f-4d40-45c2-b02b-aa56324235df None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:03.808262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374a02f-4d40-45c2-b02b-aa56324235df None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:03.843193 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7110a3-3df4-4d82-9b1d-d033f50d3dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:03.844048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7110a3-3df4-4d82-9b1d-d033f50d3dce None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:03.844329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7110a3-3df4-4d82-9b1d-d033f50d3dce None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:03.844601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7110a3-3df4-4d82-9b1d-d033f50d3dce None admin] PATH_INFO: `/v3/projects/1415b4cf2c674dec8fae3279787f8f75` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:03.845781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7110a3-3df4-4d82-9b1d-d033f50d3dce None admin] RBAC: Authorizing `identity:get_project(project_id=1415b4cf2c674dec8fae3279787f8f75)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:03.847315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7110a3-3df4-4d82-9b1d-d033f50d3dce None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:03.848993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 571/1129] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:29:03 2022] GET /identity/v3/projects/1415b4cf2c674dec8fae3279787f8f75 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:03.855458 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba42ee5-fb5f-4484-ad0f-cd3ba2831ea5 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:03.906804 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:03.952296 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba42ee5-fb5f-4484-ad0f-cd3ba2831ea5 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:03.986616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36998e16-f52c-4657-b75b-f86c99951a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:03.987264 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998e16-f52c-4657-b75b-f86c99951a88 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:03.987549 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998e16-f52c-4657-b75b-f86c99951a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:03.987826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36998e16-f52c-4657-b75b-f86c99951a88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:03.988666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36998e16-f52c-4657-b75b-f86c99951a88 None admin] RBAC: Adding query filter params (role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48, scope.project.id=1415b4cf2c674dec8fae3279787f8f75, user.id=eea20739b5c74b188d7dee29676f95ee) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:29:03.988981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36998e16-f52c-4657-b75b-f86c99951a88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:03.990442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36998e16-f52c-4657-b75b-f86c99951a88 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:03.996182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 559/1130] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:29:03 2022] GET /identity/v3/role_assignments?user.id=eea20739b5c74b188d7dee29676f95ee&scope.project.id=1415b4cf2c674dec8fae3279787f8f75&role.id=5e5bc4ce5d004cd1bb07ef755bf3bb48 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:29:06.045852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92fc7f-1a16-40f0-9d5c-ef2735bb9882 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:06.046432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92fc7f-1a16-40f0-9d5c-ef2735bb9882 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:06.046432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92fc7f-1a16-40f0-9d5c-ef2735bb9882 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:06.047824 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 572/1131] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:29:06.052943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065934-ffb3-4339-80bc-42ec08eecaf0 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:06.053354 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065934-ffb3-4339-80bc-42ec08eecaf0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:06.053497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065934-ffb3-4339-80bc-42ec08eecaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:06.070749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c0065934-ffb3-4339-80bc-42ec08eecaf0 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:29:06.071958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c0065934-ffb3-4339-80bc-42ec08eecaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:29:06.140066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 560/1132] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:29:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:29:06.163257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92fc7f-1a16-40f0-9d5c-ef2735bb9882 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:06.192403 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:06.263580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92fc7f-1a16-40f0-9d5c-ef2735bb9882 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:06.296998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3ba69-ae4b-4272-b22f-1892043c7025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:06.297741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3ba69-ae4b-4272-b22f-1892043c7025 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:06.298032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3ba69-ae4b-4272-b22f-1892043c7025 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:06.298308 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3ba69-ae4b-4272-b22f-1892043c7025 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:06.299478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3ba69-ae4b-4272-b22f-1892043c7025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:06.300910 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf3ba69-ae4b-4272-b22f-1892043c7025 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:06.302556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 573/1133] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:29:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:06.308442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0065934-ffb3-4339-80bc-42ec08eecaf0 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:06.353624 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:06.405306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0065934-ffb3-4339-80bc-42ec08eecaf0 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:06.439368 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d1ff7-627d-4543-bc5b-759fb23fe1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:06.440020 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d1ff7-627d-4543-bc5b-759fb23fe1d4 None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:06.440306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d1ff7-627d-4543-bc5b-759fb23fe1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:06.440586 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d1ff7-627d-4543-bc5b-759fb23fe1d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:06.441290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d1ff7-627d-4543-bc5b-759fb23fe1d4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:06.442767 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d1ff7-627d-4543-bc5b-759fb23fe1d4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:06.573454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 561/1134] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 20 22:29:06 2022] POST /identity/v3/projects => generated 311 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:29:08.638818 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e89671-4433-4f00-9b13-d14d409e7f5f None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:08.639380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e89671-4433-4f00-9b13-d14d409e7f5f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:08.639380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e89671-4433-4f00-9b13-d14d409e7f5f None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:08.640757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 574/1135] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:29:08.646056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43638d0-8acd-4441-97ab-2a50a4b22efe None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:08.646824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43638d0-8acd-4441-97ab-2a50a4b22efe None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:08.646824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43638d0-8acd-4441-97ab-2a50a4b22efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:08.663301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a43638d0-8acd-4441-97ab-2a50a4b22efe None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:29:08.664485 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a43638d0-8acd-4441-97ab-2a50a4b22efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:29:08.731174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 562/1136] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:29:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:29:08.756664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e89671-4433-4f00-9b13-d14d409e7f5f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:08.849178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:08.856552 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e89671-4433-4f00-9b13-d14d409e7f5f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:08.890078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c9601-559c-47f2-874c-5c8a83873fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:08.890797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c9601-559c-47f2-874c-5c8a83873fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:08.891366 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c9601-559c-47f2-874c-5c8a83873fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:08.891644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c9601-559c-47f2-874c-5c8a83873fe1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:08.892821 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c9601-559c-47f2-874c-5c8a83873fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:08.894277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c9601-559c-47f2-874c-5c8a83873fe1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:08.895891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 575/1137] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:29:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:08.901665 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43638d0-8acd-4441-97ab-2a50a4b22efe None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:08.930174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:09.001338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43638d0-8acd-4441-97ab-2a50a4b22efe None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:09.034626 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090aa9b8-b6d0-406e-a624-c6aea5ad029a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:09.035283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aa9b8-b6d0-406e-a624-c6aea5ad029a None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:09.035563 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aa9b8-b6d0-406e-a624-c6aea5ad029a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:09.035837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aa9b8-b6d0-406e-a624-c6aea5ad029a None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:09.036550 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090aa9b8-b6d0-406e-a624-c6aea5ad029a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:09.037998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090aa9b8-b6d0-406e-a624-c6aea5ad029a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:09.144960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 563/1138] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:29:08 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:29:11.235986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe6683-547a-4b18-a30f-5c0df273237e None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:11.236514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe6683-547a-4b18-a30f-5c0df273237e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:11.236514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe6683-547a-4b18-a30f-5c0df273237e None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:11.237957 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 576/1139] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:29:11.243053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3da3ae-6cab-406c-ba43-11fe6b62d4ab None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:11.243434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3da3ae-6cab-406c-ba43-11fe6b62d4ab None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:11.243610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3da3ae-6cab-406c-ba43-11fe6b62d4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:11.260309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1a3da3ae-6cab-406c-ba43-11fe6b62d4ab None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:29:11.261513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1a3da3ae-6cab-406c-ba43-11fe6b62d4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:29:11.331087 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 564/1140] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:29:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:29:11.354761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe6683-547a-4b18-a30f-5c0df273237e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:11.454567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe6683-547a-4b18-a30f-5c0df273237e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:11.488260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c080780-7ee4-4331-a0a5-fd52e73a000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:11.489052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c080780-7ee4-4331-a0a5-fd52e73a000b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:11.489337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c080780-7ee4-4331-a0a5-fd52e73a000b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:11.489613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c080780-7ee4-4331-a0a5-fd52e73a000b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:11.500349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c080780-7ee4-4331-a0a5-fd52e73a000b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-2c080780-7ee4-4331-a0a5-fd52e73a000b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:29:11.507993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:29:11.509179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:29:11.510348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:29:11.510348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:29:11.510348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:29:11.510348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:29:11.510348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:29:11.510348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:29:11.510348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:29:11.510348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:29:11.510348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:29:11.510348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:29:11.510348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:29:11.510348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:29:11.510348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 577/1141] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:29:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:29:11.515365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3da3ae-6cab-406c-ba43-11fe6b62d4ab None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:11.530259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:11.614307 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3da3ae-6cab-406c-ba43-11fe6b62d4ab None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:11.652060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0b18d-fbb9-4924-8555-d759cf572c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:11.652877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0b18d-fbb9-4924-8555-d759cf572c17 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:11.653123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0b18d-fbb9-4924-8555-d759cf572c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:11.653394 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0b18d-fbb9-4924-8555-d759cf572c17 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:11.654180 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0b18d-fbb9-4924-8555-d759cf572c17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:29:11.654486 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0b18d-fbb9-4924-8555-d759cf572c17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:11.658230 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0b18d-fbb9-4924-8555-d759cf572c17 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:11.663759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 565/1142] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:29:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:11.670262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c080780-7ee4-4331-a0a5-fd52e73a000b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:11.696530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:11.770611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c080780-7ee4-4331-a0a5-fd52e73a000b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:11.804890 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18275a28-61ed-4e49-806c-0bd21ef9c12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:11.805832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18275a28-61ed-4e49-806c-0bd21ef9c12b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:11.806119 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18275a28-61ed-4e49-806c-0bd21ef9c12b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:11.806395 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18275a28-61ed-4e49-806c-0bd21ef9c12b None admin] PATH_INFO: `/v3/users/c232771b63d54d9dbd01a9dcfc1d87ba` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:11.819300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18275a28-61ed-4e49-806c-0bd21ef9c12b None admin] RBAC: Authorizing `identity:get_user(user_id=c232771b63d54d9dbd01a9dcfc1d87ba)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:11.820740 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18275a28-61ed-4e49-806c-0bd21ef9c12b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:11.822476 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 578/1143] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:29:11 2022] GET /identity/v3/users/c232771b63d54d9dbd01a9dcfc1d87ba => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:11.828410 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0b18d-fbb9-4924-8555-d759cf572c17 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:11.905770 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:11.928287 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0b18d-fbb9-4924-8555-d759cf572c17 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:11.960702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be266678-61c0-4ac8-9a10-0a40015cde00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:11.961346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be266678-61c0-4ac8-9a10-0a40015cde00 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:11.961631 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be266678-61c0-4ac8-9a10-0a40015cde00 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:11.961936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be266678-61c0-4ac8-9a10-0a40015cde00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:12.027188 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be266678-61c0-4ac8-9a10-0a40015cde00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:12.029180 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be266678-61c0-4ac8-9a10-0a40015cde00 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:12.103688 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:12.127689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 566/1144] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:29:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:29:12.133553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18275a28-61ed-4e49-806c-0bd21ef9c12b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:12.213711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:12.232048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18275a28-61ed-4e49-806c-0bd21ef9c12b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:12.265941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d57e712-5714-4692-99ac-80f829140054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:12.266807 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57e712-5714-4692-99ac-80f829140054 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:12.267094 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57e712-5714-4692-99ac-80f829140054 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:12.267374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57e712-5714-4692-99ac-80f829140054 None admin] PATH_INFO: `/v3/projects/370edc8fc67d4d9daf322648d11be7ed` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:12.268567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57e712-5714-4692-99ac-80f829140054 None admin] RBAC: Authorizing `identity:get_project(project_id=370edc8fc67d4d9daf322648d11be7ed)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:12.270023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d57e712-5714-4692-99ac-80f829140054 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:12.271715 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 579/1145] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:29:12 2022] GET /identity/v3/projects/370edc8fc67d4d9daf322648d11be7ed => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:12.278395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be266678-61c0-4ac8-9a10-0a40015cde00 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:12.375018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be266678-61c0-4ac8-9a10-0a40015cde00 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:12.408647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46331625-daca-4fc1-8c3d-d68d5af36c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:12.409302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46331625-daca-4fc1-8c3d-d68d5af36c64 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:12.409588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46331625-daca-4fc1-8c3d-d68d5af36c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:12.409898 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46331625-daca-4fc1-8c3d-d68d5af36c64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:12.410730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46331625-daca-4fc1-8c3d-d68d5af36c64 None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=370edc8fc67d4d9daf322648d11be7ed, user.id=c232771b63d54d9dbd01a9dcfc1d87ba) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:29:12.411047 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46331625-daca-4fc1-8c3d-d68d5af36c64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:12.412476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46331625-daca-4fc1-8c3d-d68d5af36c64 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:12.417814 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 567/1146] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:29:12 2022] GET /identity/v3/role_assignments?user.id=c232771b63d54d9dbd01a9dcfc1d87ba&scope.project.id=370edc8fc67d4d9daf322648d11be7ed&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:14.438323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf5a08-2388-43d0-a9b2-218d8980cb85 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:14.438865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf5a08-2388-43d0-a9b2-218d8980cb85 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:14.438865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf5a08-2388-43d0-a9b2-218d8980cb85 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:14.440313 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 580/1147] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:29:14.446298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158be46-7551-4bba-8d62-45e44f2ea74e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:14.446690 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158be46-7551-4bba-8d62-45e44f2ea74e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:14.446933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158be46-7551-4bba-8d62-45e44f2ea74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:14.463431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-5158be46-7551-4bba-8d62-45e44f2ea74e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:29:14.464623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5158be46-7551-4bba-8d62-45e44f2ea74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:29:14.499636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:14.531696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 568/1148] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:29:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:29:14.554553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf5a08-2388-43d0-a9b2-218d8980cb85 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:14.655783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf5a08-2388-43d0-a9b2-218d8980cb85 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:14.690226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02c25b-670e-482f-8e6b-3dbfa2c236ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:14.690950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02c25b-670e-482f-8e6b-3dbfa2c236ab None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:14.691234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02c25b-670e-482f-8e6b-3dbfa2c236ab None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:14.691512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02c25b-670e-482f-8e6b-3dbfa2c236ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:14.701595 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02c25b-670e-482f-8e6b-3dbfa2c236ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-0e02c25b-670e-482f-8e6b-3dbfa2c236ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:29:14.709328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:29:14.710455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:29:14.711377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:29:14.711377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:29:14.711377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:29:14.711377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:29:14.711377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:29:14.711377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:29:14.711377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:29:14.711377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:29:14.711377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:29:14.711377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:29:14.711377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:29:14.711377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:29:14.711377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 581/1149] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:29:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:29:14.716986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158be46-7551-4bba-8d62-45e44f2ea74e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:14.812352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158be46-7551-4bba-8d62-45e44f2ea74e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:14.844951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1fce4-3d6a-41ef-81ec-2a1096cbfd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:14.845610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1fce4-3d6a-41ef-81ec-2a1096cbfd2a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:14.845925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1fce4-3d6a-41ef-81ec-2a1096cbfd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:14.846237 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1fce4-3d6a-41ef-81ec-2a1096cbfd2a None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:14.846980 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1fce4-3d6a-41ef-81ec-2a1096cbfd2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:29:14.847288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1fce4-3d6a-41ef-81ec-2a1096cbfd2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:14.848653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1fce4-3d6a-41ef-81ec-2a1096cbfd2a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:14.857410 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 569/1150] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:29:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:14.863291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02c25b-670e-482f-8e6b-3dbfa2c236ab None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:14.876062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:14.961197 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02c25b-670e-482f-8e6b-3dbfa2c236ab None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:14.993922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc758dff-783d-47cd-a79b-c8fde07982c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:14.994775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc758dff-783d-47cd-a79b-c8fde07982c8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:14.995053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc758dff-783d-47cd-a79b-c8fde07982c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:14.995323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc758dff-783d-47cd-a79b-c8fde07982c8 None admin] PATH_INFO: `/v3/users/c232771b63d54d9dbd01a9dcfc1d87ba` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:14.996486 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc758dff-783d-47cd-a79b-c8fde07982c8 None admin] RBAC: Authorizing `identity:get_user(user_id=c232771b63d54d9dbd01a9dcfc1d87ba)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:14.997933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc758dff-783d-47cd-a79b-c8fde07982c8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:14.999717 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 582/1151] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:29:14 2022] GET /identity/v3/users/c232771b63d54d9dbd01a9dcfc1d87ba => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:15.005938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1fce4-3d6a-41ef-81ec-2a1096cbfd2a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:15.038052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:15.108061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1fce4-3d6a-41ef-81ec-2a1096cbfd2a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:15.140044 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794d5a2-4716-4af4-bfb9-23c1b4441254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:15.140905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794d5a2-4716-4af4-bfb9-23c1b4441254 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:15.141179 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794d5a2-4716-4af4-bfb9-23c1b4441254 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:15.141448 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794d5a2-4716-4af4-bfb9-23c1b4441254 None admin] PATH_INFO: `/v3/projects/370edc8fc67d4d9daf322648d11be7ed` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:15.142654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794d5a2-4716-4af4-bfb9-23c1b4441254 None admin] RBAC: Authorizing `identity:get_project(project_id=370edc8fc67d4d9daf322648d11be7ed)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:15.144110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794d5a2-4716-4af4-bfb9-23c1b4441254 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:15.145891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 570/1152] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:29:15 2022] GET /identity/v3/projects/370edc8fc67d4d9daf322648d11be7ed => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:15.151829 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc758dff-783d-47cd-a79b-c8fde07982c8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:15.230053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:15.251563 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc758dff-783d-47cd-a79b-c8fde07982c8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:15.285888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5b74ae-4077-48ac-9f36-18df71c7024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:15.286770 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b74ae-4077-48ac-9f36-18df71c7024f None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:15.287051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b74ae-4077-48ac-9f36-18df71c7024f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:15.287324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5b74ae-4077-48ac-9f36-18df71c7024f None admin] PATH_INFO: `/v3/projects/370edc8fc67d4d9daf322648d11be7ed/users/c232771b63d54d9dbd01a9dcfc1d87ba/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:15.289281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b74ae-4077-48ac-9f36-18df71c7024f None admin] RBAC: Authorizing `identity:create_grant(project_id=370edc8fc67d4d9daf322648d11be7ed, user_id=c232771b63d54d9dbd01a9dcfc1d87ba, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:15.290744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5b74ae-4077-48ac-9f36-18df71c7024f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:15.388074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 583/1153] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:29:15 2022] PUT /identity/v3/projects/370edc8fc67d4d9daf322648d11be7ed/users/c232771b63d54d9dbd01a9dcfc1d87ba/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:29:17.448384 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e6032-b2e6-45ba-8c3b-7081acc50db3 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:17.448900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e6032-b2e6-45ba-8c3b-7081acc50db3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:17.449006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e6032-b2e6-45ba-8c3b-7081acc50db3 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:17.451040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 571/1154] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:29:17.456414 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e7863-d6ca-4baf-8d9e-545015ac32ff None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:17.456859 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e7863-d6ca-4baf-8d9e-545015ac32ff None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:17.456969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e7863-d6ca-4baf-8d9e-545015ac32ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:17.474110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-160e7863-d6ca-4baf-8d9e-545015ac32ff None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:29:17.475278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-160e7863-d6ca-4baf-8d9e-545015ac32ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:29:17.539973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 584/1155] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:29:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:29:17.563703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e6032-b2e6-45ba-8c3b-7081acc50db3 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:17.661740 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:17.665395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e6032-b2e6-45ba-8c3b-7081acc50db3 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:17.697632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556cec7-985e-408d-b9f5-513fcabcf9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:17.698477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556cec7-985e-408d-b9f5-513fcabcf9fa None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:17.698711 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556cec7-985e-408d-b9f5-513fcabcf9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:17.698984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556cec7-985e-408d-b9f5-513fcabcf9fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:17.710008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556cec7-985e-408d-b9f5-513fcabcf9fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-5556cec7-985e-408d-b9f5-513fcabcf9fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:29:17.718432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:29:17.719390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:29:17.720319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:29:17.720319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:29:17.720319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:29:17.720319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:29:17.720319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:29:17.720319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:29:17.720319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:29:17.720319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:29:17.720319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:29:17.720319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:29:17.720319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:29:17.720319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:29:17.720319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 572/1156] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:29:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:29:17.725653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e7863-d6ca-4baf-8d9e-545015ac32ff None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:17.789632 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:17.820895 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e7863-d6ca-4baf-8d9e-545015ac32ff None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:17.853953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884efc2-7e0f-4a6b-ac12-2ffb8e080871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:17.854867 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884efc2-7e0f-4a6b-ac12-2ffb8e080871 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:17.855144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884efc2-7e0f-4a6b-ac12-2ffb8e080871 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:17.855495 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884efc2-7e0f-4a6b-ac12-2ffb8e080871 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:17.856248 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884efc2-7e0f-4a6b-ac12-2ffb8e080871 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:29:17.856550 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884efc2-7e0f-4a6b-ac12-2ffb8e080871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:17.857927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884efc2-7e0f-4a6b-ac12-2ffb8e080871 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:17.866029 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 585/1157] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:29:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:17.872849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556cec7-985e-408d-b9f5-513fcabcf9fa None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:17.970939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556cec7-985e-408d-b9f5-513fcabcf9fa None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:18.004172 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6d9ea-e6e0-4064-9fd1-f72989b9c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:18.005019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d9ea-e6e0-4064-9fd1-f72989b9c2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:18.005294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d9ea-e6e0-4064-9fd1-f72989b9c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:18.005560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6d9ea-e6e0-4064-9fd1-f72989b9c2e6 None admin] PATH_INFO: `/v3/users/c232771b63d54d9dbd01a9dcfc1d87ba` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:18.006758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6d9ea-e6e0-4064-9fd1-f72989b9c2e6 None admin] RBAC: Authorizing `identity:get_user(user_id=c232771b63d54d9dbd01a9dcfc1d87ba)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:18.008177 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6d9ea-e6e0-4064-9fd1-f72989b9c2e6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:18.009780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 573/1158] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:29:17 2022] GET /identity/v3/users/c232771b63d54d9dbd01a9dcfc1d87ba => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:18.016139 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884efc2-7e0f-4a6b-ac12-2ffb8e080871 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:18.114649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884efc2-7e0f-4a6b-ac12-2ffb8e080871 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:18.143453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:18.149178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f81c7-a37c-4e6a-bd38-a1385cfee4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:18.149868 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f81c7-a37c-4e6a-bd38-a1385cfee4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:18.150157 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f81c7-a37c-4e6a-bd38-a1385cfee4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:18.150434 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f81c7-a37c-4e6a-bd38-a1385cfee4d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:18.217147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f81c7-a37c-4e6a-bd38-a1385cfee4d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:18.218617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f81c7-a37c-4e6a-bd38-a1385cfee4d3 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:18.317157 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 586/1159] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:29:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:29:18.323011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6d9ea-e6e0-4064-9fd1-f72989b9c2e6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:18.350936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:18.421941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6d9ea-e6e0-4064-9fd1-f72989b9c2e6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:18.455191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430b5f0f-5598-4d96-9c02-c1f09e4302bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:18.456052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b5f0f-5598-4d96-9c02-c1f09e4302bc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:18.456336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b5f0f-5598-4d96-9c02-c1f09e4302bc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:18.456615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430b5f0f-5598-4d96-9c02-c1f09e4302bc None admin] PATH_INFO: `/v3/projects/370edc8fc67d4d9daf322648d11be7ed` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:18.457813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b5f0f-5598-4d96-9c02-c1f09e4302bc None admin] RBAC: Authorizing `identity:get_project(project_id=370edc8fc67d4d9daf322648d11be7ed)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:18.459252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430b5f0f-5598-4d96-9c02-c1f09e4302bc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:18.460943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 574/1160] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:29:18 2022] GET /identity/v3/projects/370edc8fc67d4d9daf322648d11be7ed => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:29:18.467798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f81c7-a37c-4e6a-bd38-a1385cfee4d3 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:18.499656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:18.568200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f81c7-a37c-4e6a-bd38-a1385cfee4d3 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:18.601333 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a047d-2bbf-48ca-b0f2-eefadeed2cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:18.602011 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a047d-2bbf-48ca-b0f2-eefadeed2cdd None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:18.602290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a047d-2bbf-48ca-b0f2-eefadeed2cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:18.602564 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a047d-2bbf-48ca-b0f2-eefadeed2cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:18.603389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a047d-2bbf-48ca-b0f2-eefadeed2cdd None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=370edc8fc67d4d9daf322648d11be7ed, user.id=c232771b63d54d9dbd01a9dcfc1d87ba) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:29:18.603694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a047d-2bbf-48ca-b0f2-eefadeed2cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:18.605397 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a047d-2bbf-48ca-b0f2-eefadeed2cdd None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:18.612110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 587/1161] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:29:18 2022] GET /identity/v3/role_assignments?user.id=c232771b63d54d9dbd01a9dcfc1d87ba&scope.project.id=370edc8fc67d4d9daf322648d11be7ed&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:20.649358 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903ddcd-dd9e-4d42-a6e1-46c0211f770e None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:20.649950 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903ddcd-dd9e-4d42-a6e1-46c0211f770e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:20.649950 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903ddcd-dd9e-4d42-a6e1-46c0211f770e None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:20.651324 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 575/1162] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:29:20.656576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279b184-9fce-4b67-9f07-e8a589404e4f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:20.656980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279b184-9fce-4b67-9f07-e8a589404e4f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:20.657134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279b184-9fce-4b67-9f07-e8a589404e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:20.673976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0279b184-9fce-4b67-9f07-e8a589404e4f None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:29:20.675158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0279b184-9fce-4b67-9f07-e8a589404e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:29:20.739917 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 588/1163] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:29:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:29:20.762355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903ddcd-dd9e-4d42-a6e1-46c0211f770e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:20.856684 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:20.863219 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903ddcd-dd9e-4d42-a6e1-46c0211f770e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:20.896074 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6d3d8-d4a9-45c9-a982-572c7efa757e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:20.896722 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6d3d8-d4a9-45c9-a982-572c7efa757e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:20.897007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6d3d8-d4a9-45c9-a982-572c7efa757e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:20.897288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6d3d8-d4a9-45c9-a982-572c7efa757e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:20.962154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6d3d8-d4a9-45c9-a982-572c7efa757e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:20.963596 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6d3d8-d4a9-45c9-a982-572c7efa757e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:21.052713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:21.059334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 576/1164] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:29:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:29:21.065383 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279b184-9fce-4b67-9f07-e8a589404e4f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:21.090293 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:21.163547 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279b184-9fce-4b67-9f07-e8a589404e4f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:21.195562 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595be1c7-30f6-466e-adf9-6f9881086c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:21.196353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595be1c7-30f6-466e-adf9-6f9881086c21 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:21.196637 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595be1c7-30f6-466e-adf9-6f9881086c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:21.196911 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595be1c7-30f6-466e-adf9-6f9881086c21 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:21.203958 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595be1c7-30f6-466e-adf9-6f9881086c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:21.205392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595be1c7-30f6-466e-adf9-6f9881086c21 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-595be1c7-30f6-466e-adf9-6f9881086c21 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:29:21.219891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:29:21.221134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:29:21.222221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 589/1165] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Jul 20 22:29:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:29:21.227066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6d3d8-d4a9-45c9-a982-572c7efa757e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:21.328734 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6d3d8-d4a9-45c9-a982-572c7efa757e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:21.361891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec4f8f6-5ffd-4919-beb2-75c69de093d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:21.362544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4f8f6-5ffd-4919-beb2-75c69de093d9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:21.362822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4f8f6-5ffd-4919-beb2-75c69de093d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:21.363092 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec4f8f6-5ffd-4919-beb2-75c69de093d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:21.363803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4f8f6-5ffd-4919-beb2-75c69de093d9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:29:21.364108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4f8f6-5ffd-4919-beb2-75c69de093d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:21.365457 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec4f8f6-5ffd-4919-beb2-75c69de093d9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:21.372858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 577/1166] 10.222.0.83 () {56 vars in 1115 bytes} [Wed Jul 20 22:29:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:23.401621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a3cb-af0d-4703-b75d-85c0089fa216 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:23.402408 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a3cb-af0d-4703-b75d-85c0089fa216 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:23.402408 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64a3cb-af0d-4703-b75d-85c0089fa216 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:23.403934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 590/1167] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:29:23.409125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6c5e5-2802-4498-be53-0f4848c7bb80 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:23.409560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6c5e5-2802-4498-be53-0f4848c7bb80 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:23.409692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6c5e5-2802-4498-be53-0f4848c7bb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:23.426910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-abb6c5e5-2802-4498-be53-0f4848c7bb80 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:29:23.428132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-abb6c5e5-2802-4498-be53-0f4848c7bb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:29:23.484257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:23.495428 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 578/1168] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:29:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:29:23.519688 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a3cb-af0d-4703-b75d-85c0089fa216 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:23.607315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:23.623312 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64a3cb-af0d-4703-b75d-85c0089fa216 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:23.659245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79848b91-0cce-4c8d-a16f-a826afc873f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:23.659834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79848b91-0cce-4c8d-a16f-a826afc873f7 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:23.660118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79848b91-0cce-4c8d-a16f-a826afc873f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:23.660402 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79848b91-0cce-4c8d-a16f-a826afc873f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:23.661146 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79848b91-0cce-4c8d-a16f-a826afc873f7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:23.662543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79848b91-0cce-4c8d-a16f-a826afc873f7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:23.770981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 591/1169] 10.222.0.83 () {60 vars in 1138 bytes} [Wed Jul 20 22:29:23 2022] POST /identity/v3/domains => generated 267 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:29:25.826815 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c770ad-9508-4340-aee2-9e6444fbe265 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:25.827356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c770ad-9508-4340-aee2-9e6444fbe265 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:25.827356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c770ad-9508-4340-aee2-9e6444fbe265 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:25.828756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 579/1170] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:29:25.834107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c69e7c-6525-4c39-838d-5fbf6b768997 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:25.834514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c69e7c-6525-4c39-838d-5fbf6b768997 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:25.834660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c69e7c-6525-4c39-838d-5fbf6b768997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:25.851549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-22c69e7c-6525-4c39-838d-5fbf6b768997 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:29:25.852729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-22c69e7c-6525-4c39-838d-5fbf6b768997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:29:25.917153 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 592/1171] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:29:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:29:25.940504 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c770ad-9508-4340-aee2-9e6444fbe265 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:26.039619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c770ad-9508-4340-aee2-9e6444fbe265 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:26.072956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223ddcc-0acf-4f4c-a809-478e7224bb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:26.073844 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223ddcc-0acf-4f4c-a809-478e7224bb99 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:26.074786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223ddcc-0acf-4f4c-a809-478e7224bb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:26.075116 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223ddcc-0acf-4f4c-a809-478e7224bb99 None admin] PATH_INFO: `/v3/domains/82f2cfca8eed446882c826a659a3878c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:26.085485 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223ddcc-0acf-4f4c-a809-478e7224bb99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=82f2cfca8eed446882c826a659a3878c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:26.086988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223ddcc-0acf-4f4c-a809-478e7224bb99 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:26.088917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 580/1172] 10.222.0.83 () {56 vars in 1183 bytes} [Wed Jul 20 22:29:25 2022] GET /identity/v3/domains/82f2cfca8eed446882c826a659a3878c => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:26.095366 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c69e7c-6525-4c39-838d-5fbf6b768997 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:26.168090 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:26.194186 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c69e7c-6525-4c39-838d-5fbf6b768997 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:26.228987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a7c491-46e2-4660-8ae0-2b6752d1892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:26.229936 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7c491-46e2-4660-8ae0-2b6752d1892f None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:26.230310 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7c491-46e2-4660-8ae0-2b6752d1892f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:26.230591 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a7c491-46e2-4660-8ae0-2b6752d1892f None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:26.231313 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7c491-46e2-4660-8ae0-2b6752d1892f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:26.232783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a7c491-46e2-4660-8ae0-2b6752d1892f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:26.317157 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 593/1173] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 20 22:29:26 2022] POST /identity/v3/projects => generated 361 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:29:28.423425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8fbb6-b394-460d-9516-2904308686a7 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:28.423970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8fbb6-b394-460d-9516-2904308686a7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:28.423970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8fbb6-b394-460d-9516-2904308686a7 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:28.425356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 581/1174] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:29:28.430606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78aa8b-97d9-4a3d-b76b-a195699799a9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:28.431009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78aa8b-97d9-4a3d-b76b-a195699799a9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:28.431164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78aa8b-97d9-4a3d-b76b-a195699799a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:28.448612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-dd78aa8b-97d9-4a3d-b76b-a195699799a9 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:29:28.450057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dd78aa8b-97d9-4a3d-b76b-a195699799a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:29:28.516660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 594/1175] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:29:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:29:28.543721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8fbb6-b394-460d-9516-2904308686a7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:28.595136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:28.646805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8fbb6-b394-460d-9516-2904308686a7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:28.680606 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ade2d-ba82-4e37-bdfd-3f9ee7ca752d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:28.681393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ade2d-ba82-4e37-bdfd-3f9ee7ca752d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:28.681678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ade2d-ba82-4e37-bdfd-3f9ee7ca752d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:28.681990 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ade2d-ba82-4e37-bdfd-3f9ee7ca752d None admin] PATH_INFO: `/v3/domains/82f2cfca8eed446882c826a659a3878c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:28.683171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ade2d-ba82-4e37-bdfd-3f9ee7ca752d None admin] RBAC: Authorizing `identity:get_domain(domain_id=82f2cfca8eed446882c826a659a3878c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:28.684794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ade2d-ba82-4e37-bdfd-3f9ee7ca752d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:28.686451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 582/1176] 10.222.0.83 () {56 vars in 1183 bytes} [Wed Jul 20 22:29:28 2022] GET /identity/v3/domains/82f2cfca8eed446882c826a659a3878c => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:28.692408 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78aa8b-97d9-4a3d-b76b-a195699799a9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:28.746795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:28.789968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78aa8b-97d9-4a3d-b76b-a195699799a9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:28.825743 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df8fc8-80a3-469c-bb7a-0807f99bd9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:28.826428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df8fc8-80a3-469c-bb7a-0807f99bd9ab None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:28.826708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df8fc8-80a3-469c-bb7a-0807f99bd9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:28.826977 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df8fc8-80a3-469c-bb7a-0807f99bd9ab None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:28.827685 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df8fc8-80a3-469c-bb7a-0807f99bd9ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:28.829102 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df8fc8-80a3-469c-bb7a-0807f99bd9ab None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:28.915177 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 595/1177] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:29:28 2022] POST /identity/v3/users => generated 311 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:29:31.009048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e419a7-85fa-4ba2-aa0c-ae3f9581703f None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:31.009612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e419a7-85fa-4ba2-aa0c-ae3f9581703f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:31.009612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e419a7-85fa-4ba2-aa0c-ae3f9581703f None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:31.011008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 583/1178] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:29:31.016423 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacb8ff-a3be-400d-9223-f6a58cb3cfe5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:31.016844 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacb8ff-a3be-400d-9223-f6a58cb3cfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:31.016977 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aacb8ff-a3be-400d-9223-f6a58cb3cfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:31.035233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6aacb8ff-a3be-400d-9223-f6a58cb3cfe5 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:29:31.036415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6aacb8ff-a3be-400d-9223-f6a58cb3cfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:29:31.106154 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 596/1179] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:29:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:29:31.130135 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e419a7-85fa-4ba2-aa0c-ae3f9581703f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:31.231103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e419a7-85fa-4ba2-aa0c-ae3f9581703f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:31.248498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:31.264288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0c626-70b3-4203-a56a-f18e8cb4f8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:31.265029 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0c626-70b3-4203-a56a-f18e8cb4f8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:31.265307 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0c626-70b3-4203-a56a-f18e8cb4f8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:31.265591 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f0c626-70b3-4203-a56a-f18e8cb4f8a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:31.276036 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f0c626-70b3-4203-a56a-f18e8cb4f8a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-e3f0c626-70b3-4203-a56a-f18e8cb4f8a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:29:31.284506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:29:31.285738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:29:31.286782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:29:31.286782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:29:31.286782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:29:31.286782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:29:31.286782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:29:31.286782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:29:31.286782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:29:31.286782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:29:31.286782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:29:31.286782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:29:31.286782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:29:31.286782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:29:31.286782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 584/1180] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:29:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:29:31.292021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacb8ff-a3be-400d-9223-f6a58cb3cfe5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:31.335630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:31.392968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aacb8ff-a3be-400d-9223-f6a58cb3cfe5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:31.427707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275da75d-1396-4872-ac81-6281f8c53fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:31.428383 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275da75d-1396-4872-ac81-6281f8c53fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:31.428663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275da75d-1396-4872-ac81-6281f8c53fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:31.428934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275da75d-1396-4872-ac81-6281f8c53fd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:31.429899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275da75d-1396-4872-ac81-6281f8c53fd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:29:31.430211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275da75d-1396-4872-ac81-6281f8c53fd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:31.431572 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275da75d-1396-4872-ac81-6281f8c53fd5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:31.441094 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 597/1181] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:29:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:31.446935 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0c626-70b3-4203-a56a-f18e8cb4f8a3 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:31.545022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f0c626-70b3-4203-a56a-f18e8cb4f8a3 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:31.578832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c40cb-6741-4a80-9c39-da47f9fe32a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:31.579682 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c40cb-6741-4a80-9c39-da47f9fe32a9 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:31.579957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c40cb-6741-4a80-9c39-da47f9fe32a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:31.580228 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c40cb-6741-4a80-9c39-da47f9fe32a9 None admin] PATH_INFO: `/v3/users/9110eb153dfb49d8b6b1010d49a9f752` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:31.593926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c40cb-6741-4a80-9c39-da47f9fe32a9 None admin] RBAC: Authorizing `identity:get_user(user_id=9110eb153dfb49d8b6b1010d49a9f752)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:31.595367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c40cb-6741-4a80-9c39-da47f9fe32a9 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:31.597009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 585/1182] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:29:31 2022] GET /identity/v3/users/9110eb153dfb49d8b6b1010d49a9f752 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:29:31.602936 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275da75d-1396-4872-ac81-6281f8c53fd5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:31.760843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275da75d-1396-4872-ac81-6281f8c53fd5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:31.763927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:31.795554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaa569-f757-4c89-b0ae-d8a75dc021d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:31.796126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaa569-f757-4c89-b0ae-d8a75dc021d5 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:31.796478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaa569-f757-4c89-b0ae-d8a75dc021d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:31.796765 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddaa569-f757-4c89-b0ae-d8a75dc021d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:31.864237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaa569-f757-4c89-b0ae-d8a75dc021d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:31.865714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddaa569-f757-4c89-b0ae-d8a75dc021d5 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:31.960193 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 598/1183] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:29:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:29:31.966744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c40cb-6741-4a80-9c39-da47f9fe32a9 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:32.003434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:32.067575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c40cb-6741-4a80-9c39-da47f9fe32a9 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:32.102018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb8e2f-843a-4d1d-944c-44d7254bacb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:32.102874 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb8e2f-843a-4d1d-944c-44d7254bacb1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:32.103152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb8e2f-843a-4d1d-944c-44d7254bacb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:32.103422 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb8e2f-843a-4d1d-944c-44d7254bacb1 None admin] PATH_INFO: `/v3/projects/c538a971c88b46e182cc40be75584fd3` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:32.104836 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb8e2f-843a-4d1d-944c-44d7254bacb1 None admin] RBAC: Authorizing `identity:get_project(project_id=c538a971c88b46e182cc40be75584fd3)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:32.106876 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb8e2f-843a-4d1d-944c-44d7254bacb1 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:32.108550 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 586/1184] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:29:31 2022] GET /identity/v3/projects/c538a971c88b46e182cc40be75584fd3 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:32.114630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaa569-f757-4c89-b0ae-d8a75dc021d5 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:32.117669 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:32.211792 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddaa569-f757-4c89-b0ae-d8a75dc021d5 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:32.245235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48230ae-672c-4981-bb9f-973dcd4de00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:32.246530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48230ae-672c-4981-bb9f-973dcd4de00f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:32.247053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48230ae-672c-4981-bb9f-973dcd4de00f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:32.247053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48230ae-672c-4981-bb9f-973dcd4de00f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:32.248090 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48230ae-672c-4981-bb9f-973dcd4de00f None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=c538a971c88b46e182cc40be75584fd3, user.id=9110eb153dfb49d8b6b1010d49a9f752) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:29:32.248220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48230ae-672c-4981-bb9f-973dcd4de00f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:32.249542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48230ae-672c-4981-bb9f-973dcd4de00f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:32.255115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 599/1185] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:29:32 2022] GET /identity/v3/role_assignments?user.id=9110eb153dfb49d8b6b1010d49a9f752&scope.project.id=c538a971c88b46e182cc40be75584fd3&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:34.304502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721786af-3be7-47b5-9f13-b88f412868d3 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:34.305060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721786af-3be7-47b5-9f13-b88f412868d3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:34.305060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721786af-3be7-47b5-9f13-b88f412868d3 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:34.306460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 587/1186] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:29:34.311879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f627-29be-4af9-bfdf-a7b0a4e91a8c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:34.312294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f627-29be-4af9-bfdf-a7b0a4e91a8c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:34.312433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87f627-29be-4af9-bfdf-a7b0a4e91a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:34.329012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6c87f627-29be-4af9-bfdf-a7b0a4e91a8c None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:29:34.330235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6c87f627-29be-4af9-bfdf-a7b0a4e91a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:29:34.390731 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:34.395850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 600/1187] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:29:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:29:34.419870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721786af-3be7-47b5-9f13-b88f412868d3 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:34.519505 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721786af-3be7-47b5-9f13-b88f412868d3 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:34.521821 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:34.553048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f467f58-572a-4e74-be79-45347cd04986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:34.553865 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f467f58-572a-4e74-be79-45347cd04986 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:34.554151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f467f58-572a-4e74-be79-45347cd04986 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:34.554426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f467f58-572a-4e74-be79-45347cd04986 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:34.565026 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f467f58-572a-4e74-be79-45347cd04986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-3f467f58-572a-4e74-be79-45347cd04986 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:29:34.572602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:29:34.573712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:29:34.575917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:29:34.575917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:29:34.575917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:29:34.575917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:29:34.575917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:29:34.575917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:29:34.575917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:29:34.575917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:29:34.575917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:29:34.575917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:29:34.575917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:29:34.575917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:29:34.575917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 588/1188] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:29:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:29:34.580491 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87f627-29be-4af9-bfdf-a7b0a4e91a8c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:34.681883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87f627-29be-4af9-bfdf-a7b0a4e91a8c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:34.716759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41244b63-f012-4fff-92b0-2200da2dbb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:34.717453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41244b63-f012-4fff-92b0-2200da2dbb40 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:34.717749 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41244b63-f012-4fff-92b0-2200da2dbb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:34.718026 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41244b63-f012-4fff-92b0-2200da2dbb40 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:34.718770 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41244b63-f012-4fff-92b0-2200da2dbb40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:29:34.719076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41244b63-f012-4fff-92b0-2200da2dbb40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:34.720438 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41244b63-f012-4fff-92b0-2200da2dbb40 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:34.728431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 601/1189] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:29:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:34.735781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f467f58-572a-4e74-be79-45347cd04986 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:34.836722 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f467f58-572a-4e74-be79-45347cd04986 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:34.870536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaa325-798d-463a-b584-51d5689b5dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:34.871515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaa325-798d-463a-b584-51d5689b5dca None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:34.871802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaa325-798d-463a-b584-51d5689b5dca None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:34.872083 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaa325-798d-463a-b584-51d5689b5dca None admin] PATH_INFO: `/v3/users/9110eb153dfb49d8b6b1010d49a9f752` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:34.873295 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baaa325-798d-463a-b584-51d5689b5dca None admin] RBAC: Authorizing `identity:get_user(user_id=9110eb153dfb49d8b6b1010d49a9f752)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:34.874868 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baaa325-798d-463a-b584-51d5689b5dca None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:34.876517 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 589/1190] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:29:34 2022] GET /identity/v3/users/9110eb153dfb49d8b6b1010d49a9f752 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:34.882526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41244b63-f012-4fff-92b0-2200da2dbb40 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:34.942338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:34.984902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41244b63-f012-4fff-92b0-2200da2dbb40 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:35.017933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd697a9-ae99-4833-b259-4619e915882b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:35.018791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd697a9-ae99-4833-b259-4619e915882b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:35.019071 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd697a9-ae99-4833-b259-4619e915882b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:35.019350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd697a9-ae99-4833-b259-4619e915882b None admin] PATH_INFO: `/v3/projects/c538a971c88b46e182cc40be75584fd3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:35.020521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd697a9-ae99-4833-b259-4619e915882b None admin] RBAC: Authorizing `identity:get_project(project_id=c538a971c88b46e182cc40be75584fd3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:35.021971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd697a9-ae99-4833-b259-4619e915882b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:35.023667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 602/1191] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:29:34 2022] GET /identity/v3/projects/c538a971c88b46e182cc40be75584fd3 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:35.029641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaa325-798d-463a-b584-51d5689b5dca None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:35.060813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:35.128318 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaa325-798d-463a-b584-51d5689b5dca None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:35.160967 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a60dca-26ea-422d-90a1-77886f6d79ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:35.161922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a60dca-26ea-422d-90a1-77886f6d79ba None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:35.162211 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a60dca-26ea-422d-90a1-77886f6d79ba None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:35.162490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a60dca-26ea-422d-90a1-77886f6d79ba None admin] PATH_INFO: `/v3/projects/c538a971c88b46e182cc40be75584fd3/users/9110eb153dfb49d8b6b1010d49a9f752/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:35.164468 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a60dca-26ea-422d-90a1-77886f6d79ba None admin] RBAC: Authorizing `identity:create_grant(project_id=c538a971c88b46e182cc40be75584fd3, user_id=9110eb153dfb49d8b6b1010d49a9f752, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:35.165928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a60dca-26ea-422d-90a1-77886f6d79ba None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:35.238011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 590/1192] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:29:35 2022] PUT /identity/v3/projects/c538a971c88b46e182cc40be75584fd3/users/9110eb153dfb49d8b6b1010d49a9f752/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:29:37.239425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0ab2-ce2a-40df-8cb5-b27383173bce None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:37.240005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0ab2-ce2a-40df-8cb5-b27383173bce None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:37.240005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0ab2-ce2a-40df-8cb5-b27383173bce None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:37.241351 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 603/1193] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:29:37.247091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acbd21-6434-4158-923a-d5eed4eea2d0 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:37.247519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acbd21-6434-4158-923a-d5eed4eea2d0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:37.247654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acbd21-6434-4158-923a-d5eed4eea2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:37.264008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-66acbd21-6434-4158-923a-d5eed4eea2d0 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:29:37.265190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-66acbd21-6434-4158-923a-d5eed4eea2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:29:37.330177 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 591/1194] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:29:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:29:37.355819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e0ab2-ce2a-40df-8cb5-b27383173bce None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:37.454972 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e0ab2-ce2a-40df-8cb5-b27383173bce None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:37.480862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:37.488259 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470b019-1d59-461f-9aa1-a17b9239f8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:37.489046 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470b019-1d59-461f-9aa1-a17b9239f8ce None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:37.489327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470b019-1d59-461f-9aa1-a17b9239f8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:37.489601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470b019-1d59-461f-9aa1-a17b9239f8ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:37.499906 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470b019-1d59-461f-9aa1-a17b9239f8ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1470b019-1d59-461f-9aa1-a17b9239f8ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:29:37.507437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:29:37.508585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:29:37.509854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:29:37.509854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:29:37.509854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:29:37.509854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:29:37.509854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:29:37.509854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:29:37.509854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:29:37.509854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:29:37.509854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:29:37.509854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:29:37.509854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:29:37.509854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:29:37.509854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 604/1195] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:29:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 22:29:37.514979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acbd21-6434-4158-923a-d5eed4eea2d0 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:37.538786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:37.613864 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acbd21-6434-4158-923a-d5eed4eea2d0 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:37.647715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fc7bf-43ad-4cfa-9375-3960bf2a53b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:37.648377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fc7bf-43ad-4cfa-9375-3960bf2a53b4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:37.648662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fc7bf-43ad-4cfa-9375-3960bf2a53b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:37.648939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fc7bf-43ad-4cfa-9375-3960bf2a53b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:37.649690 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fc7bf-43ad-4cfa-9375-3960bf2a53b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:29:37.650243 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fc7bf-43ad-4cfa-9375-3960bf2a53b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:37.651494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fc7bf-43ad-4cfa-9375-3960bf2a53b4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:37.660105 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 592/1196] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:29:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:29:37.666143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470b019-1d59-461f-9aa1-a17b9239f8ce None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:37.763470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470b019-1d59-461f-9aa1-a17b9239f8ce None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:37.796740 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f5356-2d2f-47f4-a9d9-c68904c95ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:37.797610 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f5356-2d2f-47f4-a9d9-c68904c95ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:37.797927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f5356-2d2f-47f4-a9d9-c68904c95ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:37.798204 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f5356-2d2f-47f4-a9d9-c68904c95ac7 None admin] PATH_INFO: `/v3/users/9110eb153dfb49d8b6b1010d49a9f752` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:37.799386 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f5356-2d2f-47f4-a9d9-c68904c95ac7 None admin] RBAC: Authorizing `identity:get_user(user_id=9110eb153dfb49d8b6b1010d49a9f752)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:37.800816 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5f5356-2d2f-47f4-a9d9-c68904c95ac7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:37.802485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 605/1197] 10.222.0.83 () {56 vars in 1177 bytes} [Wed Jul 20 22:29:37 2022] GET /identity/v3/users/9110eb153dfb49d8b6b1010d49a9f752 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:37.808696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fc7bf-43ad-4cfa-9375-3960bf2a53b4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:37.894795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:37.911205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fc7bf-43ad-4cfa-9375-3960bf2a53b4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:37.944008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe677f-a077-49f4-b009-8c96fc0e9eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:37.944654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe677f-a077-49f4-b009-8c96fc0e9eac None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:37.944939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe677f-a077-49f4-b009-8c96fc0e9eac None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:37.945216 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe677f-a077-49f4-b009-8c96fc0e9eac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:38.010940 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe677f-a077-49f4-b009-8c96fc0e9eac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:38.012972 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe677f-a077-49f4-b009-8c96fc0e9eac None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:38.094372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:38.110524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 593/1198] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:29:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:29:38.116523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f5356-2d2f-47f4-a9d9-c68904c95ac7 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:38.171921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:38.215117 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f5356-2d2f-47f4-a9d9-c68904c95ac7 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:38.248696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd3275-af49-4a94-8e72-03f160c7c03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:38.249557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3275-af49-4a94-8e72-03f160c7c03f None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:38.249875 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3275-af49-4a94-8e72-03f160c7c03f None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:38.250155 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd3275-af49-4a94-8e72-03f160c7c03f None admin] PATH_INFO: `/v3/projects/c538a971c88b46e182cc40be75584fd3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:38.251335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd3275-af49-4a94-8e72-03f160c7c03f None admin] RBAC: Authorizing `identity:get_project(project_id=c538a971c88b46e182cc40be75584fd3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:38.252758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd3275-af49-4a94-8e72-03f160c7c03f None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:38.254496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 606/1199] 10.222.0.83 () {56 vars in 1186 bytes} [Wed Jul 20 22:29:38 2022] GET /identity/v3/projects/c538a971c88b46e182cc40be75584fd3 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:38.260631 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe677f-a077-49f4-b009-8c96fc0e9eac None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:29:38.357281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe677f-a077-49f4-b009-8c96fc0e9eac None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:29:38.390906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8022e0-1ff2-41e7-9cd3-ce71db2d732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:29:38.391555 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8022e0-1ff2-41e7-9cd3-ce71db2d732d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:29:38.391840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8022e0-1ff2-41e7-9cd3-ce71db2d732d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:29:38.392117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8022e0-1ff2-41e7-9cd3-ce71db2d732d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:29:38.392951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8022e0-1ff2-41e7-9cd3-ce71db2d732d None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=c538a971c88b46e182cc40be75584fd3, user.id=9110eb153dfb49d8b6b1010d49a9f752) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:29:38.393262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8022e0-1ff2-41e7-9cd3-ce71db2d732d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:29:38.394719 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8022e0-1ff2-41e7-9cd3-ce71db2d732d None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:29:38.400323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 594/1200] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:29:38 2022] GET /identity/v3/role_assignments?user.id=9110eb153dfb49d8b6b1010d49a9f752&scope.project.id=c538a971c88b46e182cc40be75584fd3&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:29:48.243857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=38 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:29:48.397808 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=76 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:30:58.612586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b561d43-eb27-4245-853b-745f3372f6a9 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:30:58.613248 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b561d43-eb27-4245-853b-745f3372f6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:30:58.613248 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b561d43-eb27-4245-853b-745f3372f6a9 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:30:58.614558 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 607/1201] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:30:58.619682 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b33be0-7cba-4730-9c9b-4cb70c1da6ff None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:30:58.620090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b33be0-7cba-4730-9c9b-4cb70c1da6ff None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:30:58.620250 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b33be0-7cba-4730-9c9b-4cb70c1da6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:30:58.638222 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e9b33be0-7cba-4730-9c9b-4cb70c1da6ff None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:30:58.639411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e9b33be0-7cba-4730-9c9b-4cb70c1da6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:30:58.712425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 595/1202] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:30:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:30:58.738747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b561d43-eb27-4245-853b-745f3372f6a9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:30:58.844489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b561d43-eb27-4245-853b-745f3372f6a9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:30:58.879679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb0665-4ce1-4a02-ba20-0022d75b867b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:30:58.880400 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb0665-4ce1-4a02-ba20-0022d75b867b None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:30:58.880685 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb0665-4ce1-4a02-ba20-0022d75b867b None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:30:58.880961 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb0665-4ce1-4a02-ba20-0022d75b867b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:30:58.891578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb0665-4ce1-4a02-ba20-0022d75b867b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:30:58.893027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb0665-4ce1-4a02-ba20-0022d75b867b None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-47eb0665-4ce1-4a02-ba20-0022d75b867b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:30:58.911282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:30:58.912497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:30:58.913908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:30:58.913908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:30:58.913908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:30:58.913908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:30:58.913908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 608/1203] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:30:58.918981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b33be0-7cba-4730-9c9b-4cb70c1da6ff None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:30:59.025043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b33be0-7cba-4730-9c9b-4cb70c1da6ff None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:30:59.053293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:30:59.058736 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5675df-c223-41d0-8230-f85b2719f9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:30:59.060099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5675df-c223-41d0-8230-f85b2719f9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:30:59.060386 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5675df-c223-41d0-8230-f85b2719f9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:30:59.060662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5675df-c223-41d0-8230-f85b2719f9b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:30:59.061380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5675df-c223-41d0-8230-f85b2719f9b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:30:59.061689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5675df-c223-41d0-8230-f85b2719f9b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:30:59.063089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5675df-c223-41d0-8230-f85b2719f9b2 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:30:59.074255 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 596/1204] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:30:59.080576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb0665-4ce1-4a02-ba20-0022d75b867b None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:30:59.140384 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:30:59.186105 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb0665-4ce1-4a02-ba20-0022d75b867b None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:30:59.228342 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf87b0-dca0-4725-9c7e-83d6f0cf8d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:30:59.229044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf87b0-dca0-4725-9c7e-83d6f0cf8d54 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:30:59.229334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf87b0-dca0-4725-9c7e-83d6f0cf8d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:30:59.229628 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf87b0-dca0-4725-9c7e-83d6f0cf8d54 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:30:59.230385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf87b0-dca0-4725-9c7e-83d6f0cf8d54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:30:59.232004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf87b0-dca0-4725-9c7e-83d6f0cf8d54 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:30:59.330100 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 609/1205] 10.222.0.83 () {60 vars in 1132 bytes} [Wed Jul 20 22:30:59 2022] POST /identity/v3/users => generated 251 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:31:01.436074 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0967b-ea3d-4aff-bdde-cec3ffcf4729 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:01.436840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0967b-ea3d-4aff-bdde-cec3ffcf4729 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:01.436840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f0967b-ea3d-4aff-bdde-cec3ffcf4729 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:01.438080 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 597/1206] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:31:01.443248 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9df20-8f29-49e8-9f9d-6b529c8355fb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:01.443649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9df20-8f29-49e8-9f9d-6b529c8355fb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:01.443808 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9df20-8f29-49e8-9f9d-6b529c8355fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:01.460676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1dc9df20-8f29-49e8-9f9d-6b529c8355fb None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:31:01.461905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1dc9df20-8f29-49e8-9f9d-6b529c8355fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:31:01.531416 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 610/1207] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:31:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:31:01.555188 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0967b-ea3d-4aff-bdde-cec3ffcf4729 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:01.660307 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f0967b-ea3d-4aff-bdde-cec3ffcf4729 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:01.700622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb4f6a-9625-4a31-b070-aee43caf5ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:01.700622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb4f6a-9625-4a31-b070-aee43caf5ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:01.700622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb4f6a-9625-4a31-b070-aee43caf5ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:01.700622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb4f6a-9625-4a31-b070-aee43caf5ea6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:01.706546 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb4f6a-9625-4a31-b070-aee43caf5ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-3efb4f6a-9625-4a31-b070-aee43caf5ea6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:31:01.714195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:01.715350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:01.716930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:01.716930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:01.716930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:01.716930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:01.716930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:31:01.716930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:31:01.716930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:31:01.716930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:31:01.716930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:31:01.716930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:31:01.716930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:31:01.716930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:01.716930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 598/1208] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:31:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:01.722433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9df20-8f29-49e8-9f9d-6b529c8355fb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:01.760492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:01.821490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9df20-8f29-49e8-9f9d-6b529c8355fb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:01.856675 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3f16-745c-4992-9301-70882d352b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:01.857435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3f16-745c-4992-9301-70882d352b91 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:01.857663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3f16-745c-4992-9301-70882d352b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:01.857971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b3f16-745c-4992-9301-70882d352b91 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:01.859002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b3f16-745c-4992-9301-70882d352b91 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:01.859314 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b3f16-745c-4992-9301-70882d352b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:01.860740 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b3f16-745c-4992-9301-70882d352b91 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:01.869358 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 611/1209] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:31:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:01.876595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb4f6a-9625-4a31-b070-aee43caf5ea6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:01.929457 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:01.980516 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb4f6a-9625-4a31-b070-aee43caf5ea6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:02.016301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5a02e-3cb2-4bcd-b2f6-161b4f809606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:02.017129 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5a02e-3cb2-4bcd-b2f6-161b4f809606 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:02.017418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5a02e-3cb2-4bcd-b2f6-161b4f809606 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:02.017699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc5a02e-3cb2-4bcd-b2f6-161b4f809606 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:02.028551 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5a02e-3cb2-4bcd-b2f6-161b4f809606 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:02.030072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc5a02e-3cb2-4bcd-b2f6-161b4f809606 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-efc5a02e-3cb2-4bcd-b2f6-161b4f809606 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:31:02.048701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:02.049871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:02.051069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:31:02.051069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:31:02.051069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:02.051069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:02.051069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 599/1210] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:02.056203 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3f16-745c-4992-9301-70882d352b91 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:02.158748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:02.161651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b3f16-745c-4992-9301-70882d352b91 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:02.195017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d02b0-1644-4982-810e-e8642761a2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:02.195686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d02b0-1644-4982-810e-e8642761a2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:02.195970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d02b0-1644-4982-810e-e8642761a2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:02.196247 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d02b0-1644-4982-810e-e8642761a2b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:02.197026 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d02b0-1644-4982-810e-e8642761a2b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:02.197336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d02b0-1644-4982-810e-e8642761a2b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:02.198735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d02b0-1644-4982-810e-e8642761a2b8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:02.210096 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 612/1211] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:02.216701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5a02e-3cb2-4bcd-b2f6-161b4f809606 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:02.317687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc5a02e-3cb2-4bcd-b2f6-161b4f809606 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:02.319240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:02.352118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046a7bd-1701-4ce3-9c27-f449cd83b8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:02.352967 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046a7bd-1701-4ce3-9c27-f449cd83b8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:02.353256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046a7bd-1701-4ce3-9c27-f449cd83b8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:02.353536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046a7bd-1701-4ce3-9c27-f449cd83b8d3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:02.361109 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046a7bd-1701-4ce3-9c27-f449cd83b8d3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:02.362667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046a7bd-1701-4ce3-9c27-f449cd83b8d3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-1046a7bd-1701-4ce3-9c27-f449cd83b8d3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:31:02.378803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:02.379837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:02.380905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:02.380905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:02.380905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:31:02.380905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:31:02.380905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:31:02.380905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:31:02.380905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:31:02.380905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:31:02.380905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 22:31:02.380905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:02.380905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 600/1212] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:02.385926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d02b0-1644-4982-810e-e8642761a2b8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:02.484391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d02b0-1644-4982-810e-e8642761a2b8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:02.518365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d13191-ecf2-4e6b-b21d-d3400fadae4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:02.519038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d13191-ecf2-4e6b-b21d-d3400fadae4c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:02.519330 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d13191-ecf2-4e6b-b21d-d3400fadae4c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:02.519606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d13191-ecf2-4e6b-b21d-d3400fadae4c None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:02.520446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d13191-ecf2-4e6b-b21d-d3400fadae4c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:02.520757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d13191-ecf2-4e6b-b21d-d3400fadae4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:02.522244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d13191-ecf2-4e6b-b21d-d3400fadae4c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:02.539450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 613/1213] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Jul 20 22:31:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:02.545904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046a7bd-1701-4ce3-9c27-f449cd83b8d3 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:02.645503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046a7bd-1701-4ce3-9c27-f449cd83b8d3 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:02.679528 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ed291-5dea-4e74-b32a-65f15fb56a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:02.680183 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed291-5dea-4e74-b32a-65f15fb56a02 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:02.680469 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed291-5dea-4e74-b32a-65f15fb56a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:02.680747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ed291-5dea-4e74-b32a-65f15fb56a02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:02.712051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:02.751617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ed291-5dea-4e74-b32a-65f15fb56a02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:02.753116 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ed291-5dea-4e74-b32a-65f15fb56a02 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:02.849109 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 601/1214] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:31:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:31:02.855044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d13191-ecf2-4e6b-b21d-d3400fadae4c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:02.875268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:02.956863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d13191-ecf2-4e6b-b21d-d3400fadae4c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:02.991237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf25ea-fcd2-4866-8be4-3139299747c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:02.992069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf25ea-fcd2-4866-8be4-3139299747c4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:02.992547 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf25ea-fcd2-4866-8be4-3139299747c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:02.993017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcf25ea-fcd2-4866-8be4-3139299747c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:03.004252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf25ea-fcd2-4866-8be4-3139299747c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:03.008452 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcf25ea-fcd2-4866-8be4-3139299747c4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-cbcf25ea-fcd2-4866-8be4-3139299747c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:31:03.023349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:03.024461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:03.025422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:31:03.025422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:31:03.025422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:03.025422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:03.025422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 614/1215] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:03.031588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ed291-5dea-4e74-b32a-65f15fb56a02 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:03.093670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:03.131577 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ed291-5dea-4e74-b32a-65f15fb56a02 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:03.166825 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10b9b3-18fd-4080-901b-1bf388f9cb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:03.167069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10b9b3-18fd-4080-901b-1bf388f9cb90 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:03.167283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10b9b3-18fd-4080-901b-1bf388f9cb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:03.167561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10b9b3-18fd-4080-901b-1bf388f9cb90 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:03.168308 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10b9b3-18fd-4080-901b-1bf388f9cb90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:03.168643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10b9b3-18fd-4080-901b-1bf388f9cb90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:03.170047 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10b9b3-18fd-4080-901b-1bf388f9cb90 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:03.181738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 602/1216] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:03.187739 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf25ea-fcd2-4866-8be4-3139299747c4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:03.257921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:03.289805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcf25ea-fcd2-4866-8be4-3139299747c4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:03.325258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214ca7f-08ef-4dec-8068-e3dcddb7844c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:03.326142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214ca7f-08ef-4dec-8068-e3dcddb7844c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:03.326419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214ca7f-08ef-4dec-8068-e3dcddb7844c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:03.326750 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214ca7f-08ef-4dec-8068-e3dcddb7844c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:03.333618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214ca7f-08ef-4dec-8068-e3dcddb7844c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:03.335100 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214ca7f-08ef-4dec-8068-e3dcddb7844c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-4214ca7f-08ef-4dec-8068-e3dcddb7844c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:31:03.349194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:03.350326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:03.351477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:31:03.351477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:31:03.351477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:31:03.351477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:31:03.351477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:31:03.351477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:31:03.351477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:31:03.351477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:03.351477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 615/1217] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:31:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:03.356632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10b9b3-18fd-4080-901b-1bf388f9cb90 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:03.460240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10b9b3-18fd-4080-901b-1bf388f9cb90 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:03.482663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:03.494228 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d8e65-6eae-423d-a930-08cf5e7291d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:03.494894 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d8e65-6eae-423d-a930-08cf5e7291d0 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:03.495174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d8e65-6eae-423d-a930-08cf5e7291d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:03.495448 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d8e65-6eae-423d-a930-08cf5e7291d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:03.496233 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d8e65-6eae-423d-a930-08cf5e7291d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:03.496569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d8e65-6eae-423d-a930-08cf5e7291d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:03.499166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d8e65-6eae-423d-a930-08cf5e7291d0 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:03.510979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 603/1218] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:31:03.517504 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214ca7f-08ef-4dec-8068-e3dcddb7844c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:03.619449 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214ca7f-08ef-4dec-8068-e3dcddb7844c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:03.647415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:03.653882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e70966-0d3f-4c12-8b21-119b8b1e3516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:03.654571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70966-0d3f-4c12-8b21-119b8b1e3516 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:03.654858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70966-0d3f-4c12-8b21-119b8b1e3516 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:03.655138 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e70966-0d3f-4c12-8b21-119b8b1e3516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:03.655973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e70966-0d3f-4c12-8b21-119b8b1e3516 None admin] RBAC: Adding query filter params (role.id=2a5f2a34d0b341e58b642fc48dc7c5da, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=65c9898ccf874dce88f08bebdbae02d4) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:03.656290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e70966-0d3f-4c12-8b21-119b8b1e3516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:03.657853 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e70966-0d3f-4c12-8b21-119b8b1e3516 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:03.663418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 616/1219] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:31:03 2022] GET /identity/v3/role_assignments?user.id=65c9898ccf874dce88f08bebdbae02d4&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=2a5f2a34d0b341e58b642fc48dc7c5da => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:05.720967 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006761c9-1946-4001-a93f-401eabd349e9 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:05.721593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006761c9-1946-4001-a93f-401eabd349e9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:05.721593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006761c9-1946-4001-a93f-401eabd349e9 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:05.723250 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 604/1220] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:31:05.728771 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4d0ac-ebe4-4882-b7e9-fd94dfb67803 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:05.729197 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4d0ac-ebe4-4882-b7e9-fd94dfb67803 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:05.729329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4d0ac-ebe4-4882-b7e9-fd94dfb67803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:05.747590 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c0e4d0ac-ebe4-4882-b7e9-fd94dfb67803 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:31:05.748778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c0e4d0ac-ebe4-4882-b7e9-fd94dfb67803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:31:05.814722 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 617/1221] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:31:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:31:05.837514 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006761c9-1946-4001-a93f-401eabd349e9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:05.939036 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006761c9-1946-4001-a93f-401eabd349e9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:05.973058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2b72-7190-4479-88bc-1beb74f2487b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:05.973863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2b72-7190-4479-88bc-1beb74f2487b None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:05.974148 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2b72-7190-4479-88bc-1beb74f2487b None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:05.974425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c2b72-7190-4479-88bc-1beb74f2487b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:05.985339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461c2b72-7190-4479-88bc-1beb74f2487b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-461c2b72-7190-4479-88bc-1beb74f2487b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:31:05.993051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:05.995028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:05.995938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:05.995938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:05.995938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:05.995938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:05.995938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:31:05.995938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:31:05.995938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:31:05.995938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:31:05.995938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:31:05.995938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:31:05.995938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:31:05.995938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:05.995938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 605/1222] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:31:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:06.000616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4d0ac-ebe4-4882-b7e9-fd94dfb67803 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:06.100668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4d0ac-ebe4-4882-b7e9-fd94dfb67803 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:06.124728 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:06.135040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8c3a2-83ed-4cc2-97d3-f2f9ecd2f491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:06.135693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8c3a2-83ed-4cc2-97d3-f2f9ecd2f491 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:06.135976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8c3a2-83ed-4cc2-97d3-f2f9ecd2f491 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:06.136254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8c3a2-83ed-4cc2-97d3-f2f9ecd2f491 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:06.137012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8c3a2-83ed-4cc2-97d3-f2f9ecd2f491 None admin] RBAC: Adding query filter params (name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:06.138145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8c3a2-83ed-4cc2-97d3-f2f9ecd2f491 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:06.139561 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8c3a2-83ed-4cc2-97d3-f2f9ecd2f491 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:06.147716 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 618/1223] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:31:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:31:06.154653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2b72-7190-4479-88bc-1beb74f2487b None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:06.200892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:06.257580 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c2b72-7190-4479-88bc-1beb74f2487b None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:06.292121 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd3709-90c7-4a9c-bfff-5da14505f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:06.292907 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3709-90c7-4a9c-bfff-5da14505f88f None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:06.293190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3709-90c7-4a9c-bfff-5da14505f88f None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:06.293494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3709-90c7-4a9c-bfff-5da14505f88f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:06.304910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd3709-90c7-4a9c-bfff-5da14505f88f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:06.306467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd3709-90c7-4a9c-bfff-5da14505f88f None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-c2fd3709-90c7-4a9c-bfff-5da14505f88f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:31:06.325280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:06.326405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:06.327687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:31:06.327687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:31:06.327687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:06.327687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:06.327687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 606/1224] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:06.332750 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8c3a2-83ed-4cc2-97d3-f2f9ecd2f491 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:06.437948 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8c3a2-83ed-4cc2-97d3-f2f9ecd2f491 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:06.471982 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e112936-45d0-4e31-b280-a8ac63589699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:06.472646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112936-45d0-4e31-b280-a8ac63589699 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:06.472934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112936-45d0-4e31-b280-a8ac63589699 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:06.473212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e112936-45d0-4e31-b280-a8ac63589699 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:06.473968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e112936-45d0-4e31-b280-a8ac63589699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:06.474283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e112936-45d0-4e31-b280-a8ac63589699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:06.475646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e112936-45d0-4e31-b280-a8ac63589699 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:06.487842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 619/1225] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:06.493817 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd3709-90c7-4a9c-bfff-5da14505f88f None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:06.588892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:06.596015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd3709-90c7-4a9c-bfff-5da14505f88f None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:06.629914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68650048-45ae-4e49-baf2-2039e9cc3ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:06.630721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68650048-45ae-4e49-baf2-2039e9cc3ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:06.631005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68650048-45ae-4e49-baf2-2039e9cc3ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:06.631347 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68650048-45ae-4e49-baf2-2039e9cc3ca1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:06.639254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68650048-45ae-4e49-baf2-2039e9cc3ca1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:06.640711 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68650048-45ae-4e49-baf2-2039e9cc3ca1 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-68650048-45ae-4e49-baf2-2039e9cc3ca1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:31:06.655745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:06.656802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:06.657875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:06.657875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:06.657875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:31:06.657875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:31:06.657875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:31:06.657875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:31:06.657875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:31:06.657875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:31:06.657875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 22:31:06.657875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:06.661869 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 607/1226] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:06.663249 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e112936-45d0-4e31-b280-a8ac63589699 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:06.711165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:06.765202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e112936-45d0-4e31-b280-a8ac63589699 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:06.800740 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2b655-478f-421d-8bb2-38e0f15ea4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:06.801411 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2b655-478f-421d-8bb2-38e0f15ea4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:06.801697 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2b655-478f-421d-8bb2-38e0f15ea4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:06.802021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2b655-478f-421d-8bb2-38e0f15ea4e1 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:06.802858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2b655-478f-421d-8bb2-38e0f15ea4e1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:06.803214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2b655-478f-421d-8bb2-38e0f15ea4e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:06.804650 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2b655-478f-421d-8bb2-38e0f15ea4e1 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:06.823125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 620/1227] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Jul 20 22:31:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:06.830781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68650048-45ae-4e49-baf2-2039e9cc3ca1 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:06.932530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68650048-45ae-4e49-baf2-2039e9cc3ca1 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:06.966938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4d958-39e5-4cf9-84f5-e8ada635fadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:06.967729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4d958-39e5-4cf9-84f5-e8ada635fadc None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:06.968010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4d958-39e5-4cf9-84f5-e8ada635fadc None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:06.968287 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4d958-39e5-4cf9-84f5-e8ada635fadc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:06.978769 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4d958-39e5-4cf9-84f5-e8ada635fadc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:06.980217 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4d958-39e5-4cf9-84f5-e8ada635fadc None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-1bc4d958-39e5-4cf9-84f5-e8ada635fadc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:31:06.998434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:06.999540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:07.000560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:31:07.000560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:31:07.000560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:07.000560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:07.000560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 608/1228] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:07.005591 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2b655-478f-421d-8bb2-38e0f15ea4e1 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:07.107721 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2b655-478f-421d-8bb2-38e0f15ea4e1 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:07.110279 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:07.142914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631cee3-7fed-4593-837f-3cfee28ee54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:07.143577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631cee3-7fed-4593-837f-3cfee28ee54c None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:07.143862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631cee3-7fed-4593-837f-3cfee28ee54c None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:07.144134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631cee3-7fed-4593-837f-3cfee28ee54c None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:07.144852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631cee3-7fed-4593-837f-3cfee28ee54c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:07.145155 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631cee3-7fed-4593-837f-3cfee28ee54c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:07.146687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631cee3-7fed-4593-837f-3cfee28ee54c None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:07.158869 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 621/1229] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:07.164621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4d958-39e5-4cf9-84f5-e8ada635fadc None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:07.174030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:07.266017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4d958-39e5-4cf9-84f5-e8ada635fadc None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:07.298572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a0493-027f-40b4-be89-91f65092d1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:07.299371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a0493-027f-40b4-be89-91f65092d1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:07.299658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a0493-027f-40b4-be89-91f65092d1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:07.299938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a0493-027f-40b4-be89-91f65092d1d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:07.306567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a0493-027f-40b4-be89-91f65092d1d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:07.308015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a0493-027f-40b4-be89-91f65092d1d6 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-253a0493-027f-40b4-be89-91f65092d1d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:31:07.323725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:07.324829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:07.325884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:31:07.325884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:31:07.325884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:31:07.325884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:31:07.325884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:31:07.325884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:31:07.325884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:31:07.325884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:07.325884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 609/1230] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:31:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:07.331594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631cee3-7fed-4593-837f-3cfee28ee54c None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:07.433498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631cee3-7fed-4593-837f-3cfee28ee54c None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:07.469541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64694fc7-03ca-41cc-b423-16a1779857bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:07.470232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64694fc7-03ca-41cc-b423-16a1779857bf None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:07.470516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64694fc7-03ca-41cc-b423-16a1779857bf None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:07.470798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64694fc7-03ca-41cc-b423-16a1779857bf None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:07.471577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64694fc7-03ca-41cc-b423-16a1779857bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:07.471885 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64694fc7-03ca-41cc-b423-16a1779857bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:07.473297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64694fc7-03ca-41cc-b423-16a1779857bf None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:07.485982 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 622/1231] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:31:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:07.492044 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a0493-027f-40b4-be89-91f65092d1d6 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:07.557420 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:07.591664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a0493-027f-40b4-be89-91f65092d1d6 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:07.627218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8f320-ef4f-4557-a078-debc5b8453d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:07.628280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8f320-ef4f-4557-a078-debc5b8453d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:07.628568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8f320-ef4f-4557-a078-debc5b8453d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:07.628848 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8f320-ef4f-4557-a078-debc5b8453d4 None admin] PATH_INFO: `/v3/projects/8cec07c864274d649ecd1944be870bd5/users/65c9898ccf874dce88f08bebdbae02d4/roles/2a5f2a34d0b341e58b642fc48dc7c5da` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:07.644587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8f320-ef4f-4557-a078-debc5b8453d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cec07c864274d649ecd1944be870bd5, user_id=65c9898ccf874dce88f08bebdbae02d4, role_id=2a5f2a34d0b341e58b642fc48dc7c5da)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:07.646066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8f320-ef4f-4557-a078-debc5b8453d4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:07.740150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 610/1232] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:31:07 2022] PUT /identity/v3/projects/8cec07c864274d649ecd1944be870bd5/users/65c9898ccf874dce88f08bebdbae02d4/roles/2a5f2a34d0b341e58b642fc48dc7c5da => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:31:09.771624 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df525dad-78eb-4b78-a6bb-3997a85be91a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:09.772201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df525dad-78eb-4b78-a6bb-3997a85be91a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:09.772308 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df525dad-78eb-4b78-a6bb-3997a85be91a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:09.773617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 623/1233] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:31:09.779339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a527a-2a8e-4890-affc-f54e0a5ed3b7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:09.779786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a527a-2a8e-4890-affc-f54e0a5ed3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:09.779893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a527a-2a8e-4890-affc-f54e0a5ed3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:09.796481 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3f8a527a-2a8e-4890-affc-f54e0a5ed3b7 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:31:09.797689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3f8a527a-2a8e-4890-affc-f54e0a5ed3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:31:09.864387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 611/1234] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:31:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:31:09.888214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df525dad-78eb-4b78-a6bb-3997a85be91a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:09.913613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:09.991471 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df525dad-78eb-4b78-a6bb-3997a85be91a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:10.025880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e28a9-8851-4ba9-a193-866e70c0e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:10.026613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e28a9-8851-4ba9-a193-866e70c0e51d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:10.026904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e28a9-8851-4ba9-a193-866e70c0e51d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:10.027180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e28a9-8851-4ba9-a193-866e70c0e51d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:10.037410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e28a9-8851-4ba9-a193-866e70c0e51d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-667e28a9-8851-4ba9-a193-866e70c0e51d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:31:10.045714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:10.046893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:10.052897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:10.052897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:10.052897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:10.052897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:10.052897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:31:10.052897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:31:10.052897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:31:10.052897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:31:10.052897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:31:10.052897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:31:10.052897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 22:31:10.052897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:10.052897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 624/1235] 10.222.0.83 () {56 vars in 1102 bytes} [Wed Jul 20 22:31:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:10.053820 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a527a-2a8e-4890-affc-f54e0a5ed3b7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:10.105551 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:10.157839 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a527a-2a8e-4890-affc-f54e0a5ed3b7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:10.192739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b803e4-975e-450d-b8f0-9865828e0920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:10.193414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b803e4-975e-450d-b8f0-9865828e0920 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:10.193697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b803e4-975e-450d-b8f0-9865828e0920 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:10.194008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b803e4-975e-450d-b8f0-9865828e0920 None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:10.194756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b803e4-975e-450d-b8f0-9865828e0920 None admin] RBAC: Adding query filter params (name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:10.195066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b803e4-975e-450d-b8f0-9865828e0920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:10.196432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b803e4-975e-450d-b8f0-9865828e0920 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:10.205598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 612/1236] 10.222.0.83 () {56 vars in 1103 bytes} [Wed Jul 20 22:31:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:10.211677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e28a9-8851-4ba9-a193-866e70c0e51d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:10.299286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:10.326288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e28a9-8851-4ba9-a193-866e70c0e51d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:10.367008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def36ca7-2f05-49da-ae8d-64b9d847d847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:10.367814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def36ca7-2f05-49da-ae8d-64b9d847d847 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:10.368099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def36ca7-2f05-49da-ae8d-64b9d847d847 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:10.368375 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def36ca7-2f05-49da-ae8d-64b9d847d847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:10.379048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def36ca7-2f05-49da-ae8d-64b9d847d847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:10.380506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def36ca7-2f05-49da-ae8d-64b9d847d847 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-def36ca7-2f05-49da-ae8d-64b9d847d847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:31:10.399353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:10.400404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:10.401329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:31:10.401329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:31:10.401329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:10.401329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:10.401329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 625/1237] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:10.406721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b803e4-975e-450d-b8f0-9865828e0920 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:10.513154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b803e4-975e-450d-b8f0-9865828e0920 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:10.522293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:10.555802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8834902-ee1f-4100-b6be-bcf3288a5e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:10.556399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8834902-ee1f-4100-b6be-bcf3288a5e7c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:10.556691 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8834902-ee1f-4100-b6be-bcf3288a5e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:10.556974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8834902-ee1f-4100-b6be-bcf3288a5e7c None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:10.557705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8834902-ee1f-4100-b6be-bcf3288a5e7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:10.558051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8834902-ee1f-4100-b6be-bcf3288a5e7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:10.560239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8834902-ee1f-4100-b6be-bcf3288a5e7c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:10.571452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 613/1238] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:10.578109 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def36ca7-2f05-49da-ae8d-64b9d847d847 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:10.676782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def36ca7-2f05-49da-ae8d-64b9d847d847 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:10.710800 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabd483-8524-48d6-aef6-4d349707250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:10.711597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabd483-8524-48d6-aef6-4d349707250d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:10.711882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabd483-8524-48d6-aef6-4d349707250d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:10.712200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabd483-8524-48d6-aef6-4d349707250d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:10.715018 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:10.719822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabd483-8524-48d6-aef6-4d349707250d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:10.721346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabd483-8524-48d6-aef6-4d349707250d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-4dabd483-8524-48d6-aef6-4d349707250d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:31:10.737450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:10.743038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:10.744337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:10.744337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:10.744337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:31:10.744337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:31:10.744337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:31:10.744337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:31:10.744337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:31:10.744337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:31:10.744337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 22:31:10.744337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:10.744337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 626/1239] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:10.745877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8834902-ee1f-4100-b6be-bcf3288a5e7c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:10.850250 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8834902-ee1f-4100-b6be-bcf3288a5e7c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:10.885158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3cb61-f883-4d2f-8449-862fcb5de1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:10.892502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3cb61-f883-4d2f-8449-862fcb5de1bf None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:10.892502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3cb61-f883-4d2f-8449-862fcb5de1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:10.892502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac3cb61-f883-4d2f-8449-862fcb5de1bf None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:10.892502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3cb61-f883-4d2f-8449-862fcb5de1bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:10.892502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3cb61-f883-4d2f-8449-862fcb5de1bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:10.892502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac3cb61-f883-4d2f-8449-862fcb5de1bf None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:10.906529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 614/1240] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Jul 20 22:31:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:10.912454 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabd483-8524-48d6-aef6-4d349707250d None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:11.012956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabd483-8524-48d6-aef6-4d349707250d None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:11.047460 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa785cb-b78a-44dc-a705-8f7897ef1508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:11.048117 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa785cb-b78a-44dc-a705-8f7897ef1508 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:11.048403 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa785cb-b78a-44dc-a705-8f7897ef1508 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:11.048684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa785cb-b78a-44dc-a705-8f7897ef1508 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:11.120024 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:11.126545 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa785cb-b78a-44dc-a705-8f7897ef1508 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:11.128007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa785cb-b78a-44dc-a705-8f7897ef1508 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:11.224886 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 627/1241] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:31:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:31:11.230908 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3cb61-f883-4d2f-8449-862fcb5de1bf None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:11.258821 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:11.336776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac3cb61-f883-4d2f-8449-862fcb5de1bf None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:11.375717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d4ce4-c3d9-4161-83fb-6e58999cc7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:11.376408 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d4ce4-c3d9-4161-83fb-6e58999cc7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:11.376692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d4ce4-c3d9-4161-83fb-6e58999cc7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:11.376968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d4ce4-c3d9-4161-83fb-6e58999cc7a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:11.388585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d4ce4-c3d9-4161-83fb-6e58999cc7a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:11.390057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d4ce4-c3d9-4161-83fb-6e58999cc7a3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-eb5d4ce4-c3d9-4161-83fb-6e58999cc7a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:31:11.409140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:11.410360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:11.412174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:31:11.412174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:31:11.412174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:11.412174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:11.412174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 615/1242] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:11.416602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa785cb-b78a-44dc-a705-8f7897ef1508 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:11.517133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:11.522993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa785cb-b78a-44dc-a705-8f7897ef1508 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:11.562697 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be4445-15e0-4c3e-b982-e88f92e42dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:11.563363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be4445-15e0-4c3e-b982-e88f92e42dcf None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:11.563648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be4445-15e0-4c3e-b982-e88f92e42dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:11.563925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14be4445-15e0-4c3e-b982-e88f92e42dcf None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:11.564646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be4445-15e0-4c3e-b982-e88f92e42dcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:11.564961 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be4445-15e0-4c3e-b982-e88f92e42dcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:11.566369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14be4445-15e0-4c3e-b982-e88f92e42dcf None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:11.578053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 628/1243] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:11.583854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d4ce4-c3d9-4161-83fb-6e58999cc7a3 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:11.671377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:11.694020 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d4ce4-c3d9-4161-83fb-6e58999cc7a3 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:11.727621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0ba2a-cc45-4bd4-9b05-8528b2cf6060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:11.728412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0ba2a-cc45-4bd4-9b05-8528b2cf6060 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:11.728726 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0ba2a-cc45-4bd4-9b05-8528b2cf6060 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:11.729017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0ba2a-cc45-4bd4-9b05-8528b2cf6060 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:11.737310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0ba2a-cc45-4bd4-9b05-8528b2cf6060 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:11.743689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0ba2a-cc45-4bd4-9b05-8528b2cf6060 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-94e0ba2a-cc45-4bd4-9b05-8528b2cf6060 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:31:11.753507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:11.754716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:11.755997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:31:11.755997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:31:11.755997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:31:11.755997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:31:11.755997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:31:11.755997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:31:11.755997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:31:11.755997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:11.755997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 616/1244] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:31:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:11.760665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be4445-15e0-4c3e-b982-e88f92e42dcf None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:11.870931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14be4445-15e0-4c3e-b982-e88f92e42dcf None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:11.905678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edde5a-c149-412e-88dd-8b3f5c492e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:11.906409 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edde5a-c149-412e-88dd-8b3f5c492e44 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:11.906694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edde5a-c149-412e-88dd-8b3f5c492e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:11.906969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edde5a-c149-412e-88dd-8b3f5c492e44 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:11.914926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edde5a-c149-412e-88dd-8b3f5c492e44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:11.914926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edde5a-c149-412e-88dd-8b3f5c492e44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:11.914926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edde5a-c149-412e-88dd-8b3f5c492e44 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:11.922535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 629/1245] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:31:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:11.928564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0ba2a-cc45-4bd4-9b05-8528b2cf6060 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:12.029182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0ba2a-cc45-4bd4-9b05-8528b2cf6060 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:12.062965 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba722eb-1f70-4cc7-a329-36a6569fc0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:12.063623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba722eb-1f70-4cc7-a329-36a6569fc0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:12.063905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba722eb-1f70-4cc7-a329-36a6569fc0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:12.064182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba722eb-1f70-4cc7-a329-36a6569fc0b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:12.065030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba722eb-1f70-4cc7-a329-36a6569fc0b7 None admin] RBAC: Adding query filter params (role.id=2a5f2a34d0b341e58b642fc48dc7c5da, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=65c9898ccf874dce88f08bebdbae02d4) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:12.065345 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba722eb-1f70-4cc7-a329-36a6569fc0b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:12.066818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba722eb-1f70-4cc7-a329-36a6569fc0b7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:12.072794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 617/1246] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:31:11 2022] GET /identity/v3/role_assignments?user.id=65c9898ccf874dce88f08bebdbae02d4&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=2a5f2a34d0b341e58b642fc48dc7c5da => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:14.197933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516c1ad-c765-4c5f-b931-8e272da1ef92 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:14.198485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516c1ad-c765-4c5f-b931-8e272da1ef92 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:14.198485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516c1ad-c765-4c5f-b931-8e272da1ef92 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:14.200281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 630/1247] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:31:14.206015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623bfd-115d-4a1e-9121-b036f168f7fb None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:14.206460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623bfd-115d-4a1e-9121-b036f168f7fb None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:14.206556 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49623bfd-115d-4a1e-9121-b036f168f7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:14.211589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:14.224597 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-49623bfd-115d-4a1e-9121-b036f168f7fb None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:31:14.225828 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-49623bfd-115d-4a1e-9121-b036f168f7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:31:14.299082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 618/1248] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:31:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:31:14.323138 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516c1ad-c765-4c5f-b931-8e272da1ef92 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:14.342924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:14.427178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516c1ad-c765-4c5f-b931-8e272da1ef92 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:14.462346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6ebff-d54f-4f04-9abc-9666826c7bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:14.463138 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6ebff-d54f-4f04-9abc-9666826c7bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:14.463412 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6ebff-d54f-4f04-9abc-9666826c7bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:14.463678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6ebff-d54f-4f04-9abc-9666826c7bf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:14.474256 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6ebff-d54f-4f04-9abc-9666826c7bf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-ffb6ebff-d54f-4f04-9abc-9666826c7bf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:31:14.483216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:14.484587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:14.485841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:14.485841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:14.485841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:14.485841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:14.485841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:31:14.485841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:31:14.485841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:31:14.485841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:31:14.485841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:31:14.485841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:31:14.485841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:31:14.485841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:14.485841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 631/1249] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:14.490783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49623bfd-115d-4a1e-9121-b036f168f7fb None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:14.595363 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49623bfd-115d-4a1e-9121-b036f168f7fb None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:14.627286 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:14.632185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7521f56-7444-442a-a393-732f3432400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:14.632859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7521f56-7444-442a-a393-732f3432400c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:14.633147 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7521f56-7444-442a-a393-732f3432400c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:14.633426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7521f56-7444-442a-a393-732f3432400c None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:14.634215 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7521f56-7444-442a-a393-732f3432400c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:14.634531 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7521f56-7444-442a-a393-732f3432400c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:14.635898 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7521f56-7444-442a-a393-732f3432400c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:14.644015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 619/1250] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:31:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:31:14.649990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6ebff-d54f-4f04-9abc-9666826c7bf9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:14.729953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:14.754514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6ebff-d54f-4f04-9abc-9666826c7bf9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:14.788868 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98941f9d-def0-48f2-aae6-37e2d9853d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:14.789656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98941f9d-def0-48f2-aae6-37e2d9853d32 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:14.789968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98941f9d-def0-48f2-aae6-37e2d9853d32 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:14.790240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98941f9d-def0-48f2-aae6-37e2d9853d32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:14.801839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98941f9d-def0-48f2-aae6-37e2d9853d32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:14.803390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98941f9d-def0-48f2-aae6-37e2d9853d32 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-98941f9d-def0-48f2-aae6-37e2d9853d32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:31:14.821363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:14.822465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:14.823602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:31:14.823602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:31:14.823602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:14.823602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:14.823602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 632/1251] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:14.828915 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7521f56-7444-442a-a393-732f3432400c None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:14.931267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7521f56-7444-442a-a393-732f3432400c None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:14.964647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd457b-3af9-4987-8f6c-462ba9a6e8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:14.965921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd457b-3af9-4987-8f6c-462ba9a6e8ba None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:14.966349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd457b-3af9-4987-8f6c-462ba9a6e8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:14.967015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd457b-3af9-4987-8f6c-462ba9a6e8ba None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:14.967743 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd457b-3af9-4987-8f6c-462ba9a6e8ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:14.968093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd457b-3af9-4987-8f6c-462ba9a6e8ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:14.969469 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd457b-3af9-4987-8f6c-462ba9a6e8ba None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:14.982634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 620/1252] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:14.988601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98941f9d-def0-48f2-aae6-37e2d9853d32 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:15.089590 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98941f9d-def0-48f2-aae6-37e2d9853d32 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:15.116644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:15.124353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67121ea4-ec18-4f89-85a1-eca208c1b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:15.125158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67121ea4-ec18-4f89-85a1-eca208c1b154 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:15.125441 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67121ea4-ec18-4f89-85a1-eca208c1b154 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:15.125734 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67121ea4-ec18-4f89-85a1-eca208c1b154 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:15.133187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67121ea4-ec18-4f89-85a1-eca208c1b154 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:15.134652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67121ea4-ec18-4f89-85a1-eca208c1b154 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-67121ea4-ec18-4f89-85a1-eca208c1b154 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:31:15.149505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:15.150872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:15.152073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:15.152073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:15.152073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:31:15.152073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:31:15.152073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:31:15.152073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:31:15.152073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:31:15.152073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:31:15.152073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 22:31:15.152073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:15.152073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 633/1253] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:15.157567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd457b-3af9-4987-8f6c-462ba9a6e8ba None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:15.220669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:15.264204 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd457b-3af9-4987-8f6c-462ba9a6e8ba None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:15.297161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d8df-ca8b-44b1-a3f5-3e02ccc05b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:15.297908 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d8df-ca8b-44b1-a3f5-3e02ccc05b57 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:15.298192 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d8df-ca8b-44b1-a3f5-3e02ccc05b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:15.298467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0d8df-ca8b-44b1-a3f5-3e02ccc05b57 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:15.299314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0d8df-ca8b-44b1-a3f5-3e02ccc05b57 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:15.299627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0d8df-ca8b-44b1-a3f5-3e02ccc05b57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:15.301057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0d8df-ca8b-44b1-a3f5-3e02ccc05b57 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:15.318710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 621/1254] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Jul 20 22:31:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:15.325324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67121ea4-ec18-4f89-85a1-eca208c1b154 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:15.426951 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67121ea4-ec18-4f89-85a1-eca208c1b154 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:15.460425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022dec2-1e89-4e7c-84c8-fb065003c089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:15.461168 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022dec2-1e89-4e7c-84c8-fb065003c089 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:15.461453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022dec2-1e89-4e7c-84c8-fb065003c089 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:15.461755 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8022dec2-1e89-4e7c-84c8-fb065003c089 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:15.521934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:15.534246 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022dec2-1e89-4e7c-84c8-fb065003c089 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:15.535735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8022dec2-1e89-4e7c-84c8-fb065003c089 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:15.634269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 634/1255] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:31:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:31:15.641221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d8df-ca8b-44b1-a3f5-3e02ccc05b57 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:15.741479 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0d8df-ca8b-44b1-a3f5-3e02ccc05b57 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:15.755154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:15.776247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a43714-4b1d-40df-86c2-7b8b5747d912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:15.776962 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a43714-4b1d-40df-86c2-7b8b5747d912 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:15.777231 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a43714-4b1d-40df-86c2-7b8b5747d912 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:15.777585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a43714-4b1d-40df-86c2-7b8b5747d912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:15.788319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a43714-4b1d-40df-86c2-7b8b5747d912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:15.789791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a43714-4b1d-40df-86c2-7b8b5747d912 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-f1a43714-4b1d-40df-86c2-7b8b5747d912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:31:15.807670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:15.808809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:15.810754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:31:15.810754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:31:15.810754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:15.810754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:15.810754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 622/1256] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:15.815982 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022dec2-1e89-4e7c-84c8-fb065003c089 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:15.902129 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:15.913811 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8022dec2-1e89-4e7c-84c8-fb065003c089 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:15.948413 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e13a4-ae5b-4966-8deb-0644c7a13289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:15.949074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e13a4-ae5b-4966-8deb-0644c7a13289 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:15.949353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e13a4-ae5b-4966-8deb-0644c7a13289 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:15.949624 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e13a4-ae5b-4966-8deb-0644c7a13289 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:15.951035 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e13a4-ae5b-4966-8deb-0644c7a13289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:15.951340 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e13a4-ae5b-4966-8deb-0644c7a13289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:15.952694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e13a4-ae5b-4966-8deb-0644c7a13289 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:15.963540 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 635/1257] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:15.969249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a43714-4b1d-40df-86c2-7b8b5747d912 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:16.070331 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a43714-4b1d-40df-86c2-7b8b5747d912 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:16.105147 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5c7fc-cdd0-4718-98d2-35432464f3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:16.106648 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c7fc-cdd0-4718-98d2-35432464f3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:16.106939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c7fc-cdd0-4718-98d2-35432464f3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:16.107213 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5c7fc-cdd0-4718-98d2-35432464f3d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:16.114133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5c7fc-cdd0-4718-98d2-35432464f3d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:16.115579 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5c7fc-cdd0-4718-98d2-35432464f3d8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-35c5c7fc-cdd0-4718-98d2-35432464f3d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:31:16.129537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:16.130646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:16.131795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:31:16.131795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:31:16.131795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:31:16.131795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:31:16.131795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:31:16.131795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:31:16.131795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:31:16.131795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:16.131795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 623/1258] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:31:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:16.136709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e13a4-ae5b-4966-8deb-0644c7a13289 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:16.236446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e13a4-ae5b-4966-8deb-0644c7a13289 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:16.271249 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6ee41-da6d-4b8e-a379-e39052951c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:16.271914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6ee41-da6d-4b8e-a379-e39052951c29 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:16.272197 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6ee41-da6d-4b8e-a379-e39052951c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:16.272472 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6ee41-da6d-4b8e-a379-e39052951c29 None admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:16.273262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6ee41-da6d-4b8e-a379-e39052951c29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:16.273564 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6ee41-da6d-4b8e-a379-e39052951c29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:16.275066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6ee41-da6d-4b8e-a379-e39052951c29 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:16.287631 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 636/1259] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:31:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:16.294520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5c7fc-cdd0-4718-98d2-35432464f3d8 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:16.320492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:16.398404 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5c7fc-cdd0-4718-98d2-35432464f3d8 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:16.433084 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b9067-fa36-4262-95d5-94dda8b88560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:16.433757 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b9067-fa36-4262-95d5-94dda8b88560 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:16.434048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b9067-fa36-4262-95d5-94dda8b88560 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:16.434518 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b9067-fa36-4262-95d5-94dda8b88560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:16.435483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b9067-fa36-4262-95d5-94dda8b88560 None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=65c9898ccf874dce88f08bebdbae02d4) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:16.435802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b9067-fa36-4262-95d5-94dda8b88560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:16.440241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b9067-fa36-4262-95d5-94dda8b88560 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:16.443288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 624/1260] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:31:16 2022] GET /identity/v3/role_assignments?user.id=65c9898ccf874dce88f08bebdbae02d4&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:18.470938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd4286-42db-4a98-a90f-91240a7dd97b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:18.471579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd4286-42db-4a98-a90f-91240a7dd97b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:18.471579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd4286-42db-4a98-a90f-91240a7dd97b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:18.472922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 637/1261] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:31:18.478173 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba60ba8-1a96-48a4-ab3d-520681231ae6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:18.478558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba60ba8-1a96-48a4-ab3d-520681231ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:18.478741 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba60ba8-1a96-48a4-ab3d-520681231ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:18.495562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7ba60ba8-1a96-48a4-ab3d-520681231ae6 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:31:18.497261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7ba60ba8-1a96-48a4-ab3d-520681231ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:31:18.564544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 625/1262] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:31:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 22:31:18.587879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd4286-42db-4a98-a90f-91240a7dd97b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:18.598978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:18.688753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd4286-42db-4a98-a90f-91240a7dd97b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:18.728797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d9a6f-dfa9-4e6a-91f1-e95cf654af27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:18.729513 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d9a6f-dfa9-4e6a-91f1-e95cf654af27 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:18.729849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d9a6f-dfa9-4e6a-91f1-e95cf654af27 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:18.730102 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d9a6f-dfa9-4e6a-91f1-e95cf654af27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:18.741474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d9a6f-dfa9-4e6a-91f1-e95cf654af27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-1f9d9a6f-dfa9-4e6a-91f1-e95cf654af27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:31:18.750759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:18.761845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:18.764201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:18.764201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:18.764201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:18.764201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:18.764201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:31:18.764201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:31:18.764201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:31:18.764201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:31:18.764201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:31:18.764201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:31:18.764201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:31:18.764201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:18.764201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 638/1263] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:31:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:18.765071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba60ba8-1a96-48a4-ab3d-520681231ae6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:18.777464 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:18.858474 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba60ba8-1a96-48a4-ab3d-520681231ae6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:18.895428 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5c2c7-144c-406c-9c78-9f1e05247b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:18.896108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5c2c7-144c-406c-9c78-9f1e05247b6e None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:18.896392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5c2c7-144c-406c-9c78-9f1e05247b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:18.896671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5c2c7-144c-406c-9c78-9f1e05247b6e None admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:18.897447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5c2c7-144c-406c-9c78-9f1e05247b6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:18.897786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5c2c7-144c-406c-9c78-9f1e05247b6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:18.899199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5c2c7-144c-406c-9c78-9f1e05247b6e None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:18.908059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 626/1264] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:18.914526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d9a6f-dfa9-4e6a-91f1-e95cf654af27 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:18.983479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:19.017618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d9a6f-dfa9-4e6a-91f1-e95cf654af27 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:19.050558 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73656ca-57c7-4e82-94d0-229c0279dad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:19.051362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73656ca-57c7-4e82-94d0-229c0279dad9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:19.052079 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73656ca-57c7-4e82-94d0-229c0279dad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:19.052368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73656ca-57c7-4e82-94d0-229c0279dad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:19.064990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73656ca-57c7-4e82-94d0-229c0279dad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:19.066594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73656ca-57c7-4e82-94d0-229c0279dad9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-b73656ca-57c7-4e82-94d0-229c0279dad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:31:19.083962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:19.085077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:19.086219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:31:19.086219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:31:19.086219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:19.086219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:19.086219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 639/1265] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:19.091390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5c2c7-144c-406c-9c78-9f1e05247b6e None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:19.174805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:19.196520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5c2c7-144c-406c-9c78-9f1e05247b6e None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:19.228336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b8278-dc37-459f-845e-578c5732a0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:19.228990 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b8278-dc37-459f-845e-578c5732a0cb None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:19.229270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b8278-dc37-459f-845e-578c5732a0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:19.229544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b8278-dc37-459f-845e-578c5732a0cb None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:19.230290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b8278-dc37-459f-845e-578c5732a0cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:19.230599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b8278-dc37-459f-845e-578c5732a0cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:19.232628 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85b8278-dc37-459f-845e-578c5732a0cb None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:19.245045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 627/1266] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:19.251487 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73656ca-57c7-4e82-94d0-229c0279dad9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:19.351609 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73656ca-57c7-4e82-94d0-229c0279dad9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:19.372183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:19.385635 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51ce7e-fb19-4fd4-b578-408a963c0de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:19.386474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51ce7e-fb19-4fd4-b578-408a963c0de9 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:19.386758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51ce7e-fb19-4fd4-b578-408a963c0de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:19.387033 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51ce7e-fb19-4fd4-b578-408a963c0de9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:19.395177 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51ce7e-fb19-4fd4-b578-408a963c0de9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:19.396606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51ce7e-fb19-4fd4-b578-408a963c0de9 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-da51ce7e-fb19-4fd4-b578-408a963c0de9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:31:19.410841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:19.412027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:19.413410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:19.413410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:19.413410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:31:19.413410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:31:19.413410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:31:19.413410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:31:19.413410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:31:19.413410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:31:19.413410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 22:31:19.413410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:19.413410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 640/1267] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:19.427510 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b8278-dc37-459f-845e-578c5732a0cb None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:19.519909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b8278-dc37-459f-845e-578c5732a0cb None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:19.557211 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da137562-8dd4-4f2b-a85d-07455ad2ab21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:19.557916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137562-8dd4-4f2b-a85d-07455ad2ab21 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:19.558206 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137562-8dd4-4f2b-a85d-07455ad2ab21 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:19.558487 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da137562-8dd4-4f2b-a85d-07455ad2ab21 None admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:19.559849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da137562-8dd4-4f2b-a85d-07455ad2ab21 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:19.560218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da137562-8dd4-4f2b-a85d-07455ad2ab21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:19.561642 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da137562-8dd4-4f2b-a85d-07455ad2ab21 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:19.570288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:19.579895 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 628/1268] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Jul 20 22:31:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:19.585703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51ce7e-fb19-4fd4-b578-408a963c0de9 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:19.688120 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51ce7e-fb19-4fd4-b578-408a963c0de9 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:19.720510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf87c2f-931d-42a6-9a64-f2c47183d7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:19.721378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87c2f-931d-42a6-9a64-f2c47183d7b8 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:19.721663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87c2f-931d-42a6-9a64-f2c47183d7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:19.721969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87c2f-931d-42a6-9a64-f2c47183d7b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:19.732960 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf87c2f-931d-42a6-9a64-f2c47183d7b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:19.734840 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf87c2f-931d-42a6-9a64-f2c47183d7b8 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-adf87c2f-931d-42a6-9a64-f2c47183d7b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:31:19.752291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:19.757857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:19.759027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:31:19.759027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:31:19.759027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:19.759027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:19.759027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 641/1269] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:19.759428 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da137562-8dd4-4f2b-a85d-07455ad2ab21 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:19.859316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da137562-8dd4-4f2b-a85d-07455ad2ab21 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:19.894695 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5150858-19fd-4e79-bdde-884d66f39a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:19.904137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5150858-19fd-4e79-bdde-884d66f39a63 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:19.904137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5150858-19fd-4e79-bdde-884d66f39a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:19.904137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5150858-19fd-4e79-bdde-884d66f39a63 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:19.904137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5150858-19fd-4e79-bdde-884d66f39a63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:19.904137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5150858-19fd-4e79-bdde-884d66f39a63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:19.904137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5150858-19fd-4e79-bdde-884d66f39a63 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:19.909810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 629/1270] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:19.915558 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf87c2f-931d-42a6-9a64-f2c47183d7b8 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:19.949321 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:20.016733 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf87c2f-931d-42a6-9a64-f2c47183d7b8 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:20.052587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760940a-04c7-4764-abfc-89a928f81863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:20.053436 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760940a-04c7-4764-abfc-89a928f81863 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:20.053708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760940a-04c7-4764-abfc-89a928f81863 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:20.054020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760940a-04c7-4764-abfc-89a928f81863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:20.061125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760940a-04c7-4764-abfc-89a928f81863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:20.062586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760940a-04c7-4764-abfc-89a928f81863 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-d760940a-04c7-4764-abfc-89a928f81863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:31:20.076826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:20.077998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:20.078980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:31:20.078980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:31:20.078980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:31:20.078980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:31:20.078980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:31:20.078980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:31:20.078980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:31:20.078980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:20.078980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 642/1271] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:31:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:20.084022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5150858-19fd-4e79-bdde-884d66f39a63 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:20.154542 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:20.195763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5150858-19fd-4e79-bdde-884d66f39a63 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:20.228450 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b1751-e1d7-4a8a-8654-d0f983f1f960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:20.229120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b1751-e1d7-4a8a-8654-d0f983f1f960 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:20.229403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b1751-e1d7-4a8a-8654-d0f983f1f960 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:20.229683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b1751-e1d7-4a8a-8654-d0f983f1f960 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:20.230504 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b1751-e1d7-4a8a-8654-d0f983f1f960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:20.230819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b1751-e1d7-4a8a-8654-d0f983f1f960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:20.233044 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b1751-e1d7-4a8a-8654-d0f983f1f960 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:20.245919 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 630/1272] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:31:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:20.252235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760940a-04c7-4764-abfc-89a928f81863 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:20.346318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:20.354761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760940a-04c7-4764-abfc-89a928f81863 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:20.391692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8ed16-4c35-49fc-a30d-b47fe01d57b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:20.392650 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ed16-4c35-49fc-a30d-b47fe01d57b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:20.392928 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ed16-4c35-49fc-a30d-b47fe01d57b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:20.393199 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8ed16-4c35-49fc-a30d-b47fe01d57b7 None admin] PATH_INFO: `/v3/projects/8cec07c864274d649ecd1944be870bd5/users/65c9898ccf874dce88f08bebdbae02d4/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:20.395201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8ed16-4c35-49fc-a30d-b47fe01d57b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=8cec07c864274d649ecd1944be870bd5, user_id=65c9898ccf874dce88f08bebdbae02d4, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:20.396649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8ed16-4c35-49fc-a30d-b47fe01d57b7 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:20.496409 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 643/1273] 10.222.0.83 () {58 vars in 1439 bytes} [Wed Jul 20 22:31:20 2022] PUT /identity/v3/projects/8cec07c864274d649ecd1944be870bd5/users/65c9898ccf874dce88f08bebdbae02d4/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:31:22.574233 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca4568-846a-4897-9e42-b7e8887a7216 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:22.574815 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca4568-846a-4897-9e42-b7e8887a7216 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:22.574953 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca4568-846a-4897-9e42-b7e8887a7216 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:22.577293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 631/1274] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:31:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:31:22.582487 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0192a1f-bde5-48a5-9184-f7bec7b44e36 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:22.582888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0192a1f-bde5-48a5-9184-f7bec7b44e36 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:22.583044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0192a1f-bde5-48a5-9184-f7bec7b44e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:22.600391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a0192a1f-bde5-48a5-9184-f7bec7b44e36 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:31:22.601610 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a0192a1f-bde5-48a5-9184-f7bec7b44e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:31:22.670871 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 644/1275] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:31:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:31:22.695630 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca4568-846a-4897-9e42-b7e8887a7216 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:22.798363 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ca4568-846a-4897-9e42-b7e8887a7216 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:22.816265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:22.833489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4c3db-74b3-49ff-a423-04eb25abb46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:22.834251 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4c3db-74b3-49ff-a423-04eb25abb46d None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:22.834537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4c3db-74b3-49ff-a423-04eb25abb46d None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:22.834815 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4c3db-74b3-49ff-a423-04eb25abb46d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:22.845151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4c3db-74b3-49ff-a423-04eb25abb46d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-2fb4c3db-74b3-49ff-a423-04eb25abb46d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 22:31:22.853045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:22.854242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:22.855292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:22.855292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:22.855292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:22.855292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:22.855292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 22:31:22.855292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 22:31:22.855292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 22:31:22.855292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 22:31:22.855292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 22:31:22.855292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 22:31:22.855292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 22:31:22.855292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:22.855292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 632/1276] 10.222.0.83 () {56 vars in 1096 bytes} [Wed Jul 20 22:31:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:22.863372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0192a1f-bde5-48a5-9184-f7bec7b44e36 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:22.951409 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:22.969708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0192a1f-bde5-48a5-9184-f7bec7b44e36 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:23.004876 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6855c-0254-4851-899a-7eb9895536a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:23.005544 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6855c-0254-4851-899a-7eb9895536a4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:23.005863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6855c-0254-4851-899a-7eb9895536a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:23.006142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6855c-0254-4851-899a-7eb9895536a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:23.006914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6855c-0254-4851-899a-7eb9895536a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:23.007227 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6855c-0254-4851-899a-7eb9895536a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:23.008594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6855c-0254-4851-899a-7eb9895536a4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:23.016991 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 645/1277] 10.222.0.83 () {56 vars in 1099 bytes} [Wed Jul 20 22:31:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:23.022805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4c3db-74b3-49ff-a423-04eb25abb46d None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:23.125605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4c3db-74b3-49ff-a423-04eb25abb46d None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:23.161604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66a4fb-97cf-4f2d-a787-c4faa4f81e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:23.161604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66a4fb-97cf-4f2d-a787-c4faa4f81e25 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:23.161604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66a4fb-97cf-4f2d-a787-c4faa4f81e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:23.161604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66a4fb-97cf-4f2d-a787-c4faa4f81e25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:23.170959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66a4fb-97cf-4f2d-a787-c4faa4f81e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:23.172410 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66a4fb-97cf-4f2d-a787-c4faa4f81e25 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-8b66a4fb-97cf-4f2d-a787-c4faa4f81e25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:31:23.190161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:23.191289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:23.192235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:31:23.192235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:31:23.192235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:23.192235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:23.192235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 633/1278] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:23.197245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6855c-0254-4851-899a-7eb9895536a4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:23.307246 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6855c-0254-4851-899a-7eb9895536a4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:23.342639 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e84189-c9a0-4b8b-8037-7d560bf9fb99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:23.343319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e84189-c9a0-4b8b-8037-7d560bf9fb99 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:23.343590 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e84189-c9a0-4b8b-8037-7d560bf9fb99 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:23.343867 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e84189-c9a0-4b8b-8037-7d560bf9fb99 None admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:23.344591 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e84189-c9a0-4b8b-8037-7d560bf9fb99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:23.344901 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e84189-c9a0-4b8b-8037-7d560bf9fb99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:23.346299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e84189-c9a0-4b8b-8037-7d560bf9fb99 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:23.358304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 646/1279] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:23.364272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66a4fb-97cf-4f2d-a787-c4faa4f81e25 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:23.396199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:23.473385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66a4fb-97cf-4f2d-a787-c4faa4f81e25 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:23.508623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8bbdf-0cfb-4d8a-9b2c-2ad18371a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:23.509453 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8bbdf-0cfb-4d8a-9b2c-2ad18371a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:23.509756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8bbdf-0cfb-4d8a-9b2c-2ad18371a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:23.510121 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8bbdf-0cfb-4d8a-9b2c-2ad18371a1f7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:23.517945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8bbdf-0cfb-4d8a-9b2c-2ad18371a1f7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:23.519415 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8bbdf-0cfb-4d8a-9b2c-2ad18371a1f7 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-07b8bbdf-0cfb-4d8a-9b2c-2ad18371a1f7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 22:31:23.533678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:23.534887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:23.535944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:23.535944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:23.535944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 22:31:23.535944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 22:31:23.535944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 22:31:23.535944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 22:31:23.535944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 22:31:23.535944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 22:31:23.535944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 22:31:23.535944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:23.535944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 634/1280] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:23.540760 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e84189-c9a0-4b8b-8037-7d560bf9fb99 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:23.545597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:23.645238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e84189-c9a0-4b8b-8037-7d560bf9fb99 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:23.686953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e93332-37b1-4af3-88dd-891f815f97a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:23.687622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e93332-37b1-4af3-88dd-891f815f97a0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:23.687904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e93332-37b1-4af3-88dd-891f815f97a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:23.688176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e93332-37b1-4af3-88dd-891f815f97a0 None admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:23.689048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e93332-37b1-4af3-88dd-891f815f97a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:23.689354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e93332-37b1-4af3-88dd-891f815f97a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:23.690793 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e93332-37b1-4af3-88dd-891f815f97a0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:23.708183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 647/1281] 10.222.0.83 () {56 vars in 1143 bytes} [Wed Jul 20 22:31:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:23.714050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8bbdf-0cfb-4d8a-9b2c-2ad18371a1f7 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:23.806572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:23.816604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8bbdf-0cfb-4d8a-9b2c-2ad18371a1f7 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:23.850586 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce9505-8c6f-4fb4-a4c2-b87de7f492b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:23.851242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce9505-8c6f-4fb4-a4c2-b87de7f492b3 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:23.851528 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce9505-8c6f-4fb4-a4c2-b87de7f492b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:23.851826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce9505-8c6f-4fb4-a4c2-b87de7f492b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:23.923594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce9505-8c6f-4fb4-a4c2-b87de7f492b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:23.925045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce9505-8c6f-4fb4-a4c2-b87de7f492b3 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:24.018721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:24.029297 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 635/1282] 10.222.0.83 () {58 vars in 1282 bytes} [Wed Jul 20 22:31:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 22:31:24.035374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e93332-37b1-4af3-88dd-891f815f97a0 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:24.100907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:24.142950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e93332-37b1-4af3-88dd-891f815f97a0 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:24.176950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3836bd8-cab2-4449-a376-b7810cb08d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:24.177768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3836bd8-cab2-4449-a376-b7810cb08d76 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:24.178055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3836bd8-cab2-4449-a376-b7810cb08d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:24.178328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3836bd8-cab2-4449-a376-b7810cb08d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:24.189613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3836bd8-cab2-4449-a376-b7810cb08d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:24.191096 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3836bd8-cab2-4449-a376-b7810cb08d76 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-a3836bd8-cab2-4449-a376-b7810cb08d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 22:31:24.208352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:24.209493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:24.210514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 22:31:24.210514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 22:31:24.210514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 22:31:24.210514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:24.210514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 648/1283] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:24.216524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce9505-8c6f-4fb4-a4c2-b87de7f492b3 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:24.315788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce9505-8c6f-4fb4-a4c2-b87de7f492b3 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:24.350272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61619ac7-30bd-4975-8d04-21aca2142ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:24.350945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61619ac7-30bd-4975-8d04-21aca2142ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:24.351222 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61619ac7-30bd-4975-8d04-21aca2142ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:24.351491 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61619ac7-30bd-4975-8d04-21aca2142ef4 None admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:24.352211 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61619ac7-30bd-4975-8d04-21aca2142ef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:24.352516 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61619ac7-30bd-4975-8d04-21aca2142ef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:24.353911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61619ac7-30bd-4975-8d04-21aca2142ef4 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:24.366027 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 636/1284] 10.222.0.83 () {56 vars in 1109 bytes} [Wed Jul 20 22:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:24.371945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3836bd8-cab2-4449-a376-b7810cb08d76 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:24.472303 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3836bd8-cab2-4449-a376-b7810cb08d76 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:24.486147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:24.506672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54addc01-1f35-4edd-b7db-425a4af683c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:24.507475 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54addc01-1f35-4edd-b7db-425a4af683c4 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:24.507758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54addc01-1f35-4edd-b7db-425a4af683c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:24.508037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54addc01-1f35-4edd-b7db-425a4af683c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:24.515484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54addc01-1f35-4edd-b7db-425a4af683c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:24.516976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54addc01-1f35-4edd-b7db-425a4af683c4 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application [None req-54addc01-1f35-4edd-b7db-425a4af683c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 22:31:24.531802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:24.532931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:24.533908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 22:31:24.533908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 22:31:24.533908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 22:31:24.533908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 22:31:24.533908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 22:31:24.533908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 22:31:24.533908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 22:31:24.533908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: ERROR keystone.server.flask.application Jul 20 22:31:24.533908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 649/1285] 10.222.0.83 () {56 vars in 1111 bytes} [Wed Jul 20 22:31:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:24.539143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61619ac7-30bd-4975-8d04-21aca2142ef4 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:24.590276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:24.639997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61619ac7-30bd-4975-8d04-21aca2142ef4 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:24.672112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57392fd-957d-420e-b6fc-c82221cc05d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:24.672778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57392fd-957d-420e-b6fc-c82221cc05d8 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:24.673059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57392fd-957d-420e-b6fc-c82221cc05d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:24.673328 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57392fd-957d-420e-b6fc-c82221cc05d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:24.674138 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57392fd-957d-420e-b6fc-c82221cc05d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:24.674445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57392fd-957d-420e-b6fc-c82221cc05d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:24.675857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57392fd-957d-420e-b6fc-c82221cc05d8 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:24.688656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 637/1286] 10.222.0.83 () {56 vars in 1148 bytes} [Wed Jul 20 22:31:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:24.694844 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54addc01-1f35-4edd-b7db-425a4af683c4 None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:24.795979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54addc01-1f35-4edd-b7db-425a4af683c4 None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:24.829603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f178a2a6-a874-4c0b-b8c4-17d506d77c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:24.830300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a2a6-a874-4c0b-b8c4-17d506d77c5e None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:24.830591 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a2a6-a874-4c0b-b8c4-17d506d77c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:24.830874 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f178a2a6-a874-4c0b-b8c4-17d506d77c5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:24.831713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178a2a6-a874-4c0b-b8c4-17d506d77c5e None admin] RBAC: Adding query filter params (role.id=498b8a184d2a4bbc97b95c64cefa5595, scope.project.id=8cec07c864274d649ecd1944be870bd5, user.id=65c9898ccf874dce88f08bebdbae02d4) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:24.832031 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178a2a6-a874-4c0b-b8c4-17d506d77c5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:24.833493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f178a2a6-a874-4c0b-b8c4-17d506d77c5e None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:24.839542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 650/1287] 10.222.0.83 () {56 vars in 1374 bytes} [Wed Jul 20 22:31:24 2022] GET /identity/v3/role_assignments?user.id=65c9898ccf874dce88f08bebdbae02d4&scope.project.id=8cec07c864274d649ecd1944be870bd5&role.id=498b8a184d2a4bbc97b95c64cefa5595 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:26.929058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb507050-8449-4a71-bb6f-d2639f2805f4 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:26.929616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb507050-8449-4a71-bb6f-d2639f2805f4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:26.929616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb507050-8449-4a71-bb6f-d2639f2805f4 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:26.931088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 638/1288] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:31:26.936769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba84dc-c967-4f5f-a8f7-a074e3083f93 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:26.937213 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba84dc-c967-4f5f-a8f7-a074e3083f93 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:26.937324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba84dc-c967-4f5f-a8f7-a074e3083f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:26.957483 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-48ba84dc-c967-4f5f-a8f7-a074e3083f93 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:31:26.958737 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-48ba84dc-c967-4f5f-a8f7-a074e3083f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:31:26.989336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:27.026880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 651/1289] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:31:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:31:27.050499 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb507050-8449-4a71-bb6f-d2639f2805f4 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:27.151256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb507050-8449-4a71-bb6f-d2639f2805f4 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:27.163026 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:27.186619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20692c4c-c3e2-4b42-a499-ed36ba09ab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:27.187349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20692c4c-c3e2-4b42-a499-ed36ba09ab24 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:27.187632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20692c4c-c3e2-4b42-a499-ed36ba09ab24 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:27.187909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20692c4c-c3e2-4b42-a499-ed36ba09ab24 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:27.188564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20692c4c-c3e2-4b42-a499-ed36ba09ab24 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:27.190032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20692c4c-c3e2-4b42-a499-ed36ba09ab24 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-20692c4c-c3e2-4b42-a499-ed36ba09ab24 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:27.202492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:27.203833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:27.204768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 639/1290] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Jul 20 22:31:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:27.209909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba84dc-c967-4f5f-a8f7-a074e3083f93 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:27.325695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba84dc-c967-4f5f-a8f7-a074e3083f93 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:27.361837 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862bb098-06fb-4b48-8b99-f29ab7c7a3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:27.362507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bb098-06fb-4b48-8b99-f29ab7c7a3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:27.362808 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bb098-06fb-4b48-8b99-f29ab7c7a3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:27.363091 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862bb098-06fb-4b48-8b99-f29ab7c7a3f0 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:27.363796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bb098-06fb-4b48-8b99-f29ab7c7a3f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:27.364111 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bb098-06fb-4b48-8b99-f29ab7c7a3f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:27.365498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862bb098-06fb-4b48-8b99-f29ab7c7a3f0 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:27.370695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 652/1291] 10.222.0.83 () {56 vars in 1116 bytes} [Wed Jul 20 22:31:27 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:27.376793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20692c4c-c3e2-4b42-a499-ed36ba09ab24 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:27.479992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20692c4c-c3e2-4b42-a499-ed36ba09ab24 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:27.529979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fdaa0-5cb1-4e80-90b2-a15b5ceb905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:27.530645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fdaa0-5cb1-4e80-90b2-a15b5ceb905a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:27.530930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fdaa0-5cb1-4e80-90b2-a15b5ceb905a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:27.531208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fdaa0-5cb1-4e80-90b2-a15b5ceb905a None admin] PATH_INFO: `/v3/services` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:27.531918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fdaa0-5cb1-4e80-90b2-a15b5ceb905a None admin] RBAC: Adding query filter params (type=placement) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:27.532228 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fdaa0-5cb1-4e80-90b2-a15b5ceb905a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:27.533691 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17fdaa0-5cb1-4e80-90b2-a15b5ceb905a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:27.538118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 640/1292] 10.222.0.83 () {56 vars in 1116 bytes} [Wed Jul 20 22:31:27 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:29.618479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf43ba-d301-4030-93b2-586a28fb445f None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:29.619210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf43ba-d301-4030-93b2-586a28fb445f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:29.619210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf43ba-d301-4030-93b2-586a28fb445f None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:29.620442 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 653/1293] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:31:29.627987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8fb79-b292-47e1-9010-d9428423f9a0 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:29.627987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8fb79-b292-47e1-9010-d9428423f9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:29.627987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8fb79-b292-47e1-9010-d9428423f9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:29.644247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d8c8fb79-b292-47e1-9010-d9428423f9a0 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:31:29.645423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d8c8fb79-b292-47e1-9010-d9428423f9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:31:29.676088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:29.714349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 641/1294] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:31:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:31:29.738833 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf43ba-d301-4030-93b2-586a28fb445f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:29.770102 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:29.848388 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf43ba-d301-4030-93b2-586a28fb445f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:29.884177 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf7899d-6322-4597-a280-06abe6e4b166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:29.884771 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7899d-6322-4597-a280-06abe6e4b166 None admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:29.885141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7899d-6322-4597-a280-06abe6e4b166 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:29.885427 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf7899d-6322-4597-a280-06abe6e4b166 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:29.886178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7899d-6322-4597-a280-06abe6e4b166 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:29.887783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf7899d-6322-4597-a280-06abe6e4b166 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:30.015410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 654/1295] 10.222.0.83 () {60 vars in 1141 bytes} [Wed Jul 20 22:31:29 2022] POST /identity/v3/services => generated 246 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:31:32.119228 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3463dc3-f6c0-4a95-9239-32ad16cc90c4 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:32.119806 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3463dc3-f6c0-4a95-9239-32ad16cc90c4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:32.119806 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3463dc3-f6c0-4a95-9239-32ad16cc90c4 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:32.121167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 642/1296] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:31:32.126642 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6f15f-edb9-4a36-9053-56f89c362de8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:32.127076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6f15f-edb9-4a36-9053-56f89c362de8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:32.127187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6f15f-edb9-4a36-9053-56f89c362de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:32.144110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-56c6f15f-edb9-4a36-9053-56f89c362de8 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:31:32.145291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-56c6f15f-edb9-4a36-9053-56f89c362de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:31:32.219053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 655/1297] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:31:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:31:32.242648 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3463dc3-f6c0-4a95-9239-32ad16cc90c4 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:32.351649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3463dc3-f6c0-4a95-9239-32ad16cc90c4 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:32.389918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685380b-0d0c-493d-bb03-36ec119b0d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:32.390710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685380b-0d0c-493d-bb03-36ec119b0d59 None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:32.390988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685380b-0d0c-493d-bb03-36ec119b0d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:32.391259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685380b-0d0c-493d-bb03-36ec119b0d59 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:32.391912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685380b-0d0c-493d-bb03-36ec119b0d59 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:32.393273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1685380b-0d0c-493d-bb03-36ec119b0d59 None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-1685380b-0d0c-493d-bb03-36ec119b0d59 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:32.406446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:32.407789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:32.408960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 643/1298] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Jul 20 22:31:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:32.413841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6f15f-edb9-4a36-9053-56f89c362de8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:32.433013 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:32.513897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6f15f-edb9-4a36-9053-56f89c362de8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:32.547397 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac669883-6019-4b89-809a-9d29289647fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:32.548088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac669883-6019-4b89-809a-9d29289647fe None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:32.548368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac669883-6019-4b89-809a-9d29289647fe None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:32.548639 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac669883-6019-4b89-809a-9d29289647fe None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:32.549341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac669883-6019-4b89-809a-9d29289647fe None admin] RBAC: Adding query filter params (name=placement) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:32.549646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac669883-6019-4b89-809a-9d29289647fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:32.551023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac669883-6019-4b89-809a-9d29289647fe None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:32.556232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 656/1299] 10.222.0.83 () {56 vars in 1116 bytes} [Wed Jul 20 22:31:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:32.562954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685380b-0d0c-493d-bb03-36ec119b0d59 None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:32.594227 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:32.661341 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685380b-0d0c-493d-bb03-36ec119b0d59 None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:32.696313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad6c81-2af5-4c1e-9c08-ed70b527265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:32.696978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad6c81-2af5-4c1e-9c08-ed70b527265c None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:32.697263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad6c81-2af5-4c1e-9c08-ed70b527265c None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:32.697544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad6c81-2af5-4c1e-9c08-ed70b527265c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:32.698379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad6c81-2af5-4c1e-9c08-ed70b527265c None admin] RBAC: Adding query filter params (interface=public, service_id=ecf7c9f2e42c493dbeab79ec94a28dae, region_id=RegionOne) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:32.698700 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad6c81-2af5-4c1e-9c08-ed70b527265c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:32.700202 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad6c81-2af5-4c1e-9c08-ed70b527265c None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:32.705903 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 644/1300] 10.222.0.83 () {56 vars in 1251 bytes} [Wed Jul 20 22:31:32 2022] GET /identity/v3/endpoints?service_id=ecf7c9f2e42c493dbeab79ec94a28dae&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:32.711769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac669883-6019-4b89-809a-9d29289647fe None admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:32.795008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:32.813130 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac669883-6019-4b89-809a-9d29289647fe None admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:32.848326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eba269-8df0-41c0-897d-74e604971703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:32.849023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eba269-8df0-41c0-897d-74e604971703 None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:32.849305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eba269-8df0-41c0-897d-74e604971703 None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:32.849580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eba269-8df0-41c0-897d-74e604971703 None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:32.850301 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eba269-8df0-41c0-897d-74e604971703 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:32.851663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eba269-8df0-41c0-897d-74e604971703 None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:32.859850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 657/1301] 10.222.0.83 () {56 vars in 1087 bytes} [Wed Jul 20 22:31:32 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:31:34.939617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720bef-b6d6-4733-8d94-b001e3c65360 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:34.940179 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720bef-b6d6-4733-8d94-b001e3c65360 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:34.940179 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26720bef-b6d6-4733-8d94-b001e3c65360 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:34.941586 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 645/1302] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:31:34.946730 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5112a9e-8763-4522-83a6-3cbb2fd31577 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:34.947151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5112a9e-8763-4522-83a6-3cbb2fd31577 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:34.947299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5112a9e-8763-4522-83a6-3cbb2fd31577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:34.964578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b5112a9e-8763-4522-83a6-3cbb2fd31577 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:31:34.965909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b5112a9e-8763-4522-83a6-3cbb2fd31577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:31:35.034796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 658/1303] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:31:34 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 22:31:35.058418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26720bef-b6d6-4733-8d94-b001e3c65360 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:35.153897 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:35.160575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26720bef-b6d6-4733-8d94-b001e3c65360 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:35.194894 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892d96a-2218-49e8-a739-d94353e18c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:35.195617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892d96a-2218-49e8-a739-d94353e18c4a None admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:35.195896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892d96a-2218-49e8-a739-d94353e18c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:35.196168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892d96a-2218-49e8-a739-d94353e18c4a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:35.196834 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892d96a-2218-49e8-a739-d94353e18c4a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:35.198529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a892d96a-2218-49e8-a739-d94353e18c4a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application [None req-a892d96a-2218-49e8-a739-d94353e18c4a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 22:31:35.211564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 22:31:35.212833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application with Lock( Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self._enter() Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application return self.creator() Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application created_value = creator( Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: ERROR keystone.server.flask.application Jul 20 22:31:35.213974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 646/1304] 10.222.0.83 () {56 vars in 1117 bytes} [Wed Jul 20 22:31:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 22:31:35.219562 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5112a9e-8763-4522-83a6-3cbb2fd31577 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:35.296801 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:35.319107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5112a9e-8763-4522-83a6-3cbb2fd31577 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:35.352725 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae744cbb-e7df-4753-8b18-602e3ddfb91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:35.353393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae744cbb-e7df-4753-8b18-602e3ddfb91d None admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:35.353676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae744cbb-e7df-4753-8b18-602e3ddfb91d None admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:35.353986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae744cbb-e7df-4753-8b18-602e3ddfb91d None admin] PATH_INFO: `/v3/services` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:35.354687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae744cbb-e7df-4753-8b18-602e3ddfb91d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:31:35.354998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae744cbb-e7df-4753-8b18-602e3ddfb91d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:35.357215 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae744cbb-e7df-4753-8b18-602e3ddfb91d None admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:35.362612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 659/1305] 10.222.0.83 () {56 vars in 1116 bytes} [Wed Jul 20 22:31:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:31:35.368473 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892d96a-2218-49e8-a739-d94353e18c4a None admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:31:35.470851 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892d96a-2218-49e8-a739-d94353e18c4a None admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:31:35.504983 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50725e0-200f-4bf2-b2b0-53397319ac3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:31:35.505650 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50725e0-200f-4bf2-b2b0-53397319ac3a None admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:31:35.505968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50725e0-200f-4bf2-b2b0-53397319ac3a None admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:31:35.506253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50725e0-200f-4bf2-b2b0-53397319ac3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:31:35.511969 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50725e0-200f-4bf2-b2b0-53397319ac3a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:31:35.511969 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50725e0-200f-4bf2-b2b0-53397319ac3a None admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:31:35.605703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 647/1306] 10.222.0.83 () {60 vars in 1144 bytes} [Wed Jul 20 22:31:35 2022] POST /identity/v3/endpoints => generated 331 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:31:45.359391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=30 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:31:45.600673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:30.586688 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16de46-be8f-437b-bfe9-b87e24b7d9a6 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:30.587111 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16de46-be8f-437b-bfe9-b87e24b7d9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:30.587342 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16de46-be8f-437b-bfe9-b87e24b7d9a6 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:30.589029 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 660/1307] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:38:30.595638 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbba276-fb10-4a0e-bc68-2504594caa08 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:30.596174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbba276-fb10-4a0e-bc68-2504594caa08 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:30.596599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbba276-fb10-4a0e-bc68-2504594caa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:30.771198 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-dfbba276-fb10-4a0e-bc68-2504594caa08 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:38:30.772305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dfbba276-fb10-4a0e-bc68-2504594caa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:30.962301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 648/1308] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:38:31.015168 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a76b1a-0405-4db6-b3ab-3a68d20c974f None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:31.015804 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a76b1a-0405-4db6-b3ab-3a68d20c974f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:31.016291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a76b1a-0405-4db6-b3ab-3a68d20c974f None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:31.018228 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 661/1309] 10.222.0.83 () {54 vars in 965 bytes} [Wed Jul 20 22:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:38:31.024768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae2f2e-976e-40b0-9597-a5d10e461d84 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:31.025057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae2f2e-976e-40b0-9597-a5d10e461d84 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:31.025396 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae2f2e-976e-40b0-9597-a5d10e461d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:31.133030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-95ae2f2e-976e-40b0-9597-a5d10e461d84 None None] MFA Rules not processed for user `d3faac5703c54396bcdba9e149a6d35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:38:31.134345 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-95ae2f2e-976e-40b0-9597-a5d10e461d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:31.160769 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:31.223818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 649/1310] 10.222.0.83 () {58 vars in 1062 bytes} [Wed Jul 20 22:38:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:38:31.232715 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a76b1a-0405-4db6-b3ab-3a68d20c974f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:38:31.235324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e1a76b1a-0405-4db6-b3ab-3a68d20c974f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:31.372591 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a76b1a-0405-4db6-b3ab-3a68d20c974f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:38:31.470015 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10159919-8967-432b-8fea-d6a614a470f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:38:31.470684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10159919-8967-432b-8fea-d6a614a470f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:31.470962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10159919-8967-432b-8fea-d6a614a470f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:31.471236 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10159919-8967-432b-8fea-d6a614a470f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:31.473387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-10159919-8967-432b-8fea-d6a614a470f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:31.545560 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:31.622382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10159919-8967-432b-8fea-d6a614a470f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:38:31.624180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10159919-8967-432b-8fea-d6a614a470f2 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:38:31.647503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 662/1311] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:38:34.044159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a82a3-6321-46f0-ac05-2bf491fc1fcb None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:34.044709 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a82a3-6321-46f0-ac05-2bf491fc1fcb None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:34.044709 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a82a3-6321-46f0-ac05-2bf491fc1fcb None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:34.046726 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 650/1312] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:38:34.052551 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd637db-e85c-489e-8a5e-d5602b51d343 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:34.053126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd637db-e85c-489e-8a5e-d5602b51d343 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:34.053304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd637db-e85c-489e-8a5e-d5602b51d343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:34.134059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7cd637db-e85c-489e-8a5e-d5602b51d343 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:38:34.135299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7cd637db-e85c-489e-8a5e-d5602b51d343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:34.238133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 663/1313] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:38:34.278362 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a82a3-6321-46f0-ac05-2bf491fc1fcb None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:38:34.280002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c42a82a3-6321-46f0-ac05-2bf491fc1fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:34.390135 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a82a3-6321-46f0-ac05-2bf491fc1fcb None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:38:34.465675 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:34.468327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74c4da-9ee6-42e2-a3eb-d548c74de012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:38:34.469086 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74c4da-9ee6-42e2-a3eb-d548c74de012 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:34.469266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74c4da-9ee6-42e2-a3eb-d548c74de012 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:34.469781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74c4da-9ee6-42e2-a3eb-d548c74de012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:34.471265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bf74c4da-9ee6-42e2-a3eb-d548c74de012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:34.583386 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74c4da-9ee6-42e2-a3eb-d548c74de012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:38:34.584832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74c4da-9ee6-42e2-a3eb-d548c74de012 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:38:34.602309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 651/1314] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:38:37.189976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a33c6a-3edb-4abe-b631-d1ae15df86a2 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:37.190554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a33c6a-3edb-4abe-b631-d1ae15df86a2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:37.190554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a33c6a-3edb-4abe-b631-d1ae15df86a2 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:37.191931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 664/1315] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:38:37.197129 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73234afd-aee2-4dba-9a5f-355f66a0f216 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:37.197553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73234afd-aee2-4dba-9a5f-355f66a0f216 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:37.197673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73234afd-aee2-4dba-9a5f-355f66a0f216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:37.261127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-73234afd-aee2-4dba-9a5f-355f66a0f216 None None] MFA Rules not processed for user `35d4d449311544628df57904899e79de`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:38:37.262366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-73234afd-aee2-4dba-9a5f-355f66a0f216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:37.313614 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:37.357153 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 652/1316] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:38:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:38:37.413440 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a79a7-4ae8-47cc-b133-1b570d1ec058 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:37.413744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a79a7-4ae8-47cc-b133-1b570d1ec058 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:37.414032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a79a7-4ae8-47cc-b133-1b570d1ec058 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:37.415432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 665/1317] 10.222.0.83 () {54 vars in 965 bytes} [Wed Jul 20 22:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:38:37.422544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e30c9-7b53-442a-9b63-bc5c1bfbaf94 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:37.422832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e30c9-7b53-442a-9b63-bc5c1bfbaf94 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:37.423114 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393e30c9-7b53-442a-9b63-bc5c1bfbaf94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:37.496530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-393e30c9-7b53-442a-9b63-bc5c1bfbaf94 None None] MFA Rules not processed for user `d3faac5703c54396bcdba9e149a6d35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:38:37.498026 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-393e30c9-7b53-442a-9b63-bc5c1bfbaf94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:37.572802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 653/1318] 10.222.0.83 () {58 vars in 1062 bytes} [Wed Jul 20 22:38:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:38:37.581958 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a79a7-4ae8-47cc-b133-1b570d1ec058 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:38:37.583533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-aa4a79a7-4ae8-47cc-b133-1b570d1ec058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:37.593886 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:37.690541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a79a7-4ae8-47cc-b133-1b570d1ec058 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:38:37.763853 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a2323-b8a1-46f8-b149-c750e18a4a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:38:37.765198 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a2323-b8a1-46f8-b149-c750e18a4a21 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:37.765468 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a2323-b8a1-46f8-b149-c750e18a4a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:37.765764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a2323-b8a1-46f8-b149-c750e18a4a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:37.767475 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b22a2323-b8a1-46f8-b149-c750e18a4a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:37.831944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:37.878614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a2323-b8a1-46f8-b149-c750e18a4a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:38:37.880051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a2323-b8a1-46f8-b149-c750e18a4a21 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:38:37.898149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 666/1319] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:38:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:38:41.299960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39474e93-cb0f-440c-a094-7a5262756fa6 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:41.300556 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39474e93-cb0f-440c-a094-7a5262756fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:41.300556 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39474e93-cb0f-440c-a094-7a5262756fa6 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:41.301930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 654/1320] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:38:41.307160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605a99d-9b1e-4493-af96-cd8a1eb9c0f4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:41.307610 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605a99d-9b1e-4493-af96-cd8a1eb9c0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:41.307716 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0605a99d-9b1e-4493-af96-cd8a1eb9c0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:41.375409 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0605a99d-9b1e-4493-af96-cd8a1eb9c0f4 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:38:41.376523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0605a99d-9b1e-4493-af96-cd8a1eb9c0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:41.475373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 667/1321] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:38:41 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:38:41.516140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39474e93-cb0f-440c-a094-7a5262756fa6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:38:41.517694 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-39474e93-cb0f-440c-a094-7a5262756fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:41.568355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:41.622367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39474e93-cb0f-440c-a094-7a5262756fa6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:38:41.694628 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccbaf73-84eb-4e8e-9340-d6fa42e41fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:38:41.695301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbaf73-84eb-4e8e-9340-d6fa42e41fdf service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:41.695585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbaf73-84eb-4e8e-9340-d6fa42e41fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:41.695884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccbaf73-84eb-4e8e-9340-d6fa42e41fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:41.697703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9ccbaf73-84eb-4e8e-9340-d6fa42e41fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:41.794662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:41.808201 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbaf73-84eb-4e8e-9340-d6fa42e41fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:38:41.810320 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccbaf73-84eb-4e8e-9340-d6fa42e41fdf service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:38:41.828753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 655/1322] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:38:41 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:38:45.072932 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de21cb9-916f-4f9f-974f-059f17ee02ce None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:45.073492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de21cb9-916f-4f9f-974f-059f17ee02ce None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:45.073492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de21cb9-916f-4f9f-974f-059f17ee02ce None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:45.074906 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 668/1323] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:38:45.080721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e6c19-68dc-4d23-898b-8ae225ec337a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:45.080721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e6c19-68dc-4d23-898b-8ae225ec337a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:45.081212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060e6c19-68dc-4d23-898b-8ae225ec337a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:45.146974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-060e6c19-68dc-4d23-898b-8ae225ec337a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:38:45.148170 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-060e6c19-68dc-4d23-898b-8ae225ec337a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:45.246080 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 656/1324] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:38:45.282410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de21cb9-916f-4f9f-974f-059f17ee02ce None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:38:45.283935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4de21cb9-916f-4f9f-974f-059f17ee02ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:45.303413 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:45.392753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de21cb9-916f-4f9f-974f-059f17ee02ce None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:38:45.473395 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f24456-a232-440b-8cd1-aec94e050ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:38:45.474096 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24456-a232-440b-8cd1-aec94e050ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:45.474391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24456-a232-440b-8cd1-aec94e050ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:45.474763 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f24456-a232-440b-8cd1-aec94e050ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:45.476680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-96f24456-a232-440b-8cd1-aec94e050ef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:45.554559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:45.593654 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f24456-a232-440b-8cd1-aec94e050ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:38:45.595241 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f24456-a232-440b-8cd1-aec94e050ef1 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:38:45.614293 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 669/1325] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:38:47.759706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b22d07-6f13-414f-8c36-a2d098f88f0b None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:47.760261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b22d07-6f13-414f-8c36-a2d098f88f0b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:47.760413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b22d07-6f13-414f-8c36-a2d098f88f0b None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:47.761816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 657/1326] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:38:47.767371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b160271-9ba2-4333-8164-e7bcdab1fafa None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:47.767843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b160271-9ba2-4333-8164-e7bcdab1fafa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:47.767940 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b160271-9ba2-4333-8164-e7bcdab1fafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:47.835231 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8b160271-9ba2-4333-8164-e7bcdab1fafa None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:38:47.836459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8b160271-9ba2-4333-8164-e7bcdab1fafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:47.938615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 670/1327] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:38:47.975686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b22d07-6f13-414f-8c36-a2d098f88f0b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:38:47.977215 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-22b22d07-6f13-414f-8c36-a2d098f88f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:48.037928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:48.083877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b22d07-6f13-414f-8c36-a2d098f88f0b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:38:48.161217 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab91af-d73e-419c-baef-c3f3cccf70a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:38:48.161900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab91af-d73e-419c-baef-c3f3cccf70a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:48.162191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab91af-d73e-419c-baef-c3f3cccf70a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:48.162469 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab91af-d73e-419c-baef-c3f3cccf70a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:48.164131 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4cab91af-d73e-419c-baef-c3f3cccf70a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:48.274422 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:48.278037 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab91af-d73e-419c-baef-c3f3cccf70a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:38:48.280156 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab91af-d73e-419c-baef-c3f3cccf70a6 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:38:48.301850 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 658/1328] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:38:50.449192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441128c5-369e-4fdf-9425-6220d566aa3c None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:50.449764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441128c5-369e-4fdf-9425-6220d566aa3c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:50.449863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441128c5-369e-4fdf-9425-6220d566aa3c None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:50.451399 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 671/1329] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:38:50.457211 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538f38f-42c7-4427-bcda-36aff0a176fc None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:50.457678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538f38f-42c7-4427-bcda-36aff0a176fc None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:50.457830 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538f38f-42c7-4427-bcda-36aff0a176fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:50.527709 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-5538f38f-42c7-4427-bcda-36aff0a176fc None None] MFA Rules not processed for user `35d4d449311544628df57904899e79de`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:38:50.530744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5538f38f-42c7-4427-bcda-36aff0a176fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:50.632221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 659/1330] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:38:50 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:38:50.671980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441128c5-369e-4fdf-9425-6220d566aa3c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:38:50.673508 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-441128c5-369e-4fdf-9425-6220d566aa3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:50.705821 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:50.784178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441128c5-369e-4fdf-9425-6220d566aa3c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:38:50.860441 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf84f06-ec73-4100-90e8-81104c4bbb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:38:50.861117 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf84f06-ec73-4100-90e8-81104c4bbb46 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:50.861396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf84f06-ec73-4100-90e8-81104c4bbb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:50.861666 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf84f06-ec73-4100-90e8-81104c4bbb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:50.863327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2bf84f06-ec73-4100-90e8-81104c4bbb46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:50.945568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:50.979261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf84f06-ec73-4100-90e8-81104c4bbb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:38:50.980741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf84f06-ec73-4100-90e8-81104c4bbb46 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:38:50.999807 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 672/1331] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:38:50 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:38:53.588667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed52c9-ed1b-4652-bca3-5ff3c8f4acd8 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:53.589208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed52c9-ed1b-4652-bca3-5ff3c8f4acd8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:53.589208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed52c9-ed1b-4652-bca3-5ff3c8f4acd8 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:53.590634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 660/1332] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:38:53.596411 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c92f0-b7c0-413b-b918-c72042aaad2a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:53.596835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c92f0-b7c0-413b-b918-c72042aaad2a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:53.596970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c92f0-b7c0-413b-b918-c72042aaad2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:53.660757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b01c92f0-b7c0-413b-b918-c72042aaad2a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:38:53.661991 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b01c92f0-b7c0-413b-b918-c72042aaad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:53.757815 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 673/1333] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:38:53.794575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed52c9-ed1b-4652-bca3-5ff3c8f4acd8 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:38:53.796038 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-55ed52c9-ed1b-4652-bca3-5ff3c8f4acd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:53.866721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:53.901454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed52c9-ed1b-4652-bca3-5ff3c8f4acd8 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:38:53.979273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68d2c0-cdb2-46c1-a4e9-7c5b3291f7ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:38:53.979940 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68d2c0-cdb2-46c1-a4e9-7c5b3291f7ca service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:53.980229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68d2c0-cdb2-46c1-a4e9-7c5b3291f7ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:53.980511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68d2c0-cdb2-46c1-a4e9-7c5b3291f7ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:53.982218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2e68d2c0-cdb2-46c1-a4e9-7c5b3291f7ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:54.091244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68d2c0-cdb2-46c1-a4e9-7c5b3291f7ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:38:54.092692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68d2c0-cdb2-46c1-a4e9-7c5b3291f7ca service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:38:54.103306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:54.111870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 661/1334] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:38:56.242609 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06257e10-6f5d-43ab-b345-bce8d1915926 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:56.243181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06257e10-6f5d-43ab-b345-bce8d1915926 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:56.243181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06257e10-6f5d-43ab-b345-bce8d1915926 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:56.244567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 674/1335] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:38:56.250280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d0f95-b9f3-46c6-947d-eb3e61971a4e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:56.250692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d0f95-b9f3-46c6-947d-eb3e61971a4e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:56.250841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d0f95-b9f3-46c6-947d-eb3e61971a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:56.321439 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0f5d0f95-b9f3-46c6-947d-eb3e61971a4e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:38:56.322692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0f5d0f95-b9f3-46c6-947d-eb3e61971a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:56.423208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 662/1336] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:38:56.463795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06257e10-6f5d-43ab-b345-bce8d1915926 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:38:56.465361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-06257e10-6f5d-43ab-b345-bce8d1915926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:56.508851 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:56.573064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06257e10-6f5d-43ab-b345-bce8d1915926 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:38:56.647782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae1aca-9e55-4396-bf04-215efde47516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:38:56.648436 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae1aca-9e55-4396-bf04-215efde47516 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:56.648717 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae1aca-9e55-4396-bf04-215efde47516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:56.648990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae1aca-9e55-4396-bf04-215efde47516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:56.650677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d8ae1aca-9e55-4396-bf04-215efde47516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:56.732265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:56.758486 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae1aca-9e55-4396-bf04-215efde47516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:38:56.759932 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae1aca-9e55-4396-bf04-215efde47516 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:38:56.780857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 675/1337] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:38:59.544729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4af0-9b2a-4b0c-8062-06f2e22a7c7d None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:59.545359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4af0-9b2a-4b0c-8062-06f2e22a7c7d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:59.545359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4af0-9b2a-4b0c-8062-06f2e22a7c7d None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:59.547958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 663/1338] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:38:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:38:59.553186 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ba59a-ae63-4aac-9116-48b6c62545b5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:59.553698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ba59a-ae63-4aac-9116-48b6c62545b5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:59.553858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ba59a-ae63-4aac-9116-48b6c62545b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:59.619512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-636ba59a-ae63-4aac-9116-48b6c62545b5 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:38:59.620737 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-636ba59a-ae63-4aac-9116-48b6c62545b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:59.716581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 676/1339] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:38:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:38:59.754655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d4af0-9b2a-4b0c-8062-06f2e22a7c7d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:38:59.756280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-261d4af0-9b2a-4b0c-8062-06f2e22a7c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:38:59.837193 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:38:59.865974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d4af0-9b2a-4b0c-8062-06f2e22a7c7d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:38:59.939757 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92901b-2bd4-4915-90e2-fe7e8b42f5ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:38:59.940411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92901b-2bd4-4915-90e2-fe7e8b42f5ce service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:38:59.940697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92901b-2bd4-4915-90e2-fe7e8b42f5ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:38:59.940978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92901b-2bd4-4915-90e2-fe7e8b42f5ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:38:59.942672 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6c92901b-2bd4-4915-90e2-fe7e8b42f5ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:00.051433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92901b-2bd4-4915-90e2-fe7e8b42f5ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:00.052872 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c92901b-2bd4-4915-90e2-fe7e8b42f5ce service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:00.072271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 664/1340] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:38:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:04.302804 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cbb2f-bc98-42a7-974c-037bc115b2aa None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:04.303319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cbb2f-bc98-42a7-974c-037bc115b2aa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:04.303319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cbb2f-bc98-42a7-974c-037bc115b2aa None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:04.304808 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 677/1341] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:04.310203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f808a1-c279-4f6f-8a98-52766824fb4c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:04.310702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f808a1-c279-4f6f-8a98-52766824fb4c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:04.310798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f808a1-c279-4f6f-8a98-52766824fb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:04.316135 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:04.379786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-58f808a1-c279-4f6f-8a98-52766824fb4c None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:04.380712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-58f808a1-c279-4f6f-8a98-52766824fb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:04.489913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 665/1342] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:04.527660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cbb2f-bc98-42a7-974c-037bc115b2aa None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:04.527660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4d9cbb2f-bc98-42a7-974c-037bc115b2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:04.586070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:04.645456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cbb2f-bc98-42a7-974c-037bc115b2aa None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:04.723976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a0258-1948-48eb-9fd5-8214db7701dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:04.724624 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a0258-1948-48eb-9fd5-8214db7701dd service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:04.724902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a0258-1948-48eb-9fd5-8214db7701dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:04.725173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a0258-1948-48eb-9fd5-8214db7701dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:04.726840 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2b9a0258-1948-48eb-9fd5-8214db7701dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:04.821276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:04.837471 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a0258-1948-48eb-9fd5-8214db7701dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:04.838959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a0258-1948-48eb-9fd5-8214db7701dd service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:04.857841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 678/1343] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:07.986488 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a54ee1-bb9d-4398-a793-28f319783f7a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:07.987028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a54ee1-bb9d-4398-a793-28f319783f7a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:07.987028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a54ee1-bb9d-4398-a793-28f319783f7a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:07.988468 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 666/1344] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:07.993842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7559e1-c852-4134-a934-37f162aba44c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:07.994273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7559e1-c852-4134-a934-37f162aba44c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:07.994407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7559e1-c852-4134-a934-37f162aba44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:08.063380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3c7559e1-c852-4134-a934-37f162aba44c None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:08.064494 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3c7559e1-c852-4134-a934-37f162aba44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:08.170056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 679/1345] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:08.208814 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a54ee1-bb9d-4398-a793-28f319783f7a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:08.210386 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-81a54ee1-bb9d-4398-a793-28f319783f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:08.301833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:08.319448 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a54ee1-bb9d-4398-a793-28f319783f7a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:08.397344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee4678d-76db-41e5-b3ce-7b2729fccf34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:08.398253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4678d-76db-41e5-b3ce-7b2729fccf34 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:08.398504 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4678d-76db-41e5-b3ce-7b2729fccf34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:08.398778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee4678d-76db-41e5-b3ce-7b2729fccf34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:08.400561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1ee4678d-76db-41e5-b3ce-7b2729fccf34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:08.518953 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4678d-76db-41e5-b3ce-7b2729fccf34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:08.520443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee4678d-76db-41e5-b3ce-7b2729fccf34 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:08.540171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 667/1346] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:13.306875 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c51d4-f44c-4dc0-acdc-5c5cdb6e7286 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:13.307451 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c51d4-f44c-4dc0-acdc-5c5cdb6e7286 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:13.307566 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c51d4-f44c-4dc0-acdc-5c5cdb6e7286 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:13.309018 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 680/1347] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:13.315168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6223330-f6fc-4373-97c4-df1367c569ef None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:13.315691 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6223330-f6fc-4373-97c4-df1367c569ef None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:13.315795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6223330-f6fc-4373-97c4-df1367c569ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:13.330992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:13.394016 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b6223330-f6fc-4373-97c4-df1367c569ef None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:13.395080 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b6223330-f6fc-4373-97c4-df1367c569ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:13.507736 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 668/1348] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:13.547319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c51d4-f44c-4dc0-acdc-5c5cdb6e7286 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:13.548852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fe4c51d4-f44c-4dc0-acdc-5c5cdb6e7286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:13.611280 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:13.662663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c51d4-f44c-4dc0-acdc-5c5cdb6e7286 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:13.747477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af236d-a3ce-44d7-9637-30399f3495ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:13.748489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af236d-a3ce-44d7-9637-30399f3495ab service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:13.748837 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af236d-a3ce-44d7-9637-30399f3495ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:13.750009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af236d-a3ce-44d7-9637-30399f3495ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:13.752392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-26af236d-a3ce-44d7-9637-30399f3495ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:13.864692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:13.868267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af236d-a3ce-44d7-9637-30399f3495ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:13.869841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af236d-a3ce-44d7-9637-30399f3495ab service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:13.890919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 681/1349] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:39:18.991278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6987d8f-6640-4a8b-9596-8995c2d58c96 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:18.991855 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6987d8f-6640-4a8b-9596-8995c2d58c96 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:18.991956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6987d8f-6640-4a8b-9596-8995c2d58c96 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:18.993624 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 669/1350] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 20 22:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:19.000217 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49ee81-47e2-48a2-a132-ea4449b639b4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:19.000693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49ee81-47e2-48a2-a132-ea4449b639b4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:19.000693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf49ee81-47e2-48a2-a132-ea4449b639b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:19.102914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-cf49ee81-47e2-48a2-a132-ea4449b639b4 None None] MFA Rules not processed for user `65c9898ccf874dce88f08bebdbae02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:19.104216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cf49ee81-47e2-48a2-a132-ea4449b639b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:19.236573 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 682/1351] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 20 22:39:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:23.496218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5686a4-13a1-4d8d-837a-6cb4d04f0a21 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:23.496791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5686a4-13a1-4d8d-837a-6cb4d04f0a21 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:23.497189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5686a4-13a1-4d8d-837a-6cb4d04f0a21 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:23.499706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 670/1352] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 20 22:39:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:23.504516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c23e1-4480-43db-a86f-507283b22448 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:23.504976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c23e1-4480-43db-a86f-507283b22448 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:23.505272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c23e1-4480-43db-a86f-507283b22448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:23.505537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=59 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:23.561707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:23.588025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ab5c23e1-4480-43db-a86f-507283b22448 None None] MFA Rules not processed for user `65c9898ccf874dce88f08bebdbae02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:23.590306 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ab5c23e1-4480-43db-a86f-507283b22448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:23.716245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 683/1353] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 20 22:39:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:24.904293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455efc-0fbf-4cfe-b06a-ca0141c749d5 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:24.904822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455efc-0fbf-4cfe-b06a-ca0141c749d5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:24.904822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4455efc-0fbf-4cfe-b06a-ca0141c749d5 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:24.907145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 671/1354] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 20 22:39:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:24.912243 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b1aa9-277b-444d-862b-d72e2adf5872 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:24.912679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b1aa9-277b-444d-862b-d72e2adf5872 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:24.912802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405b1aa9-277b-444d-862b-d72e2adf5872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:24.990089 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-405b1aa9-277b-444d-862b-d72e2adf5872 None None] MFA Rules not processed for user `65c9898ccf874dce88f08bebdbae02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:24.991349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-405b1aa9-277b-444d-862b-d72e2adf5872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:25.034073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:25.111071 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 684/1355] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 20 22:39:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:39:28.700148 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af799a07-52c8-4489-b8f4-c7056969ffc8 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:28.700713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af799a07-52c8-4489-b8f4-c7056969ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:28.700713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af799a07-52c8-4489-b8f4-c7056969ffc8 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:28.703543 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 672/1356] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:28.708911 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ef52c-1834-4920-a2a7-a8b0bdc64ed3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:28.709426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ef52c-1834-4920-a2a7-a8b0bdc64ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:28.709529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ef52c-1834-4920-a2a7-a8b0bdc64ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:28.783898 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-db4ef52c-1834-4920-a2a7-a8b0bdc64ed3 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:28.785160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-db4ef52c-1834-4920-a2a7-a8b0bdc64ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:28.893799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 685/1357] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:28.958238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7225d-87b1-4fbd-b8af-c07d7819ea71 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:28.958813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7225d-87b1-4fbd-b8af-c07d7819ea71 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:28.959307 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7225d-87b1-4fbd-b8af-c07d7819ea71 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:28.961433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 673/1358] 10.222.0.83 () {54 vars in 962 bytes} [Wed Jul 20 22:39:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:28.977441 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f79a3f-63f7-4ba3-8c20-79dd950133d5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:28.978367 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f79a3f-63f7-4ba3-8c20-79dd950133d5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:28.987274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f79a3f-63f7-4ba3-8c20-79dd950133d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:28.994896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:29.062193 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b7f79a3f-63f7-4ba3-8c20-79dd950133d5 None None] MFA Rules not processed for user `67c92c8d2b9d41e489e4c03ae4e71fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:29.063622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b7f79a3f-63f7-4ba3-8c20-79dd950133d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:29.198014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 686/1359] 10.222.0.83 () {58 vars in 1059 bytes} [Wed Jul 20 22:39:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:39:29.204393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7225d-87b1-4fbd-b8af-c07d7819ea71 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:29.206099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e8a7225d-87b1-4fbd-b8af-c07d7819ea71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:29.379237 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7225d-87b1-4fbd-b8af-c07d7819ea71 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:29.462318 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:29.513639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d42c94-eb03-4420-9647-51baff0f5cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:29.514585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d42c94-eb03-4420-9647-51baff0f5cc8 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:29.514924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d42c94-eb03-4420-9647-51baff0f5cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:29.515267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d42c94-eb03-4420-9647-51baff0f5cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:29.517036 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a4d42c94-eb03-4420-9647-51baff0f5cc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:29.615666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d42c94-eb03-4420-9647-51baff0f5cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:29.617587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d42c94-eb03-4420-9647-51baff0f5cc8 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:29.638288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 674/1360] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:31.908345 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11a5f9-3925-458e-81fd-4555b6a6b9df None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:31.908889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11a5f9-3925-458e-81fd-4555b6a6b9df None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:31.908889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11a5f9-3925-458e-81fd-4555b6a6b9df None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:31.910412 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 687/1361] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:31.915539 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b71c44-5033-4d45-8435-f072b39d2442 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:31.916003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b71c44-5033-4d45-8435-f072b39d2442 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:31.916290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b71c44-5033-4d45-8435-f072b39d2442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:31.987160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-86b71c44-5033-4d45-8435-f072b39d2442 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:31.988527 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-86b71c44-5033-4d45-8435-f072b39d2442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:32.027678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:32.117771 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 675/1362] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:32.162305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11a5f9-3925-458e-81fd-4555b6a6b9df None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:32.163748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ea11a5f9-3925-458e-81fd-4555b6a6b9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:32.236634 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:32.326585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11a5f9-3925-458e-81fd-4555b6a6b9df None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:32.463631 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603767ce-a052-418b-8d1e-2d09920c16cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:32.464303 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603767ce-a052-418b-8d1e-2d09920c16cc service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:32.464584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603767ce-a052-418b-8d1e-2d09920c16cc service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:32.464857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603767ce-a052-418b-8d1e-2d09920c16cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:32.466667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-603767ce-a052-418b-8d1e-2d09920c16cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:32.493390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:32.568775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603767ce-a052-418b-8d1e-2d09920c16cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:32.570529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603767ce-a052-418b-8d1e-2d09920c16cc service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:32.591176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 688/1363] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:35.179091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ded85-fb4a-4c85-b00f-b51b28fa18a8 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:35.179613 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ded85-fb4a-4c85-b00f-b51b28fa18a8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:35.179697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ded85-fb4a-4c85-b00f-b51b28fa18a8 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:35.181028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 676/1364] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:35.186292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3ac7a-fe87-4d59-92e9-5a183c89e28e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:35.186936 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3ac7a-fe87-4d59-92e9-5a183c89e28e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:35.186936 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3ac7a-fe87-4d59-92e9-5a183c89e28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:35.256440 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1ca3ac7a-fe87-4d59-92e9-5a183c89e28e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:35.257668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1ca3ac7a-fe87-4d59-92e9-5a183c89e28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:35.364157 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:35.378096 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 689/1365] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:35.423134 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c94f8f-af29-43c5-a207-7605830c2012 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:35.423420 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c94f8f-af29-43c5-a207-7605830c2012 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:35.423702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c94f8f-af29-43c5-a207-7605830c2012 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:35.425312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 677/1366] 10.222.0.83 () {54 vars in 962 bytes} [Wed Jul 20 22:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:35.430920 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432c394-2c9f-42ae-9f06-5e765e7c6422 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:35.431312 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432c394-2c9f-42ae-9f06-5e765e7c6422 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:35.431680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432c394-2c9f-42ae-9f06-5e765e7c6422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:35.513239 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e432c394-2c9f-42ae-9f06-5e765e7c6422 None None] MFA Rules not processed for user `67c92c8d2b9d41e489e4c03ae4e71fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:35.515166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e432c394-2c9f-42ae-9f06-5e765e7c6422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:35.650685 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 690/1367] 10.222.0.83 () {58 vars in 1059 bytes} [Wed Jul 20 22:39:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:35.659544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c94f8f-af29-43c5-a207-7605830c2012 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:35.661277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-32c94f8f-af29-43c5-a207-7605830c2012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:35.820505 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c94f8f-af29-43c5-a207-7605830c2012 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:35.841938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:35.945026 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b4ded-3a8b-47a3-b8fc-de3da2f0e8ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:35.945686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b4ded-3a8b-47a3-b8fc-de3da2f0e8ed service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:35.955176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b4ded-3a8b-47a3-b8fc-de3da2f0e8ed service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:35.955176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b4ded-3a8b-47a3-b8fc-de3da2f0e8ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:35.955176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0a2b4ded-3a8b-47a3-b8fc-de3da2f0e8ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:36.056000 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b4ded-3a8b-47a3-b8fc-de3da2f0e8ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:36.057676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b4ded-3a8b-47a3-b8fc-de3da2f0e8ed service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:36.088831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 678/1368] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:37.034305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1005ac-8904-481c-9537-4c85312bf352 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:37.034896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1005ac-8904-481c-9537-4c85312bf352 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:37.035172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1005ac-8904-481c-9537-4c85312bf352 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:37.036934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 691/1369] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:37.042170 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9218118-0a2f-417b-ba48-e0588cc8a3bd None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:37.042708 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9218118-0a2f-417b-ba48-e0588cc8a3bd None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:37.042822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9218118-0a2f-417b-ba48-e0588cc8a3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:37.084587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:37.118403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e9218118-0a2f-417b-ba48-e0588cc8a3bd None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:37.119643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e9218118-0a2f-417b-ba48-e0588cc8a3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:37.227428 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 679/1370] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:39:37.586122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddcb11-2611-4d67-9142-e370f3aa80ba None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:37.586122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddcb11-2611-4d67-9142-e370f3aa80ba None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:37.586122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddcb11-2611-4d67-9142-e370f3aa80ba None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:37.589769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 692/1371] 10.222.0.83 () {54 vars in 964 bytes} [Wed Jul 20 22:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:37.592236 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7367e-8efe-4b0b-8988-a5d3fe04ae83 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:37.593141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7367e-8efe-4b0b-8988-a5d3fe04ae83 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:37.593634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e7367e-8efe-4b0b-8988-a5d3fe04ae83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:37.674336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-00e7367e-8efe-4b0b-8988-a5d3fe04ae83 None None] MFA Rules not processed for user `12ab5b94b21b466e8070771a61378e89`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:37.675604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-00e7367e-8efe-4b0b-8988-a5d3fe04ae83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:37.727569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:37.760984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 680/1372] 10.222.0.83 () {58 vars in 1061 bytes} [Wed Jul 20 22:39:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:37.769921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddcb11-2611-4d67-9142-e370f3aa80ba None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:37.772276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6eddcb11-2611-4d67-9142-e370f3aa80ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:37.829251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:37.897966 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddcb11-2611-4d67-9142-e370f3aa80ba None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:37.984713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47c335-69fa-4ede-a4fd-b9b459fbf567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:37.985531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47c335-69fa-4ede-a4fd-b9b459fbf567 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:37.985942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47c335-69fa-4ede-a4fd-b9b459fbf567 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:37.986317 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47c335-69fa-4ede-a4fd-b9b459fbf567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:37.989324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1c47c335-69fa-4ede-a4fd-b9b459fbf567 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:38.102679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:38.116034 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47c335-69fa-4ede-a4fd-b9b459fbf567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:38.117474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47c335-69fa-4ede-a4fd-b9b459fbf567 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:38.136940 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 693/1373] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:38.390376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a49ef-164d-4eef-8506-067a8b8c42ea None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:38.390376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a49ef-164d-4eef-8506-067a8b8c42ea None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:38.390376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a49ef-164d-4eef-8506-067a8b8c42ea None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:38.391263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 681/1374] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:38.397481 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649b783-9547-4dd5-a6e2-05dfdb480c11 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:38.397481 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649b783-9547-4dd5-a6e2-05dfdb480c11 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:38.397827 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6649b783-9547-4dd5-a6e2-05dfdb480c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:38.470055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6649b783-9547-4dd5-a6e2-05dfdb480c11 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:38.471190 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6649b783-9547-4dd5-a6e2-05dfdb480c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:38.586921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 694/1375] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:38.632582 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a49ef-164d-4eef-8506-067a8b8c42ea None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:38.634171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-066a49ef-164d-4eef-8506-067a8b8c42ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:38.788126 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a49ef-164d-4eef-8506-067a8b8c42ea None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:38.842227 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:38.906601 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24055d5e-3054-4df5-8f45-171039c005cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:38.907270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055d5e-3054-4df5-8f45-171039c005cc service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:38.907845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055d5e-3054-4df5-8f45-171039c005cc service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:38.907845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24055d5e-3054-4df5-8f45-171039c005cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:38.909610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-24055d5e-3054-4df5-8f45-171039c005cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:39.003574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24055d5e-3054-4df5-8f45-171039c005cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:39.005228 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24055d5e-3054-4df5-8f45-171039c005cc service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:39.023915 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 682/1376] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:41.250101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03b42d-55d8-46b5-aaa6-cdc0ece381fa None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:41.250619 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03b42d-55d8-46b5-aaa6-cdc0ece381fa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:41.250732 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03b42d-55d8-46b5-aaa6-cdc0ece381fa None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:41.252042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 695/1377] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:41.257563 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756b5ea-bc49-41fd-a1f5-cb449ce08cdb None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:41.258076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756b5ea-bc49-41fd-a1f5-cb449ce08cdb None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:41.258205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5756b5ea-bc49-41fd-a1f5-cb449ce08cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:41.347511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-5756b5ea-bc49-41fd-a1f5-cb449ce08cdb None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:41.348857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5756b5ea-bc49-41fd-a1f5-cb449ce08cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:41.357157 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:41.462067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 683/1378] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:41.508697 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03b42d-55d8-46b5-aaa6-cdc0ece381fa None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:41.510283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3e03b42d-55d8-46b5-aaa6-cdc0ece381fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:41.575544 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:41.666968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03b42d-55d8-46b5-aaa6-cdc0ece381fa None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:41.827528 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45cc2c-e36c-400f-ba41-f705e3b9b5fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:41.828532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45cc2c-e36c-400f-ba41-f705e3b9b5fd service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:41.828816 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45cc2c-e36c-400f-ba41-f705e3b9b5fd service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:41.830949 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45cc2c-e36c-400f-ba41-f705e3b9b5fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:41.830949 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bc45cc2c-e36c-400f-ba41-f705e3b9b5fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:41.853685 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:41.942178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45cc2c-e36c-400f-ba41-f705e3b9b5fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:41.943937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45cc2c-e36c-400f-ba41-f705e3b9b5fd service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:41.962840 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 696/1379] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:44.184822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ba8e9-9bf3-4c85-8e55-6bbf2d9fba7a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:44.185380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ba8e9-9bf3-4c85-8e55-6bbf2d9fba7a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:44.185380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ba8e9-9bf3-4c85-8e55-6bbf2d9fba7a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:44.187108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 684/1380] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:44.192413 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab4f7c-66d5-4c48-93c5-395bfc1dabe5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:44.192865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab4f7c-66d5-4c48-93c5-395bfc1dabe5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:44.192961 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab4f7c-66d5-4c48-93c5-395bfc1dabe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:44.263170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-78ab4f7c-66d5-4c48-93c5-395bfc1dabe5 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:44.264888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-78ab4f7c-66d5-4c48-93c5-395bfc1dabe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:44.362590 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:44.368517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 697/1381] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:44.413506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ba8e9-9bf3-4c85-8e55-6bbf2d9fba7a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:44.415473 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4c5ba8e9-9bf3-4c85-8e55-6bbf2d9fba7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:44.566847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:44.579392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ba8e9-9bf3-4c85-8e55-6bbf2d9fba7a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:44.716113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bc0ce-79ff-47fd-bc55-93af9715e49b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:44.716805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bc0ce-79ff-47fd-bc55-93af9715e49b service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:44.717093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bc0ce-79ff-47fd-bc55-93af9715e49b service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:44.717500 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bc0ce-79ff-47fd-bc55-93af9715e49b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:44.719805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b66bc0ce-79ff-47fd-bc55-93af9715e49b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:44.837207 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bc0ce-79ff-47fd-bc55-93af9715e49b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:44.838935 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bc0ce-79ff-47fd-bc55-93af9715e49b service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:44.854712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:44.865575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 685/1382] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:47.279515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f2ac-fbf6-4dee-86dc-4bbb92f47236 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:47.280503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f2ac-fbf6-4dee-86dc-4bbb92f47236 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:47.280503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699f2ac-fbf6-4dee-86dc-4bbb92f47236 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:47.282371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 698/1383] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:47.287688 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa76ff8-eb2c-4a33-bda1-a7fb502100ed None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:47.288140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa76ff8-eb2c-4a33-bda1-a7fb502100ed None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:47.288260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa76ff8-eb2c-4a33-bda1-a7fb502100ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:47.362519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-daa76ff8-eb2c-4a33-bda1-a7fb502100ed None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:47.363954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-daa76ff8-eb2c-4a33-bda1-a7fb502100ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:47.472727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 686/1384] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:47.516113 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699f2ac-fbf6-4dee-86dc-4bbb92f47236 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:47.517634 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f699f2ac-fbf6-4dee-86dc-4bbb92f47236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:47.668698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699f2ac-fbf6-4dee-86dc-4bbb92f47236 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:47.747098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:47.801688 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb0036-8425-4891-8dfd-554f83135f14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:47.802372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb0036-8425-4891-8dfd-554f83135f14 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:47.802652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb0036-8425-4891-8dfd-554f83135f14 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:47.802922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb0036-8425-4891-8dfd-554f83135f14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:47.804576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-86bb0036-8425-4891-8dfd-554f83135f14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:47.896791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb0036-8425-4891-8dfd-554f83135f14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:47.898450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb0036-8425-4891-8dfd-554f83135f14 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:47.917224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 699/1385] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:49.982123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0de1b-7b62-4e3a-8a79-4be6f3f8787d None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:49.982635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0de1b-7b62-4e3a-8a79-4be6f3f8787d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:49.982635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e0de1b-7b62-4e3a-8a79-4be6f3f8787d None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:49.984979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 687/1386] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:49.991107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee5bbb-8b0f-4b57-a79c-44f3aa7cd1c3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:49.991525 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee5bbb-8b0f-4b57-a79c-44f3aa7cd1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:49.991955 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee5bbb-8b0f-4b57-a79c-44f3aa7cd1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:50.084405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-24ee5bbb-8b0f-4b57-a79c-44f3aa7cd1c3 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:50.086351 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-24ee5bbb-8b0f-4b57-a79c-44f3aa7cd1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:50.122341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:50.197864 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 700/1387] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:50.257543 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0de1b-7b62-4e3a-8a79-4be6f3f8787d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:50.259181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-01e0de1b-7b62-4e3a-8a79-4be6f3f8787d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:50.341891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:50.413015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e0de1b-7b62-4e3a-8a79-4be6f3f8787d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:50.540842 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2f979-6316-4104-b7f5-6aab8421b2e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:50.541489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f979-6316-4104-b7f5-6aab8421b2e3 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:50.541793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f979-6316-4104-b7f5-6aab8421b2e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:50.542065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2f979-6316-4104-b7f5-6aab8421b2e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:50.543692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-86e2f979-6316-4104-b7f5-6aab8421b2e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:50.582928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:50.636696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2f979-6316-4104-b7f5-6aab8421b2e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:50.643690 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2f979-6316-4104-b7f5-6aab8421b2e3 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:50.659300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 688/1388] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:52.946516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1f51f-be46-43c9-964b-5ddd7e6a42ae None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:52.947088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1f51f-be46-43c9-964b-5ddd7e6a42ae None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:52.947088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1f51f-be46-43c9-964b-5ddd7e6a42ae None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:52.948457 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 701/1389] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:52.954683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1231b-7f07-4eb3-8c2d-ef6e7a6471d9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:52.955101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1231b-7f07-4eb3-8c2d-ef6e7a6471d9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:52.955419 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1231b-7f07-4eb3-8c2d-ef6e7a6471d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:53.022326 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e4c1231b-7f07-4eb3-8c2d-ef6e7a6471d9 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:53.023528 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e4c1231b-7f07-4eb3-8c2d-ef6e7a6471d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:53.124409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 689/1390] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:53.168472 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1f51f-be46-43c9-964b-5ddd7e6a42ae None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:53.170012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c3b1f51f-be46-43c9-964b-5ddd7e6a42ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:53.318064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1f51f-be46-43c9-964b-5ddd7e6a42ae None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:53.334795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:53.431696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d303a7-d835-4609-9dc3-e1dd910a6f13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:53.432354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d303a7-d835-4609-9dc3-e1dd910a6f13 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:53.432641 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d303a7-d835-4609-9dc3-e1dd910a6f13 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:53.432917 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d303a7-d835-4609-9dc3-e1dd910a6f13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:53.434587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-33d303a7-d835-4609-9dc3-e1dd910a6f13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:53.528363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d303a7-d835-4609-9dc3-e1dd910a6f13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:53.530550 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d303a7-d835-4609-9dc3-e1dd910a6f13 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:53.549349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 702/1391] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:53.771350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb457e-eeb4-4f71-bd77-dcb30467bed3 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:53.771638 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb457e-eeb4-4f71-bd77-dcb30467bed3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:53.771917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb457e-eeb4-4f71-bd77-dcb30467bed3 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:53.773333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 690/1392] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:53.779461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bf638-69c2-4efa-833b-a4a24b31856b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:53.779760 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bf638-69c2-4efa-833b-a4a24b31856b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:53.780786 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270bf638-69c2-4efa-833b-a4a24b31856b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:53.808608 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:53.858067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-270bf638-69c2-4efa-833b-a4a24b31856b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:53.859407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-270bf638-69c2-4efa-833b-a4a24b31856b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:53.963768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 703/1393] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:54.020940 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa310b5b-c077-41a9-8f50-57a2a964f27a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:54.021400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa310b5b-c077-41a9-8f50-57a2a964f27a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:54.021509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa310b5b-c077-41a9-8f50-57a2a964f27a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:54.022893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 691/1394] 10.222.0.83 () {54 vars in 966 bytes} [Wed Jul 20 22:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:54.028183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc34504-b62b-4dbe-a248-b380517c8eac None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:54.028586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc34504-b62b-4dbe-a248-b380517c8eac None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:54.028870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc34504-b62b-4dbe-a248-b380517c8eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:54.105273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-dbc34504-b62b-4dbe-a248-b380517c8eac None None] MFA Rules not processed for user `669a11ce83b746eeb7f4e7d0acca4b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:54.106500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dbc34504-b62b-4dbe-a248-b380517c8eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:54.150252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:54.188607 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 704/1395] 10.222.0.83 () {58 vars in 1063 bytes} [Wed Jul 20 22:39:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:54.196338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa310b5b-c077-41a9-8f50-57a2a964f27a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:54.197881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-aa310b5b-c077-41a9-8f50-57a2a964f27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:54.216610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:54.314039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa310b5b-c077-41a9-8f50-57a2a964f27a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:54.393138 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c09294-f9b9-4e78-8686-a2f940846640 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669a11ce83b746eeb7f4e7d0acca4b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:54.393820 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09294-f9b9-4e78-8686-a2f940846640 service glance] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:54.394121 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09294-f9b9-4e78-8686-a2f940846640 service glance] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:54.394425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c09294-f9b9-4e78-8686-a2f940846640 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:54.396216 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e2c09294-f9b9-4e78-8686-a2f940846640 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:54.469203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:54.511295 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c09294-f9b9-4e78-8686-a2f940846640 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:54.512821 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c09294-f9b9-4e78-8686-a2f940846640 service glance] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:54.533595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 692/1396] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:55.450380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0512fad-a1de-4b5f-ad17-5b6a849348e2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:55.450926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0512fad-a1de-4b5f-ad17-5b6a849348e2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:55.450926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0512fad-a1de-4b5f-ad17-5b6a849348e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:55.521058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d0512fad-a1de-4b5f-ad17-5b6a849348e2 None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:55.522240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d0512fad-a1de-4b5f-ad17-5b6a849348e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:55.622107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 705/1397] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:39:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:55.665639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb7b44-4bb3-437f-80bc-26f396a323b1 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:55.666745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb7b44-4bb3-437f-80bc-26f396a323b1 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:55.667210 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb7b44-4bb3-437f-80bc-26f396a323b1 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:55.668813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 693/1398] 10.222.0.83 () {54 vars in 943 bytes} [Wed Jul 20 22:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:55.676479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59978959-8fe6-43a7-8881-b8a3605370bd None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:55.676767 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59978959-8fe6-43a7-8881-b8a3605370bd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:55.677077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59978959-8fe6-43a7-8881-b8a3605370bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:55.765278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:55.775639 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-59978959-8fe6-43a7-8881-b8a3605370bd None None] MFA Rules not processed for user `146610a7cbbc46928a4a8d710c4d1942`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:55.776911 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-59978959-8fe6-43a7-8881-b8a3605370bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:55.891968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a13b-88db-40a5-b3a4-7ea3f47fe256 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:55.892437 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a13b-88db-40a5-b3a4-7ea3f47fe256 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:55.893342 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a13b-88db-40a5-b3a4-7ea3f47fe256 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:55.895782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 694/1399] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:39:55.903467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ecea3-b39b-4a7e-ae5b-4e663af2680a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:55.903754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ecea3-b39b-4a7e-ae5b-4e663af2680a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:55.904039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ecea3-b39b-4a7e-ae5b-4e663af2680a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:55.907673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 706/1400] 10.222.0.83 () {58 vars in 1040 bytes} [Wed Jul 20 22:39:55 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:39:55.917631 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59978959-8fe6-43a7-8881-b8a3605370bd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:55.928157 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59978959-8fe6-43a7-8881-b8a3605370bd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:55.978857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-644ecea3-b39b-4a7e-ae5b-4e663af2680a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:55.980491 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-644ecea3-b39b-4a7e-ae5b-4e663af2680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:56.060538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df7d54-9791-4f4a-8e12-a5e5d33bae00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:56.061134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df7d54-9791-4f4a-8e12-a5e5d33bae00 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:56.061430 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df7d54-9791-4f4a-8e12-a5e5d33bae00 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:56.061712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df7d54-9791-4f4a-8e12-a5e5d33bae00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:56.063540 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-09df7d54-9791-4f4a-8e12-a5e5d33bae00 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:56.067887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:56.117462 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 695/1401] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:39:56.166843 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ecea3-b39b-4a7e-ae5b-4e663af2680a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:56.168183 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-644ecea3-b39b-4a7e-ae5b-4e663af2680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:56.175360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df7d54-9791-4f4a-8e12-a5e5d33bae00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:56.177026 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df7d54-9791-4f4a-8e12-a5e5d33bae00 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:56.186572 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 707/1402] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:39:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 22:39:56.200594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:56.309519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ecea3-b39b-4a7e-ae5b-4e663af2680a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:56.428274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a45878-be68-4181-974a-bb82b6d66cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:56.428923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a45878-be68-4181-974a-bb82b6d66cbf service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:56.429203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a45878-be68-4181-974a-bb82b6d66cbf service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:56.429473 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a45878-be68-4181-974a-bb82b6d66cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:56.431151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d2a45878-be68-4181-974a-bb82b6d66cbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:56.453052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:56.530438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a45878-be68-4181-974a-bb82b6d66cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:56.532068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a45878-be68-4181-974a-bb82b6d66cbf service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:56.551506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 696/1403] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:39:58.932267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef391637-adf5-4c4e-b42c-853feded090e None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:58.932862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef391637-adf5-4c4e-b42c-853feded090e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:58.932862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef391637-adf5-4c4e-b42c-853feded090e None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:58.934514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 708/1404] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:39:58.940495 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f4265-4765-4b89-960a-2f7e68e3d929 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:58.940495 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f4265-4765-4b89-960a-2f7e68e3d929 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:58.940495 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f4265-4765-4b89-960a-2f7e68e3d929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:59.018772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f66f4265-4765-4b89-960a-2f7e68e3d929 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:39:59.020103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f66f4265-4765-4b89-960a-2f7e68e3d929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:59.134999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:59.141996 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 697/1405] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:39:59.188578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef391637-adf5-4c4e-b42c-853feded090e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:39:59.190065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ef391637-adf5-4c4e-b42c-853feded090e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:59.367437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:39:59.370836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef391637-adf5-4c4e-b42c-853feded090e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:39:59.500604 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18997658-8ed8-4c42-b317-c91e5a820a37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:39:59.501189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18997658-8ed8-4c42-b317-c91e5a820a37 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:39:59.501477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18997658-8ed8-4c42-b317-c91e5a820a37 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:39:59.501782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18997658-8ed8-4c42-b317-c91e5a820a37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:39:59.503698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-18997658-8ed8-4c42-b317-c91e5a820a37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:39:59.606149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18997658-8ed8-4c42-b317-c91e5a820a37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:39:59.607763 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18997658-8ed8-4c42-b317-c91e5a820a37 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:39:59.629450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 709/1406] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:39:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:01.909639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18569b2-0334-44da-83a8-9a34907706cf None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:01.910262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18569b2-0334-44da-83a8-9a34907706cf None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:01.910262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18569b2-0334-44da-83a8-9a34907706cf None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:01.915622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 698/1407] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:40:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:01.916951 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5fdd6-ff34-4e1e-a16e-f7888cc1e329 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:01.917392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5fdd6-ff34-4e1e-a16e-f7888cc1e329 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:01.917495 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f5fdd6-ff34-4e1e-a16e-f7888cc1e329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:01.920884 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:02.018040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e9f5fdd6-ff34-4e1e-a16e-f7888cc1e329 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:02.019303 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e9f5fdd6-ff34-4e1e-a16e-f7888cc1e329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:02.185743 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 710/1408] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:40:02.220688 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18569b2-0334-44da-83a8-9a34907706cf None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:02.222504 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f18569b2-0334-44da-83a8-9a34907706cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:02.407944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18569b2-0334-44da-83a8-9a34907706cf None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:02.502209 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:02.563621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650b762-2fc8-402f-b77a-ec0a9bfe9e29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:02.564284 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650b762-2fc8-402f-b77a-ec0a9bfe9e29 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:02.564572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650b762-2fc8-402f-b77a-ec0a9bfe9e29 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:02.564853 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650b762-2fc8-402f-b77a-ec0a9bfe9e29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:02.566596 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f650b762-2fc8-402f-b77a-ec0a9bfe9e29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:02.667399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650b762-2fc8-402f-b77a-ec0a9bfe9e29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:02.669049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650b762-2fc8-402f-b77a-ec0a9bfe9e29 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:02.690588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 699/1409] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:12.169888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=64 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:12.687937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=64 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:20.852058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4a27d-61d6-4253-bac9-98fb2e6175c5 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:20.852613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4a27d-61d6-4253-bac9-98fb2e6175c5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:20.852613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4a27d-61d6-4253-bac9-98fb2e6175c5 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:20.854068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 711/1410] 10.222.0.83 () {54 vars in 918 bytes} [Wed Jul 20 22:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:20.859598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4f901-e14e-4c95-960a-38da7e1f8f7e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:20.860049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4f901-e14e-4c95-960a-38da7e1f8f7e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:20.860212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4f901-e14e-4c95-960a-38da7e1f8f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:20.934340 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-31e4f901-e14e-4c95-960a-38da7e1f8f7e None None] MFA Rules not processed for user `65c9898ccf874dce88f08bebdbae02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:20.935560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-31e4f901-e14e-4c95-960a-38da7e1f8f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:21.047813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 700/1411] 10.222.0.83 () {58 vars in 1015 bytes} [Wed Jul 20 22:40:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:21.062291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e890860-3d39-4f53-a17a-88fed9c99a2f None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:21.062583 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e890860-3d39-4f53-a17a-88fed9c99a2f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:21.062864 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e890860-3d39-4f53-a17a-88fed9c99a2f None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:21.064237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 712/1412] 10.222.0.83 () {54 vars in 918 bytes} [Wed Jul 20 22:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:21.069695 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94499e-5a02-4b34-afe5-013446309af2 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:21.070020 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94499e-5a02-4b34-afe5-013446309af2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:21.070305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94499e-5a02-4b34-afe5-013446309af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:21.143755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:21.146949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4e94499e-5a02-4b34-afe5-013446309af2 None None] MFA Rules not processed for user `67c92c8d2b9d41e489e4c03ae4e71fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:21.148190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4e94499e-5a02-4b34-afe5-013446309af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:21.263565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 701/1413] 10.222.0.83 () {58 vars in 1015 bytes} [Wed Jul 20 22:40:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:23.804636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166acee-9a2a-4c37-b13e-88edfea03c3b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:23.805294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166acee-9a2a-4c37-b13e-88edfea03c3b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:23.805294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166acee-9a2a-4c37-b13e-88edfea03c3b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:23.806688 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:23.812163 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f20c6-f63d-4a73-87c6-35aa8cda0ec3 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:23.812595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f20c6-f63d-4a73-87c6-35aa8cda0ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:23.812712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f20c6-f63d-4a73-87c6-35aa8cda0ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:23.880565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-295f20c6-f63d-4a73-87c6-35aa8cda0ec3 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:23.881822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-295f20c6-f63d-4a73-87c6-35aa8cda0ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:23.935651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:23.977934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:24.021947 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166acee-9a2a-4c37-b13e-88edfea03c3b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:24.023507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c166acee-9a2a-4c37-b13e-88edfea03c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:24.169647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166acee-9a2a-4c37-b13e-88edfea03c3b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:24.241318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:24.282164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e40f9-1ed8-4ec0-ae1a-b3badf2f726c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:24.282819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e40f9-1ed8-4ec0-ae1a-b3badf2f726c service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:24.283104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e40f9-1ed8-4ec0-ae1a-b3badf2f726c service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:24.283382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e40f9-1ed8-4ec0-ae1a-b3badf2f726c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:24.285688 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d92e40f9-1ed8-4ec0-ae1a-b3badf2f726c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:24.373705 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e40f9-1ed8-4ec0-ae1a-b3badf2f726c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:24.375517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e40f9-1ed8-4ec0-ae1a-b3badf2f726c service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:24.393686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 714/1416] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:25.306810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7a84c-2110-463f-acfd-92dbaeac0ca7 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:25.307376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7a84c-2110-463f-acfd-92dbaeac0ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:25.307376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7a84c-2110-463f-acfd-92dbaeac0ca7 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:25.308780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:25.313716 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc2eaf-79d6-4f9d-ac60-58b70587b181 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:25.314122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc2eaf-79d6-4f9d-ac60-58b70587b181 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:25.314315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc2eaf-79d6-4f9d-ac60-58b70587b181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:25.390123 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f2bc2eaf-79d6-4f9d-ac60-58b70587b181 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:25.391230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f2bc2eaf-79d6-4f9d-ac60-58b70587b181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:25.418947 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:25.491210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:25.644966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7a84c-2110-463f-acfd-92dbaeac0ca7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:25.646491 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-38b7a84c-2110-463f-acfd-92dbaeac0ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:25.793863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7a84c-2110-463f-acfd-92dbaeac0ca7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:25.834682 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:25.907904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff00c80-6b1c-4e00-9bfa-828b1b1fe4a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:25.908469 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff00c80-6b1c-4e00-9bfa-828b1b1fe4a6 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:25.909247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff00c80-6b1c-4e00-9bfa-828b1b1fe4a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:25.909530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff00c80-6b1c-4e00-9bfa-828b1b1fe4a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:25.911200 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4ff00c80-6b1c-4e00-9bfa-828b1b1fe4a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:26.000387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff00c80-6b1c-4e00-9bfa-828b1b1fe4a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:26.002037 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff00c80-6b1c-4e00-9bfa-828b1b1fe4a6 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:26.021050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 704/1419] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:26.923230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b7ee2-ee0a-4b81-8cd2-fbd6769c2d9b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:26.923784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b7ee2-ee0a-4b81-8cd2-fbd6769c2d9b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:26.923784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b7ee2-ee0a-4b81-8cd2-fbd6769c2d9b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:26.925330 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:26.930281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4093102-9f39-4bcd-a551-b4938eba4401 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:26.930691 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4093102-9f39-4bcd-a551-b4938eba4401 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:26.930819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4093102-9f39-4bcd-a551-b4938eba4401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:26.983887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:27.006198 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f4093102-9f39-4bcd-a551-b4938eba4401 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:27.007406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f4093102-9f39-4bcd-a551-b4938eba4401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:27.107437 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:40:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:27.262034 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b7ee2-ee0a-4b81-8cd2-fbd6769c2d9b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:27.263611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-215b7ee2-ee0a-4b81-8cd2-fbd6769c2d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:27.412167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b7ee2-ee0a-4b81-8cd2-fbd6769c2d9b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:27.426598 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:27.531669 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848e110-2e1b-426c-9306-a8c06d387fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:27.532230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848e110-2e1b-426c-9306-a8c06d387fc3 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:27.532511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848e110-2e1b-426c-9306-a8c06d387fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:27.532786 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848e110-2e1b-426c-9306-a8c06d387fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:27.535147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a848e110-2e1b-426c-9306-a8c06d387fc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:27.626290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848e110-2e1b-426c-9306-a8c06d387fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:27.628114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848e110-2e1b-426c-9306-a8c06d387fc3 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:27.646634 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 717/1422] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:28.524126 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152f784-a2dc-4aeb-8733-710a1560b41b None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:28.524693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152f784-a2dc-4aeb-8733-710a1560b41b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:28.524693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152f784-a2dc-4aeb-8733-710a1560b41b None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:28.526189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:28.531346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509d2d6-7056-4f47-88c4-a45b56ce3b0c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:28.531752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509d2d6-7056-4f47-88c4-a45b56ce3b0c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:28.531921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509d2d6-7056-4f47-88c4-a45b56ce3b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:28.551454 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:28.608538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9509d2d6-7056-4f47-88c4-a45b56ce3b0c None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:28.609807 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9509d2d6-7056-4f47-88c4-a45b56ce3b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:28.708117 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:28.857977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152f784-a2dc-4aeb-8733-710a1560b41b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:28.859440 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a152f784-a2dc-4aeb-8733-710a1560b41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:28.975008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:29.013604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152f784-a2dc-4aeb-8733-710a1560b41b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:29.128376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fdb1c-ee07-4876-8f37-6081fa5eee92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:29.128959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fdb1c-ee07-4876-8f37-6081fa5eee92 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:29.129239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fdb1c-ee07-4876-8f37-6081fa5eee92 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:29.129513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fdb1c-ee07-4876-8f37-6081fa5eee92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:29.131181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ed9fdb1c-ee07-4876-8f37-6081fa5eee92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:29.207151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:29.220102 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fdb1c-ee07-4876-8f37-6081fa5eee92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:29.225062 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fdb1c-ee07-4876-8f37-6081fa5eee92 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:29.241200 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 707/1425] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:30.125360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797d6fa-5894-4fc9-9d87-b6d2d0aff865 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:30.125905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797d6fa-5894-4fc9-9d87-b6d2d0aff865 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:30.126011 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797d6fa-5894-4fc9-9d87-b6d2d0aff865 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:30.127348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:30.132645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a07b1b-71a3-4a40-b107-8f51bfda6aab None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:30.133112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a07b1b-71a3-4a40-b107-8f51bfda6aab None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:30.133230 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a07b1b-71a3-4a40-b107-8f51bfda6aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:30.206810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c3a07b1b-71a3-4a40-b107-8f51bfda6aab None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:30.208014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c3a07b1b-71a3-4a40-b107-8f51bfda6aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:30.302981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:30.453866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797d6fa-5894-4fc9-9d87-b6d2d0aff865 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:30.455429 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f797d6fa-5894-4fc9-9d87-b6d2d0aff865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:30.538759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:30.602885 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797d6fa-5894-4fc9-9d87-b6d2d0aff865 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:30.718965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bed0bd-d41d-47c1-8c05-3983c757fe1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:30.719573 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bed0bd-d41d-47c1-8c05-3983c757fe1e service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:30.719880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bed0bd-d41d-47c1-8c05-3983c757fe1e service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:30.720161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bed0bd-d41d-47c1-8c05-3983c757fe1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:30.722434 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-35bed0bd-d41d-47c1-8c05-3983c757fe1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:30.770381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:30.812609 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bed0bd-d41d-47c1-8c05-3983c757fe1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:30.814272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bed0bd-d41d-47c1-8c05-3983c757fe1e service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:30.832018 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 720/1428] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:31.740811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de4ad1-ef0d-4da3-bae6-b603dfb2cb07 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:31.741402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de4ad1-ef0d-4da3-bae6-b603dfb2cb07 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:31.741402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de4ad1-ef0d-4da3-bae6-b603dfb2cb07 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:31.742904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:31.747862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d9b86-e7db-473c-958d-63b3a1b10329 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:31.748286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d9b86-e7db-473c-958d-63b3a1b10329 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:31.748426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d9b86-e7db-473c-958d-63b3a1b10329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:31.825671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ab5d9b86-e7db-473c-958d-63b3a1b10329 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:31.826912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ab5d9b86-e7db-473c-958d-63b3a1b10329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:31.925742 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:32.075823 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de4ad1-ef0d-4da3-bae6-b603dfb2cb07 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:32.077263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-72de4ad1-ef0d-4da3-bae6-b603dfb2cb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:32.126204 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:32.228409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de4ad1-ef0d-4da3-bae6-b603dfb2cb07 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:32.340450 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf04211-f96d-4489-a07d-9bade19ef85d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:32.341014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf04211-f96d-4489-a07d-9bade19ef85d service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:32.341299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf04211-f96d-4489-a07d-9bade19ef85d service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:32.341577 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf04211-f96d-4489-a07d-9bade19ef85d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:32.343289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ebf04211-f96d-4489-a07d-9bade19ef85d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:32.350760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:32.434213 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf04211-f96d-4489-a07d-9bade19ef85d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:32.435846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf04211-f96d-4489-a07d-9bade19ef85d service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:32.453832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 710/1431] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:33.344805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02cd26-b1f5-4fd5-ba3a-1b69bb22aaf2 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:33.345323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02cd26-b1f5-4fd5-ba3a-1b69bb22aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:33.345323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02cd26-b1f5-4fd5-ba3a-1b69bb22aaf2 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:33.346965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:33.352175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23286fe-dde1-4c38-abc2-6176a452b64c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:33.352606 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23286fe-dde1-4c38-abc2-6176a452b64c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:33.352753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23286fe-dde1-4c38-abc2-6176a452b64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:33.427253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c23286fe-dde1-4c38-abc2-6176a452b64c None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:33.428471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c23286fe-dde1-4c38-abc2-6176a452b64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:33.495085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:33.523988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:40:33.681084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02cd26-b1f5-4fd5-ba3a-1b69bb22aaf2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:33.682698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dc02cd26-b1f5-4fd5-ba3a-1b69bb22aaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:33.700185 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:33.828731 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02cd26-b1f5-4fd5-ba3a-1b69bb22aaf2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:33.915893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:33.941485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1daf6-bc76-446a-a4e0-27cc75c62981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:33.942238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1daf6-bc76-446a-a4e0-27cc75c62981 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:33.942423 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1daf6-bc76-446a-a4e0-27cc75c62981 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:33.942696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1daf6-bc76-446a-a4e0-27cc75c62981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:33.944330 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-97c1daf6-bc76-446a-a4e0-27cc75c62981 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:34.036355 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1daf6-bc76-446a-a4e0-27cc75c62981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:34.037987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1daf6-bc76-446a-a4e0-27cc75c62981 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:34.055914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 723/1434] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:34.936884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6140-b0f7-44ff-9b67-7d3eec85298f None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:34.937456 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6140-b0f7-44ff-9b67-7d3eec85298f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:34.937456 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6140-b0f7-44ff-9b67-7d3eec85298f None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:34.938912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:34.944807 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2826b6c-cad0-4bf3-84c5-549abad82c2a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:34.945275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2826b6c-cad0-4bf3-84c5-549abad82c2a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:34.945404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2826b6c-cad0-4bf3-84c5-549abad82c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:35.019980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f2826b6c-cad0-4bf3-84c5-549abad82c2a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:35.021194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f2826b6c-cad0-4bf3-84c5-549abad82c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:35.063099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:35.122778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:40:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:35.275544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d6140-b0f7-44ff-9b67-7d3eec85298f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:35.277027 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ca6d6140-b0f7-44ff-9b67-7d3eec85298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:35.426506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d6140-b0f7-44ff-9b67-7d3eec85298f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:35.481068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:35.540704 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a95700-1287-481b-a359-9869f26313ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:35.541278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a95700-1287-481b-a359-9869f26313ce service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:35.541562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a95700-1287-481b-a359-9869f26313ce service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:35.541909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a95700-1287-481b-a359-9869f26313ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:35.543606 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a9a95700-1287-481b-a359-9869f26313ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:35.632876 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a95700-1287-481b-a359-9869f26313ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:35.634549 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a95700-1287-481b-a359-9869f26313ce service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:35.653041 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 713/1437] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:36.528025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dabde-3e6e-4538-9d90-8521dd5a476b None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:36.528603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dabde-3e6e-4538-9d90-8521dd5a476b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:36.528603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dabde-3e6e-4538-9d90-8521dd5a476b None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:36.529983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:36.535798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424126d-a9f4-41d5-9898-766eff2ffee7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:36.536279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424126d-a9f4-41d5-9898-766eff2ffee7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:36.536406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424126d-a9f4-41d5-9898-766eff2ffee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:36.610715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-2424126d-a9f4-41d5-9898-766eff2ffee7 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:36.612598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2424126d-a9f4-41d5-9898-766eff2ffee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:36.614805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:36.708957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:36.860534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dabde-3e6e-4538-9d90-8521dd5a476b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:36.863278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-504dabde-3e6e-4538-9d90-8521dd5a476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:37.009672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504dabde-3e6e-4538-9d90-8521dd5a476b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:37.039019 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:37.127138 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5749ff7e-a977-4b50-bfd9-a4c1368c7f30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:37.128200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749ff7e-a977-4b50-bfd9-a4c1368c7f30 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:37.128478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749ff7e-a977-4b50-bfd9-a4c1368c7f30 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:37.128746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5749ff7e-a977-4b50-bfd9-a4c1368c7f30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:37.130401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5749ff7e-a977-4b50-bfd9-a4c1368c7f30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:37.219921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749ff7e-a977-4b50-bfd9-a4c1368c7f30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:37.222374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5749ff7e-a977-4b50-bfd9-a4c1368c7f30 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:37.240318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 726/1440] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:39.202074 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e77d-b5fe-4711-9a02-c14252ef2995 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:39.202632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e77d-b5fe-4711-9a02-c14252ef2995 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:39.202632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6e77d-b5fe-4711-9a02-c14252ef2995 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:39.204015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:39.210341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad447f-ab2b-41e2-ba01-aae069393e39 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:39.210758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad447f-ab2b-41e2-ba01-aae069393e39 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:39.210902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad447f-ab2b-41e2-ba01-aae069393e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:39.251070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:39.275970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d1ad447f-ab2b-41e2-ba01-aae069393e39 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:39.277180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d1ad447f-ab2b-41e2-ba01-aae069393e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:39.378363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:40:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:39.418974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e77d-b5fe-4711-9a02-c14252ef2995 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:39.420540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-00d6e77d-b5fe-4711-9a02-c14252ef2995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:39.524755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6e77d-b5fe-4711-9a02-c14252ef2995 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:39.556634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:39.598574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150bb054-5254-40ca-90ad-fd5c7a1e20eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:39.599235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb054-5254-40ca-90ad-fd5c7a1e20eb service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:39.599519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb054-5254-40ca-90ad-fd5c7a1e20eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:39.599797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150bb054-5254-40ca-90ad-fd5c7a1e20eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:39.601442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-150bb054-5254-40ca-90ad-fd5c7a1e20eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:39.709201 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bb054-5254-40ca-90ad-fd5c7a1e20eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:39.710684 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150bb054-5254-40ca-90ad-fd5c7a1e20eb service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:39.729101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 716/1443] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:41.990577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f628f-e03d-4a4d-8635-c6781d170f48 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:41.991257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f628f-e03d-4a4d-8635-c6781d170f48 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:41.991257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f628f-e03d-4a4d-8635-c6781d170f48 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:41.992499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:41.997618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b46a2-db1f-41d8-95ac-a231bf193fc4 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:41.998190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b46a2-db1f-41d8-95ac-a231bf193fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:41.998311 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b46a2-db1f-41d8-95ac-a231bf193fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:42.062667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f73b46a2-db1f-41d8-95ac-a231bf193fc4 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:42.063875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f73b46a2-db1f-41d8-95ac-a231bf193fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:42.076990 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:42.162221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:42.201352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f628f-e03d-4a4d-8635-c6781d170f48 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:42.202937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e15f628f-e03d-4a4d-8635-c6781d170f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:42.318525 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f628f-e03d-4a4d-8635-c6781d170f48 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:42.331671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:42.394395 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713225fe-5a31-4bea-b943-bab89d6a070c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:42.395052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713225fe-5a31-4bea-b943-bab89d6a070c service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:42.395335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713225fe-5a31-4bea-b943-bab89d6a070c service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:42.395611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713225fe-5a31-4bea-b943-bab89d6a070c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:42.397372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-713225fe-5a31-4bea-b943-bab89d6a070c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:42.506486 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713225fe-5a31-4bea-b943-bab89d6a070c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:42.507968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713225fe-5a31-4bea-b943-bab89d6a070c service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:42.525805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 729/1446] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:45.013791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd0068-e894-45d0-913b-a7bee6c34b2f None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:45.014387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd0068-e894-45d0-913b-a7bee6c34b2f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:45.014387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd0068-e894-45d0-913b-a7bee6c34b2f None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:45.015733 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:40:45.021927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d852a0-7f74-46c4-b0fb-1b8987194f71 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:45.022381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d852a0-7f74-46c4-b0fb-1b8987194f71 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:45.022477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d852a0-7f74-46c4-b0fb-1b8987194f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:45.070237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:45.089099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d7d852a0-7f74-46c4-b0fb-1b8987194f71 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:45.090350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d7d852a0-7f74-46c4-b0fb-1b8987194f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:45.187093 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:45.226976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd0068-e894-45d0-913b-a7bee6c34b2f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:45.228498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1fdd0068-e894-45d0-913b-a7bee6c34b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:45.333589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd0068-e894-45d0-913b-a7bee6c34b2f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:45.375281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:45.409162 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bc612-36b3-428f-b417-da8f89349d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:45.409847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bc612-36b3-428f-b417-da8f89349d87 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:45.410133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bc612-36b3-428f-b417-da8f89349d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:45.410406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bc612-36b3-428f-b417-da8f89349d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:45.412057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-424bc612-36b3-428f-b417-da8f89349d87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:45.520575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bc612-36b3-428f-b417-da8f89349d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:45.522050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bc612-36b3-428f-b417-da8f89349d87 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:45.540662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 719/1449] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:47.739122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4c09-8fd5-4fb3-a4d8-92ecbf69dbf5 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:47.739660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4c09-8fd5-4fb3-a4d8-92ecbf69dbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:47.739660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b4c09-8fd5-4fb3-a4d8-92ecbf69dbf5 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:47.741044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:47.746255 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ef4b0-b5e1-4593-bf30-5cef2dac0a9b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:47.746712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ef4b0-b5e1-4593-bf30-5cef2dac0a9b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:47.746849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ef4b0-b5e1-4593-bf30-5cef2dac0a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:47.811524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-376ef4b0-b5e1-4593-bf30-5cef2dac0a9b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:47.812742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-376ef4b0-b5e1-4593-bf30-5cef2dac0a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:47.835000 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:47.913058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:47.954412 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b4c09-8fd5-4fb3-a4d8-92ecbf69dbf5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:47.956751 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c04b4c09-8fd5-4fb3-a4d8-92ecbf69dbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:48.061395 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b4c09-8fd5-4fb3-a4d8-92ecbf69dbf5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:48.083065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:48.138152 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196bf69-b2b4-48ce-be75-712778cd4981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:48.138808 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196bf69-b2b4-48ce-be75-712778cd4981 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:48.139093 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196bf69-b2b4-48ce-be75-712778cd4981 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:48.139370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196bf69-b2b4-48ce-be75-712778cd4981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:48.141028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7196bf69-b2b4-48ce-be75-712778cd4981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:48.248477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196bf69-b2b4-48ce-be75-712778cd4981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:48.250208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196bf69-b2b4-48ce-be75-712778cd4981 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:48.268455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 732/1452] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:50.467706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c9b26-e5d1-47dc-b3b4-6a4b410171b0 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:50.468252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c9b26-e5d1-47dc-b3b4-6a4b410171b0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:50.468252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c9b26-e5d1-47dc-b3b4-6a4b410171b0 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:50.469704 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:50.475657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50701f0-e9e5-49df-b4cd-53bf36c85ad1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:50.476106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50701f0-e9e5-49df-b4cd-53bf36c85ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:50.476219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50701f0-e9e5-49df-b4cd-53bf36c85ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:50.539433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:50.542461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a50701f0-e9e5-49df-b4cd-53bf36c85ad1 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:50.543683 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a50701f0-e9e5-49df-b4cd-53bf36c85ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:50.643382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:40:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:50.682652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c9b26-e5d1-47dc-b3b4-6a4b410171b0 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:50.684264 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4a7c9b26-e5d1-47dc-b3b4-6a4b410171b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:50.790454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c9b26-e5d1-47dc-b3b4-6a4b410171b0 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:50.838743 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:50.864678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276bb48-a3e5-4f58-843e-1ba8fdcd9d55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:50.865365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276bb48-a3e5-4f58-843e-1ba8fdcd9d55 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:50.865639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276bb48-a3e5-4f58-843e-1ba8fdcd9d55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:50.865942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276bb48-a3e5-4f58-843e-1ba8fdcd9d55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:50.867628 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a276bb48-a3e5-4f58-843e-1ba8fdcd9d55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:50.977795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276bb48-a3e5-4f58-843e-1ba8fdcd9d55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:50.979218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276bb48-a3e5-4f58-843e-1ba8fdcd9d55 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:50.998139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 722/1455] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:53.182961 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8924260-085d-42b6-82b1-4c697017f824 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:53.183552 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8924260-085d-42b6-82b1-4c697017f824 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:53.183552 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8924260-085d-42b6-82b1-4c697017f824 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:53.185009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:53.191070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc96ff-fd05-4a74-b9fc-f83b854df39e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:53.191499 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc96ff-fd05-4a74-b9fc-f83b854df39e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:53.191636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc96ff-fd05-4a74-b9fc-f83b854df39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:53.256845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bacc96ff-fd05-4a74-b9fc-f83b854df39e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:53.258125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bacc96ff-fd05-4a74-b9fc-f83b854df39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:53.287458 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:53.355044 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:53.394845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8924260-085d-42b6-82b1-4c697017f824 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:53.396479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f8924260-085d-42b6-82b1-4c697017f824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:53.500089 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8924260-085d-42b6-82b1-4c697017f824 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:53.528525 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:53.576127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d77e9c5-c769-4a6c-8514-e1f0d9c35df0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:53.576786 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77e9c5-c769-4a6c-8514-e1f0d9c35df0 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:53.577076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77e9c5-c769-4a6c-8514-e1f0d9c35df0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:53.577352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d77e9c5-c769-4a6c-8514-e1f0d9c35df0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:53.579190 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5d77e9c5-c769-4a6c-8514-e1f0d9c35df0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:53.693248 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77e9c5-c769-4a6c-8514-e1f0d9c35df0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:53.694789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d77e9c5-c769-4a6c-8514-e1f0d9c35df0 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:53.713544 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 735/1458] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:40:55.831863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83471c40-990c-4517-acd0-02211824cd9d None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:55.832412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83471c40-990c-4517-acd0-02211824cd9d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:55.832412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83471c40-990c-4517-acd0-02211824cd9d None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:55.833819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:40:55.839176 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18e28-d23c-4985-9fff-c02ad506d753 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:55.839599 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18e28-d23c-4985-9fff-c02ad506d753 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:55.839762 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18e28-d23c-4985-9fff-c02ad506d753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:55.910624 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a7b18e28-d23c-4985-9fff-c02ad506d753 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:55.911921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a7b18e28-d23c-4985-9fff-c02ad506d753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:55.920085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:56.008307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:56.047898 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83471c40-990c-4517-acd0-02211824cd9d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:56.050131 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-83471c40-990c-4517-acd0-02211824cd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:56.154065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83471c40-990c-4517-acd0-02211824cd9d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:56.210293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:56.229106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c288ef4-cff1-4a28-b865-10b7d770433a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:56.229809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c288ef4-cff1-4a28-b865-10b7d770433a service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:56.230098 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c288ef4-cff1-4a28-b865-10b7d770433a service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:56.230379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c288ef4-cff1-4a28-b865-10b7d770433a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:56.232030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0c288ef4-cff1-4a28-b865-10b7d770433a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:56.342539 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c288ef4-cff1-4a28-b865-10b7d770433a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:56.343985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c288ef4-cff1-4a28-b865-10b7d770433a service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:56.364951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 725/1461] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:40:58.564006 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947c28e-2d68-43b5-a11e-62a144c84d6d None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:58.564952 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947c28e-2d68-43b5-a11e-62a144c84d6d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:58.565179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947c28e-2d68-43b5-a11e-62a144c84d6d None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:58.566673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:40:58.572688 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb203d-bd3d-4889-b1e5-ba6335261d0b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:58.573140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb203d-bd3d-4889-b1e5-ba6335261d0b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:58.573263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb203d-bd3d-4889-b1e5-ba6335261d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:58.638739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0feb203d-bd3d-4889-b1e5-ba6335261d0b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:40:58.639995 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0feb203d-bd3d-4889-b1e5-ba6335261d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:58.680916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:58.742623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:40:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:40:58.781905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947c28e-2d68-43b5-a11e-62a144c84d6d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:40:58.783462 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2947c28e-2d68-43b5-a11e-62a144c84d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:58.887094 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947c28e-2d68-43b5-a11e-62a144c84d6d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:40:58.924968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:40:58.961810 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75831c-3145-4043-8362-228988e85541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:40:58.962461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75831c-3145-4043-8362-228988e85541 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:40:58.962744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75831c-3145-4043-8362-228988e85541 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:40:58.963016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75831c-3145-4043-8362-228988e85541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:40:58.964677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ef75831c-3145-4043-8362-228988e85541 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:40:59.077454 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75831c-3145-4043-8362-228988e85541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:40:59.078989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75831c-3145-4043-8362-228988e85541 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:40:59.217618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 738/1464] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:40:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:41:01.323184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591a0da-5522-4358-b887-fd5fb37a4b72 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:01.323753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591a0da-5522-4358-b887-fd5fb37a4b72 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:01.323753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591a0da-5522-4358-b887-fd5fb37a4b72 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:01.325077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:41:01.330787 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf4cb3-34f6-4c8e-ab7f-6ccc18a5b83b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:01.331240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf4cb3-34f6-4c8e-ab7f-6ccc18a5b83b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:01.331341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf4cb3-34f6-4c8e-ab7f-6ccc18a5b83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:01.395209 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6abf4cb3-34f6-4c8e-ab7f-6ccc18a5b83b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:41:01.396411 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6abf4cb3-34f6-4c8e-ab7f-6ccc18a5b83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:01.414556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:01.491640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:41:01.529752 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591a0da-5522-4358-b887-fd5fb37a4b72 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:41:01.531285 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d591a0da-5522-4358-b887-fd5fb37a4b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:01.638893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591a0da-5522-4358-b887-fd5fb37a4b72 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:41:01.707270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:01.714173 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3b804-59ba-4db9-8cae-ebf1ba1b8dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:41:01.714995 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b804-59ba-4db9-8cae-ebf1ba1b8dcf service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:01.715383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b804-59ba-4db9-8cae-ebf1ba1b8dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:01.715765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b804-59ba-4db9-8cae-ebf1ba1b8dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:01.717627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8bf3b804-59ba-4db9-8cae-ebf1ba1b8dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:01.833640 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3b804-59ba-4db9-8cae-ebf1ba1b8dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:41:01.835150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3b804-59ba-4db9-8cae-ebf1ba1b8dcf service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:41:01.853997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 728/1467] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:41:03.923187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce475b-a140-46cd-80a6-caed5ba81277 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:03.924286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce475b-a140-46cd-80a6-caed5ba81277 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:03.924286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ce475b-a140-46cd-80a6-caed5ba81277 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:03.925972 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:41:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:41:03.931358 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bc65a-3ece-4cd2-9707-226586ab0ed4 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:03.931787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bc65a-3ece-4cd2-9707-226586ab0ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:03.931919 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06bc65a-3ece-4cd2-9707-226586ab0ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:03.997008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b06bc65a-3ece-4cd2-9707-226586ab0ed4 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:41:03.998259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b06bc65a-3ece-4cd2-9707-226586ab0ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:04.046065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:04.098798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:41:04.137525 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce475b-a140-46cd-80a6-caed5ba81277 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:41:04.139085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-14ce475b-a140-46cd-80a6-caed5ba81277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:04.243361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ce475b-a140-46cd-80a6-caed5ba81277 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:41:04.292320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:04.318642 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a9b0d-8c58-4e8d-8785-9a0bce15319c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:41:04.319418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a9b0d-8c58-4e8d-8785-9a0bce15319c service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:04.319702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a9b0d-8c58-4e8d-8785-9a0bce15319c service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:04.319981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a9b0d-8c58-4e8d-8785-9a0bce15319c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:04.321630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-196a9b0d-8c58-4e8d-8785-9a0bce15319c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:04.431744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a9b0d-8c58-4e8d-8785-9a0bce15319c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:41:04.433178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a9b0d-8c58-4e8d-8785-9a0bce15319c service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:41:04.451090 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 741/1470] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:41:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:41:14.096917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=22 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:14.448781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=66 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:24.558553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00831-cb9b-40a2-a8a2-1e090c6fadbc None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:24.559127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00831-cb9b-40a2-a8a2-1e090c6fadbc None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:24.559127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd00831-cb9b-40a2-a8a2-1e090c6fadbc None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:24.560493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 730/1471] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:41:24.566801 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a83bd9-bc44-4f47-9416-80840e3dfada None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:24.567271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a83bd9-bc44-4f47-9416-80840e3dfada None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:24.567398 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a83bd9-bc44-4f47-9416-80840e3dfada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:24.631530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-66a83bd9-bc44-4f47-9416-80840e3dfada None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:41:24.632738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-66a83bd9-bc44-4f47-9416-80840e3dfada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:24.730232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 742/1472] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:41:24.819868 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06099b-ca42-4aad-a5db-0350f16784a8 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:24.820153 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06099b-ca42-4aad-a5db-0350f16784a8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:24.820429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06099b-ca42-4aad-a5db-0350f16784a8 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:24.821886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 731/1473] 10.222.0.83 () {54 vars in 966 bytes} [Wed Jul 20 22:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:41:24.826649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0de7f-e6e6-4b4c-9cc6-b44b0ed13794 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:24.826943 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0de7f-e6e6-4b4c-9cc6-b44b0ed13794 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:24.827224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0de7f-e6e6-4b4c-9cc6-b44b0ed13794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:24.903496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f6b0de7f-e6e6-4b4c-9cc6-b44b0ed13794 None None] MFA Rules not processed for user `669a11ce83b746eeb7f4e7d0acca4b6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:41:24.904708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f6b0de7f-e6e6-4b4c-9cc6-b44b0ed13794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:24.926406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:24.981609 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 743/1474] 10.222.0.83 () {58 vars in 1063 bytes} [Wed Jul 20 22:41:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:41:24.989698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06099b-ca42-4aad-a5db-0350f16784a8 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:41:24.991273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-be06099b-ca42-4aad-a5db-0350f16784a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:25.095029 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06099b-ca42-4aad-a5db-0350f16784a8 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:41:25.171358 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c660048-4030-4935-98c4-16df8bf50d71 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669a11ce83b746eeb7f4e7d0acca4b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:41:25.172016 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660048-4030-4935-98c4-16df8bf50d71 service glance] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:25.172303 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660048-4030-4935-98c4-16df8bf50d71 service glance] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:25.172582 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660048-4030-4935-98c4-16df8bf50d71 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:25.175166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7c660048-4030-4935-98c4-16df8bf50d71 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:25.229328 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:25.286368 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c660048-4030-4935-98c4-16df8bf50d71 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:41:25.287809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c660048-4030-4935-98c4-16df8bf50d71 service glance] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:41:25.306996 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 732/1475] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:41:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:41:27.463507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2eabf-cabb-4471-b512-848c9ce980bb None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:27.464074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2eabf-cabb-4471-b512-848c9ce980bb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:27.464074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2eabf-cabb-4471-b512-848c9ce980bb None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:27.466305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 744/1476] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:41:27.472493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486916f-d1e8-474c-8d32-6efcc40328a6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:27.472951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486916f-d1e8-474c-8d32-6efcc40328a6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:27.477053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486916f-d1e8-474c-8d32-6efcc40328a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:27.540722 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a486916f-d1e8-474c-8d32-6efcc40328a6 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:41:27.541971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a486916f-d1e8-474c-8d32-6efcc40328a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:27.639915 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 733/1477] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:41:27.664084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2eabf-cabb-4471-b512-848c9ce980bb None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:41:27.665672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8db2eabf-cabb-4471-b512-848c9ce980bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:27.792728 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2eabf-cabb-4471-b512-848c9ce980bb None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:41:27.843025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:27.888009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646dc605-3da1-43b0-8342-786a8ee76356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:41:27.888670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dc605-3da1-43b0-8342-786a8ee76356 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:27.888951 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dc605-3da1-43b0-8342-786a8ee76356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:27.889221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646dc605-3da1-43b0-8342-786a8ee76356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:27.889980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dc605-3da1-43b0-8342-786a8ee76356 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:41:27.891689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-646dc605-3da1-43b0-8342-786a8ee76356 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:41:27.891689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: warnings.warn(msg) Jul 20 22:41:27.891689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: Jul 20 22:41:27.893736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646dc605-3da1-43b0-8342-786a8ee76356 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:41:27.912328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 745/1478] 10.222.0.83 () {56 vars in 1108 bytes} [Wed Jul 20 22:41:27 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:41:29.990972 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be911fe-efe1-4e6c-bb21-ff19a740dd25 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:29.991535 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be911fe-efe1-4e6c-bb21-ff19a740dd25 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:29.991535 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be911fe-efe1-4e6c-bb21-ff19a740dd25 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:29.993053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 734/1479] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:41:29.998321 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592ecb4-7004-4e9f-ba58-acc9c7b6b990 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:29.998769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592ecb4-7004-4e9f-ba58-acc9c7b6b990 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:29.998883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592ecb4-7004-4e9f-ba58-acc9c7b6b990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:30.063455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8592ecb4-7004-4e9f-ba58-acc9c7b6b990 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:41:30.064789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8592ecb4-7004-4e9f-ba58-acc9c7b6b990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:30.163440 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 746/1480] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:41:30.208124 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be911fe-efe1-4e6c-bb21-ff19a740dd25 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:41:30.209819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6be911fe-efe1-4e6c-bb21-ff19a740dd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:30.219561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:30.355400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be911fe-efe1-4e6c-bb21-ff19a740dd25 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:41:30.444245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:30.479674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60a20b-5d73-4646-814b-a045c659ca12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:41:30.480371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60a20b-5d73-4646-814b-a045c659ca12 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:30.480664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60a20b-5d73-4646-814b-a045c659ca12 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:30.480960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60a20b-5d73-4646-814b-a045c659ca12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:30.482649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6b60a20b-5d73-4646-814b-a045c659ca12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:30.573546 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60a20b-5d73-4646-814b-a045c659ca12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:41:30.575195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60a20b-5d73-4646-814b-a045c659ca12 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:41:30.594392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 735/1481] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:41:32.844814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb16ab8-f1e8-40c1-bbc1-2b8fd8037790 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:32.846470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb16ab8-f1e8-40c1-bbc1-2b8fd8037790 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:32.846470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb16ab8-f1e8-40c1-bbc1-2b8fd8037790 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:32.847711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 747/1482] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:41:32.853400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46627e8-0390-4ef8-ae6d-d8a9d80e1bc0 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:32.853854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46627e8-0390-4ef8-ae6d-d8a9d80e1bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:32.854040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46627e8-0390-4ef8-ae6d-d8a9d80e1bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:32.922977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b46627e8-0390-4ef8-ae6d-d8a9d80e1bc0 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:41:32.925010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b46627e8-0390-4ef8-ae6d-d8a9d80e1bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:32.972454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:33.024227 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 736/1483] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:41:33.062221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb16ab8-f1e8-40c1-bbc1-2b8fd8037790 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:41:33.063770 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9cb16ab8-f1e8-40c1-bbc1-2b8fd8037790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:33.087571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:33.167199 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb16ab8-f1e8-40c1-bbc1-2b8fd8037790 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:41:33.240781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0f874-5cc9-4138-a6cf-7a1cf6b6b242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:41:33.241686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0f874-5cc9-4138-a6cf-7a1cf6b6b242 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:33.241997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0f874-5cc9-4138-a6cf-7a1cf6b6b242 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:33.242272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0f874-5cc9-4138-a6cf-7a1cf6b6b242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:33.243913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f8f0f874-5cc9-4138-a6cf-7a1cf6b6b242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:33.320514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:33.355965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0f874-5cc9-4138-a6cf-7a1cf6b6b242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:41:33.357405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0f874-5cc9-4138-a6cf-7a1cf6b6b242 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:41:33.376419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 748/1484] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:41:35.497621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627392-2ff4-443e-a089-efe69a378f53 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:35.498310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627392-2ff4-443e-a089-efe69a378f53 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:35.498310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b627392-2ff4-443e-a089-efe69a378f53 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:35.499607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 737/1485] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:41:35.505811 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602ab6f-aa04-47c4-af37-e86541e0e7fa None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:35.506263 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602ab6f-aa04-47c4-af37-e86541e0e7fa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:35.506375 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602ab6f-aa04-47c4-af37-e86541e0e7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:35.570786 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1602ab6f-aa04-47c4-af37-e86541e0e7fa None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:41:35.571995 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1602ab6f-aa04-47c4-af37-e86541e0e7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:35.668383 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 749/1486] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:41:35.708421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b627392-2ff4-443e-a089-efe69a378f53 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:41:35.709977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0b627392-2ff4-443e-a089-efe69a378f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:35.939985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b627392-2ff4-443e-a089-efe69a378f53 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:41:36.011966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:36.013817 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be3f2a-2a58-4070-a8e2-f40ca87bd572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:41:36.014476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be3f2a-2a58-4070-a8e2-f40ca87bd572 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:36.014761 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be3f2a-2a58-4070-a8e2-f40ca87bd572 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:36.015037 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be3f2a-2a58-4070-a8e2-f40ca87bd572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:36.016687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-99be3f2a-2a58-4070-a8e2-f40ca87bd572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:36.124923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be3f2a-2a58-4070-a8e2-f40ca87bd572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:41:36.126679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be3f2a-2a58-4070-a8e2-f40ca87bd572 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:41:36.144396 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 738/1487] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:41:38.306529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2ae4-e7ee-4946-86e7-8fd5251110ee None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:38.307095 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2ae4-e7ee-4946-86e7-8fd5251110ee None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:38.307095 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b2ae4-e7ee-4946-86e7-8fd5251110ee None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:38.308446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 750/1488] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:41:38.313805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830e82b-ea36-4495-82d4-a4280fbb39be None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:38.314346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830e82b-ea36-4495-82d4-a4280fbb39be None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:38.314346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830e82b-ea36-4495-82d4-a4280fbb39be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:38.380219 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-2830e82b-ea36-4495-82d4-a4280fbb39be None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:41:38.381366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2830e82b-ea36-4495-82d4-a4280fbb39be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:38.433503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:38.477099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 739/1489] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:41:38.519116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b2ae4-e7ee-4946-86e7-8fd5251110ee None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:41:38.520732 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e12b2ae4-e7ee-4946-86e7-8fd5251110ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:38.557553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:38.627778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b2ae4-e7ee-4946-86e7-8fd5251110ee None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:41:38.701336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577b9c7-fc64-481f-a980-6b48b95dc50e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:41:38.702010 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577b9c7-fc64-481f-a980-6b48b95dc50e service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:38.702289 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577b9c7-fc64-481f-a980-6b48b95dc50e service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:38.702556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577b9c7-fc64-481f-a980-6b48b95dc50e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:38.704196 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5577b9c7-fc64-481f-a980-6b48b95dc50e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:38.786131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:38.817492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577b9c7-fc64-481f-a980-6b48b95dc50e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:41:38.818952 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577b9c7-fc64-481f-a980-6b48b95dc50e service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:41:38.837284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 751/1490] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:41:41.346677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0699539-bc7a-4840-a0ff-cf2c7870f349 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:41.347210 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0699539-bc7a-4840-a0ff-cf2c7870f349 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:41.347210 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0699539-bc7a-4840-a0ff-cf2c7870f349 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:41.348516 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 740/1491] 10.222.0.83 () {54 vars in 926 bytes} [Wed Jul 20 22:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:41:41.353770 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e0d5b-fc18-4e6e-b001-6cdcba3ba902 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:41.354231 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e0d5b-fc18-4e6e-b001-6cdcba3ba902 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:41.354343 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e0d5b-fc18-4e6e-b001-6cdcba3ba902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:41.420064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a38e0d5b-fc18-4e6e-b001-6cdcba3ba902 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:41:41.421279 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a38e0d5b-fc18-4e6e-b001-6cdcba3ba902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:41.516991 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 752/1492] 10.222.0.83 () {58 vars in 1023 bytes} [Wed Jul 20 22:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:41:41.556998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0699539-bc7a-4840-a0ff-cf2c7870f349 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:41:41.558565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d0699539-bc7a-4840-a0ff-cf2c7870f349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:41.663570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0699539-bc7a-4840-a0ff-cf2c7870f349 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:41:41.736615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ee576-4be3-40f9-b5f2-2e7e4e383853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:41:41.737260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ee576-4be3-40f9-b5f2-2e7e4e383853 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:41:41.737564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ee576-4be3-40f9-b5f2-2e7e4e383853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:41:41.737896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ee576-4be3-40f9-b5f2-2e7e4e383853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:41:41.739595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4a3ee576-4be3-40f9-b5f2-2e7e4e383853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:41:41.748998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:41.849866 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ee576-4be3-40f9-b5f2-2e7e4e383853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:41:41.851307 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ee576-4be3-40f9-b5f2-2e7e4e383853 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:41:41.870439 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 741/1493] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:41:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:41:51.515118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=82 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:41:51.868176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=50 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:17.834288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b031-44f7-4b98-9cb2-962e5994af69 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:17.834885 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b031-44f7-4b98-9cb2-962e5994af69 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:17.834885 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452b031-44f7-4b98-9cb2-962e5994af69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:17.910267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4452b031-44f7-4b98-9cb2-962e5994af69 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:43:17.911435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4452b031-44f7-4b98-9cb2-962e5994af69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:18.007844 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 753/1494] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:43:18.016117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e99c5c-3f46-42e0-af7f-a399c0cb250f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:18.016605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e99c5c-3f46-42e0-af7f-a399c0cb250f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:18.016719 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e99c5c-3f46-42e0-af7f-a399c0cb250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:18.091090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-69e99c5c-3f46-42e0-af7f-a399c0cb250f None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:43:18.092315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-69e99c5c-3f46-42e0-af7f-a399c0cb250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:18.192067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 742/1495] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:43:18.197369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452b031-44f7-4b98-9cb2-962e5994af69 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:43:18.199076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4452b031-44f7-4b98-9cb2-962e5994af69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:18.214540 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452b031-44f7-4b98-9cb2-962e5994af69 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:43:18.275905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:18.309041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810159ae-20b5-4947-b9bd-0cab2c872d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:43:18.309705 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810159ae-20b5-4947-b9bd-0cab2c872d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:18.310016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810159ae-20b5-4947-b9bd-0cab2c872d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:18.310294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810159ae-20b5-4947-b9bd-0cab2c872d80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:18.311016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810159ae-20b5-4947-b9bd-0cab2c872d80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:43:18.311323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810159ae-20b5-4947-b9bd-0cab2c872d80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:43:18.312331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-810159ae-20b5-4947-b9bd-0cab2c872d80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:43:18.312331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: warnings.warn(msg) Jul 20 22:43:18.312331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: Jul 20 22:43:18.313215 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810159ae-20b5-4947-b9bd-0cab2c872d80 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:43:18.324214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 754/1496] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:43:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:43:18.333350 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e99c5c-3f46-42e0-af7f-a399c0cb250f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:43:18.342386 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e99c5c-3f46-42e0-af7f-a399c0cb250f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:43:18.403621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:18.436540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ec3c3-b26a-4c88-9076-d9a11bb751b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:43:18.437196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ec3c3-b26a-4c88-9076-d9a11bb751b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:18.437478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ec3c3-b26a-4c88-9076-d9a11bb751b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:18.437839 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ec3c3-b26a-4c88-9076-d9a11bb751b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:18.438482 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ec3c3-b26a-4c88-9076-d9a11bb751b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:43:18.441110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: WARNING py.warnings [None req-8e8ec3c3-b26a-4c88-9076-d9a11bb751b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:43:18.441110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: warnings.warn(msg) Jul 20 22:43:18.441110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: Jul 20 22:43:18.442339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8ec3c3-b26a-4c88-9076-d9a11bb751b2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:43:18.584461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 743/1497] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:43:18 2022] POST /identity/v3/projects => generated 379 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:43:18.588505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810159ae-20b5-4947-b9bd-0cab2c872d80 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:43:18.590150 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-810159ae-20b5-4947-b9bd-0cab2c872d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:18.624365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810159ae-20b5-4947-b9bd-0cab2c872d80 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:43:18.718194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116296bd-e041-4710-ae20-fba373cff628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:43:18.718854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116296bd-e041-4710-ae20-fba373cff628 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:18.719136 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116296bd-e041-4710-ae20-fba373cff628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:18.719417 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116296bd-e041-4710-ae20-fba373cff628 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:18.720112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116296bd-e041-4710-ae20-fba373cff628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:43:18.721123 dv-cinder-799871-38-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-116296bd-e041-4710-ae20-fba373cff628 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:43:18.721123 dv-cinder-799871-38-smb devstack@keystone.service[80614]: warnings.warn(msg) Jul 20 22:43:18.721123 dv-cinder-799871-38-smb devstack@keystone.service[80614]: Jul 20 22:43:18.722438 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116296bd-e041-4710-ae20-fba373cff628 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:43:18.816848 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 755/1498] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:43:18 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:43:18.820974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ec3c3-b26a-4c88-9076-d9a11bb751b2 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:43:18.822534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8e8ec3c3-b26a-4c88-9076-d9a11bb751b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:18.886398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ec3c3-b26a-4c88-9076-d9a11bb751b2 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:43:18.967484 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:18.977531 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776dfe1-258d-4ff4-9d63-34b6ee1ba3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:43:18.978338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776dfe1-258d-4ff4-9d63-34b6ee1ba3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:18.978617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776dfe1-258d-4ff4-9d63-34b6ee1ba3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:18.978887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776dfe1-258d-4ff4-9d63-34b6ee1ba3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:18.979610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776dfe1-258d-4ff4-9d63-34b6ee1ba3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:43:18.980626 dv-cinder-799871-38-smb devstack@keystone.service[80615]: WARNING py.warnings [None req-1776dfe1-258d-4ff4-9d63-34b6ee1ba3d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:43:18.980626 dv-cinder-799871-38-smb devstack@keystone.service[80615]: warnings.warn(msg) Jul 20 22:43:18.980626 dv-cinder-799871-38-smb devstack@keystone.service[80615]: Jul 20 22:43:18.981501 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776dfe1-258d-4ff4-9d63-34b6ee1ba3d8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:43:18.994458 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 744/1499] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:43:18.998150 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116296bd-e041-4710-ae20-fba373cff628 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:43:19.003670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-116296bd-e041-4710-ae20-fba373cff628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:19.011725 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116296bd-e041-4710-ae20-fba373cff628 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:43:19.035874 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:19.106546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35412b-81bc-496b-8c8d-0a482ae9f4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:43:19.107227 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35412b-81bc-496b-8c8d-0a482ae9f4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:19.107512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35412b-81bc-496b-8c8d-0a482ae9f4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:19.107791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35412b-81bc-496b-8c8d-0a482ae9f4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:19.108522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35412b-81bc-496b-8c8d-0a482ae9f4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:43:19.109535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-ee35412b-81bc-496b-8c8d-0a482ae9f4c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:43:19.109535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: warnings.warn(msg) Jul 20 22:43:19.109535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: Jul 20 22:43:19.110458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35412b-81bc-496b-8c8d-0a482ae9f4c3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:43:19.123418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 756/1500] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:43:19.128671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776dfe1-258d-4ff4-9d63-34b6ee1ba3d8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:43:19.130279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1776dfe1-258d-4ff4-9d63-34b6ee1ba3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:19.163908 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776dfe1-258d-4ff4-9d63-34b6ee1ba3d8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:43:19.259927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0870c-8887-4427-a1ba-7e61ee535e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:43:19.260816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0870c-8887-4427-a1ba-7e61ee535e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:19.261102 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0870c-8887-4427-a1ba-7e61ee535e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:19.261378 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0870c-8887-4427-a1ba-7e61ee535e9a admin admin] PATH_INFO: `/v3/projects/84f6b7fb7e5746fea251341c86cd0c8b/users/156429f92f6a4e4f8deacd25daea5fb4/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:19.282846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0870c-8887-4427-a1ba-7e61ee535e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=84f6b7fb7e5746fea251341c86cd0c8b, user_id=156429f92f6a4e4f8deacd25daea5fb4, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:43:19.283882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: WARNING py.warnings [None req-9df0870c-8887-4427-a1ba-7e61ee535e9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:43:19.283882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: warnings.warn(msg) Jul 20 22:43:19.283882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: Jul 20 22:43:19.286588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0870c-8887-4427-a1ba-7e61ee535e9a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:43:19.400195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 745/1501] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:43:19 2022] PUT /identity/v3/projects/84f6b7fb7e5746fea251341c86cd0c8b/users/156429f92f6a4e4f8deacd25daea5fb4/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:43:19.413209 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2678df1-2718-4e7c-9623-9bb34331212f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:19.413498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2678df1-2718-4e7c-9623-9bb34331212f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:19.413813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2678df1-2718-4e7c-9623-9bb34331212f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:19.467938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e2678df1-2718-4e7c-9623-9bb34331212f None None] MFA Rules not processed for user `156429f92f6a4e4f8deacd25daea5fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:43:19.469138 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e2678df1-2718-4e7c-9623-9bb34331212f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:19.545611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 757/1502] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:43:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:43:19.559443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e893f-f976-4859-80d2-3aabc2b65aaf None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:19.559732 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e893f-f976-4859-80d2-3aabc2b65aaf None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:19.560009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e893f-f976-4859-80d2-3aabc2b65aaf None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:19.561540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 746/1503] 10.222.0.83 () {54 vars in 964 bytes} [Wed Jul 20 22:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:43:19.566755 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d01b7c-3e80-48dc-9841-1a5e6dba5813 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:19.567043 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d01b7c-3e80-48dc-9841-1a5e6dba5813 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:19.567319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d01b7c-3e80-48dc-9841-1a5e6dba5813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:19.596555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:19.642411 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-98d01b7c-3e80-48dc-9841-1a5e6dba5813 None None] MFA Rules not processed for user `12ab5b94b21b466e8070771a61378e89`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:43:19.644598 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-98d01b7c-3e80-48dc-9841-1a5e6dba5813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:19.718762 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 758/1504] 10.222.0.83 () {58 vars in 1061 bytes} [Wed Jul 20 22:43:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:43:19.727135 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e893f-f976-4859-80d2-3aabc2b65aaf None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:43:19.728657 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-162e893f-f976-4859-80d2-3aabc2b65aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:19.778319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:19.833134 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e893f-f976-4859-80d2-3aabc2b65aaf None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:43:19.904452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b7a0e-4c6a-4810-a0a2-7d30af2ff808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:43:19.905099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b7a0e-4c6a-4810-a0a2-7d30af2ff808 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:19.905378 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b7a0e-4c6a-4810-a0a2-7d30af2ff808 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:19.905651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b7a0e-4c6a-4810-a0a2-7d30af2ff808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:19.907334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-598b7a0e-4c6a-4810-a0a2-7d30af2ff808 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:20.005897 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b7a0e-4c6a-4810-a0a2-7d30af2ff808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:43:20.007256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b7a0e-4c6a-4810-a0a2-7d30af2ff808 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:43:20.010787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:20.025374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 747/1505] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:43:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:43:20.067587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a35cbf-80f4-4b36-b8bd-4b1c0c7b014a None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:20.068063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a35cbf-80f4-4b36-b8bd-4b1c0c7b014a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:20.068167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a35cbf-80f4-4b36-b8bd-4b1c0c7b014a None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:20.069440 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 759/1506] 10.222.0.83 () {52 vars in 829 bytes} [Wed Jul 20 22:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:43:20.073157 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b7a0e-4c6a-4810-a0a2-7d30af2ff808 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:43:20.074447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-598b7a0e-4c6a-4810-a0a2-7d30af2ff808 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:20.172090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b7a0e-4c6a-4810-a0a2-7d30af2ff808 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:43:20.266630 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:43:20.267443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:20.267728 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:20.268002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] PATH_INFO: `/v3/users/156429f92f6a4e4f8deacd25daea5fb4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:20.281006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=156429f92f6a4e4f8deacd25daea5fb4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:43:20.282053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: WARNING py.warnings [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:43:20.282053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: warnings.warn(msg) Jul 20 22:43:20.282053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: Jul 20 22:43:20.283268 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:43:20.292907 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:20.479356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '156429f92f6a4e4f8deacd25daea5fb4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:43:20.479903 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '156429f92f6a4e4f8deacd25daea5fb4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:43:20.480336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '156429f92f6a4e4f8deacd25daea5fb4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:43:20.500398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '156429f92f6a4e4f8deacd25daea5fb4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:43:20.512994 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '156429f92f6a4e4f8deacd25daea5fb4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:43:20.581874 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 748/1507] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:43:20 2022] DELETE /identity/v3/users/156429f92f6a4e4f8deacd25daea5fb4 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:43:20.586207 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b95e7b-76c0-42e8-821d-44395c818c9f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:20.586499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b95e7b-76c0-42e8-821d-44395c818c9f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:20.586785 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b95e7b-76c0-42e8-821d-44395c818c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:20.644328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f8b95e7b-76c0-42e8-821d-44395c818c9f None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:43:20.645735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f8b95e7b-76c0-42e8-821d-44395c818c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:20.721534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:20.734571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 760/1508] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:43:20.745468 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:43:20.746784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:20.848012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf38be-fa04-4f8b-847c-3152d368c1f1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:43:20.902580 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:20.921886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa44001-e328-4d9c-bc20-4bad9ee38eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:43:20.922536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa44001-e328-4d9c-bc20-4bad9ee38eff service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:20.922816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa44001-e328-4d9c-bc20-4bad9ee38eff service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:20.923094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa44001-e328-4d9c-bc20-4bad9ee38eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:20.924844 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-afa44001-e328-4d9c-bc20-4bad9ee38eff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:21.033797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa44001-e328-4d9c-bc20-4bad9ee38eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:43:21.036069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa44001-e328-4d9c-bc20-4bad9ee38eff service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:43:21.054998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 749/1509] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:43:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:43:21.481468 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b95e7b-76c0-42e8-821d-44395c818c9f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:43:21.482762 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f8b95e7b-76c0-42e8-821d-44395c818c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:43:21.495034 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b95e7b-76c0-42e8-821d-44395c818c9f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:43:21.592519 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8032894-bb1c-436a-b700-16a3695b9a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:43:21.593379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8032894-bb1c-436a-b700-16a3695b9a00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:43:21.593663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8032894-bb1c-436a-b700-16a3695b9a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:43:21.593967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8032894-bb1c-436a-b700-16a3695b9a00 admin admin] PATH_INFO: `/v3/projects/84f6b7fb7e5746fea251341c86cd0c8b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:43:21.604318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8032894-bb1c-436a-b700-16a3695b9a00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84f6b7fb7e5746fea251341c86cd0c8b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:43:21.605355 dv-cinder-799871-38-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-b8032894-bb1c-436a-b700-16a3695b9a00 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:43:21.605355 dv-cinder-799871-38-smb devstack@keystone.service[80614]: warnings.warn(msg) Jul 20 22:43:21.605355 dv-cinder-799871-38-smb devstack@keystone.service[80614]: Jul 20 22:43:21.606572 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8032894-bb1c-436a-b700-16a3695b9a00 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:43:21.769735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b8032894-bb1c-436a-b700-16a3695b9a00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84f6b7fb7e5746fea251341c86cd0c8b', 'request_id': 'req-b8032894-bb1c-436a-b700-16a3695b9a00'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:43:21.838663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b8032894-bb1c-436a-b700-16a3695b9a00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84f6b7fb7e5746fea251341c86cd0c8b', 'request_id': 'req-b8032894-bb1c-436a-b700-16a3695b9a00'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:43:21.853555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b8032894-bb1c-436a-b700-16a3695b9a00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84f6b7fb7e5746fea251341c86cd0c8b', 'request_id': 'req-b8032894-bb1c-436a-b700-16a3695b9a00'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:43:21.879690 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b8032894-bb1c-436a-b700-16a3695b9a00 admin admin] The token cache is being invalidate because project 84f6b7fb7e5746fea251341c86cd0c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:43:21.879983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b8032894-bb1c-436a-b700-16a3695b9a00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:43:21.880421 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b8032894-bb1c-436a-b700-16a3695b9a00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:43:21.882112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 761/1510] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:43:21 2022] DELETE /identity/v3/projects/84f6b7fb7e5746fea251341c86cd0c8b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:43:31.052672 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=62 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:43:31.877320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:06.091136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da572392-092c-49f4-8fb8-7cbaa1ed6311 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:06.091610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da572392-092c-49f4-8fb8-7cbaa1ed6311 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:06.091714 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da572392-092c-49f4-8fb8-7cbaa1ed6311 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:06.093068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:45:06.098995 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc368-b1f7-42da-87cc-69a8b918fa6c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:06.099442 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc368-b1f7-42da-87cc-69a8b918fa6c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:06.099547 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc368-b1f7-42da-87cc-69a8b918fa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:06.178773 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e79bc368-b1f7-42da-87cc-69a8b918fa6c None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:45:06.179981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e79bc368-b1f7-42da-87cc-69a8b918fa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:45:06.284327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:45:06.438840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da572392-092c-49f4-8fb8-7cbaa1ed6311 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:45:06.444831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-da572392-092c-49f4-8fb8-7cbaa1ed6311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:45:06.557574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da572392-092c-49f4-8fb8-7cbaa1ed6311 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:45:06.563800 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c548126-4163-486a-99d3-46de7a8ec9b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:45:06.564449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c548126-4163-486a-99d3-46de7a8ec9b3 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:06.564738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c548126-4163-486a-99d3-46de7a8ec9b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:06.565018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c548126-4163-486a-99d3-46de7a8ec9b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:06.573053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c548126-4163-486a-99d3-46de7a8ec9b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:45:06.574733 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c548126-4163-486a-99d3-46de7a8ec9b3 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:45:06.584402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 751/1513] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:45:07.415701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ba549-ba29-4da0-bb88-a8315d3be5d5 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:07.416235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ba549-ba29-4da0-bb88-a8315d3be5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:07.416235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ba549-ba29-4da0-bb88-a8315d3be5d5 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:07.417586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:45:07.422506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e8b9f-2682-4ba9-bdc0-0a2c58b42185 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:07.422909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e8b9f-2682-4ba9-bdc0-0a2c58b42185 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:07.423002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e8b9f-2682-4ba9-bdc0-0a2c58b42185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:07.442197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-fd1e8b9f-2682-4ba9-bdc0-0a2c58b42185 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:45:07.443389 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fd1e8b9f-2682-4ba9-bdc0-0a2c58b42185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:45:07.451212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:45:07.602709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ba549-ba29-4da0-bb88-a8315d3be5d5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:45:07.618576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ba549-ba29-4da0-bb88-a8315d3be5d5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:45:07.624048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b21b9d-661f-4946-8952-0b2cc6556730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:45:07.624696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b21b9d-661f-4946-8952-0b2cc6556730 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:07.624980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b21b9d-661f-4946-8952-0b2cc6556730 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:07.625258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b21b9d-661f-4946-8952-0b2cc6556730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:07.634416 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b21b9d-661f-4946-8952-0b2cc6556730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:45:07.636065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b21b9d-661f-4946-8952-0b2cc6556730 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:45:07.646461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 764/1516] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:45:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:45:07.655020 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf6e27-1c25-4e8f-ba04-e5c953727984 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:07.655312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf6e27-1c25-4e8f-ba04-e5c953727984 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:07.655595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf6e27-1c25-4e8f-ba04-e5c953727984 None None] PATH_INFO: `/v3` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:07.656959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 753/1517] 10.222.0.15 () {54 vars in 925 bytes} [Wed Jul 20 22:45:07 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:45:07.663620 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ad568-b2a5-46e1-ac1d-12f75b23de10 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:07.664475 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ad568-b2a5-46e1-ac1d-12f75b23de10 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:07.664817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ad568-b2a5-46e1-ac1d-12f75b23de10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:07.728420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f91ad568-b2a5-46e1-ac1d-12f75b23de10 None None] MFA Rules not processed for user `65c9898ccf874dce88f08bebdbae02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:45:07.729651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f91ad568-b2a5-46e1-ac1d-12f75b23de10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:45:07.748438 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:07.804110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 765/1518] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Jul 20 22:45:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:45:17.437200 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=56 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:17.801214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=23 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:17.827711 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c47c12-ec94-44b1-bfa5-3fbc02537ee2 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:17.827997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c47c12-ec94-44b1-bfa5-3fbc02537ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:17.828276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c47c12-ec94-44b1-bfa5-3fbc02537ee2 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:17.831328 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 754/1519] 10.222.0.83 () {54 vars in 961 bytes} [Wed Jul 20 22:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:45:17.836221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b943f8-7cfa-4ae0-ba49-49a1651f12f9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:17.836515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b943f8-7cfa-4ae0-ba49-49a1651f12f9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:17.836800 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b943f8-7cfa-4ae0-ba49-49a1651f12f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:17.858111 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-20b943f8-7cfa-4ae0-ba49-49a1651f12f9 None None] MFA Rules not processed for user `65c9898ccf874dce88f08bebdbae02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:45:17.858111 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-20b943f8-7cfa-4ae0-ba49-49a1651f12f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:45:17.867485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 766/1520] 10.222.0.83 () {58 vars in 1058 bytes} [Wed Jul 20 22:45:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:45:17.875199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c47c12-ec94-44b1-bfa5-3fbc02537ee2 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:45:17.889797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c47c12-ec94-44b1-bfa5-3fbc02537ee2 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:45:17.895974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4d01c-41b7-48e6-8003-0ca2faec1a1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c9898ccf874dce88f08bebdbae02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:45:17.896658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4d01c-41b7-48e6-8003-0ca2faec1a1e service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:17.896936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4d01c-41b7-48e6-8003-0ca2faec1a1e service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:17.897205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4d01c-41b7-48e6-8003-0ca2faec1a1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:17.906425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4d01c-41b7-48e6-8003-0ca2faec1a1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:45:17.909082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4d01c-41b7-48e6-8003-0ca2faec1a1e service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:45:17.918656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 755/1521] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:45:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:45:18.901903 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfaeb6-88cc-48b2-a283-d41899db32bc None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:18.902471 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfaeb6-88cc-48b2-a283-d41899db32bc None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:18.902471 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbfaeb6-88cc-48b2-a283-d41899db32bc None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:18.903942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:45:18.909658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f07219-dc6a-4f66-b6b5-d2df361c4c2e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:18.910123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f07219-dc6a-4f66-b6b5-d2df361c4c2e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:18.910244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f07219-dc6a-4f66-b6b5-d2df361c4c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:18.928230 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-23f07219-dc6a-4f66-b6b5-d2df361c4c2e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:45:18.929410 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-23f07219-dc6a-4f66-b6b5-d2df361c4c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:45:18.937128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:45:19.095777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfaeb6-88cc-48b2-a283-d41899db32bc None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:45:19.109950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbfaeb6-88cc-48b2-a283-d41899db32bc None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:45:19.115992 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00944637-55cd-4812-8aa9-58478756675d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:45:19.116630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00944637-55cd-4812-8aa9-58478756675d service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:19.116913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00944637-55cd-4812-8aa9-58478756675d service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:19.117191 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00944637-55cd-4812-8aa9-58478756675d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:19.125429 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00944637-55cd-4812-8aa9-58478756675d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:45:19.128171 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00944637-55cd-4812-8aa9-58478756675d service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:45:19.137969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 768/1524] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:45:19.966536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fcb84-9e48-4df4-9d4d-4c8e083c2c6b None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:19.967125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fcb84-9e48-4df4-9d4d-4c8e083c2c6b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:19.967125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65fcb84-9e48-4df4-9d4d-4c8e083c2c6b None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:19.968505 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:45:19.973952 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0520ee1-f82f-46ac-86d4-c0f33af29d3d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:19.974381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0520ee1-f82f-46ac-86d4-c0f33af29d3d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:19.974507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0520ee1-f82f-46ac-86d4-c0f33af29d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:19.992985 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e0520ee1-f82f-46ac-86d4-c0f33af29d3d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:45:19.994219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e0520ee1-f82f-46ac-86d4-c0f33af29d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:45:20.002133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:45:20.155470 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fcb84-9e48-4df4-9d4d-4c8e083c2c6b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:45:20.170561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65fcb84-9e48-4df4-9d4d-4c8e083c2c6b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:45:20.176111 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ce2fe-05c4-4b1c-aca2-22703ba5bbac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:45:20.176750 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ce2fe-05c4-4b1c-aca2-22703ba5bbac service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:20.177040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ce2fe-05c4-4b1c-aca2-22703ba5bbac service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:20.177315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ce2fe-05c4-4b1c-aca2-22703ba5bbac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:20.185580 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ce2fe-05c4-4b1c-aca2-22703ba5bbac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:45:20.187203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ce2fe-05c4-4b1c-aca2-22703ba5bbac service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:45:20.196701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 758/1527] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:45:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:45:24.163202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248a9bf-4020-401f-a121-abd7ff11b9d7 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:24.163774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248a9bf-4020-401f-a121-abd7ff11b9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:24.163774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248a9bf-4020-401f-a121-abd7ff11b9d7 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:24.165139 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:45:24.170378 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72f590-cca7-4d40-8428-0f68c0b5b95b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:24.170810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72f590-cca7-4d40-8428-0f68c0b5b95b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:24.170945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72f590-cca7-4d40-8428-0f68c0b5b95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:24.189248 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6e72f590-cca7-4d40-8428-0f68c0b5b95b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:45:24.190482 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6e72f590-cca7-4d40-8428-0f68c0b5b95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:45:24.198335 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:45:24.274168 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248a9bf-4020-401f-a121-abd7ff11b9d7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:45:24.275881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1248a9bf-4020-401f-a121-abd7ff11b9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:45:24.356581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248a9bf-4020-401f-a121-abd7ff11b9d7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:45:24.360022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cd34a-7c87-422b-b381-e6b65283ef5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:45:24.360733 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cd34a-7c87-422b-b381-e6b65283ef5f service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:24.362167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cd34a-7c87-422b-b381-e6b65283ef5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:24.362167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cd34a-7c87-422b-b381-e6b65283ef5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:24.371217 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cd34a-7c87-422b-b381-e6b65283ef5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:45:24.372645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cd34a-7c87-422b-b381-e6b65283ef5f service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:45:24.383071 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 771/1530] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:45:26.425392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e45ef-3b96-43cd-a41c-adacb763019a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:26.425989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e45ef-3b96-43cd-a41c-adacb763019a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:26.425989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e45ef-3b96-43cd-a41c-adacb763019a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:26.427373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:45:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:45:26.432463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a6249-38ea-4c11-bc9c-cab0e89e25cb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:26.432846 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a6249-38ea-4c11-bc9c-cab0e89e25cb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:26.433029 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a6249-38ea-4c11-bc9c-cab0e89e25cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:26.450819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-803a6249-38ea-4c11-bc9c-cab0e89e25cb None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:45:26.452018 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-803a6249-38ea-4c11-bc9c-cab0e89e25cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:45:26.460899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:45:26.496973 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e45ef-3b96-43cd-a41c-adacb763019a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:45:26.508676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e45ef-3b96-43cd-a41c-adacb763019a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:45:26.512249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f302dd-5d9b-46ff-b994-bf007beb43f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:45:26.512890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f302dd-5d9b-46ff-b994-bf007beb43f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:26.513171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f302dd-5d9b-46ff-b994-bf007beb43f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:26.513445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f302dd-5d9b-46ff-b994-bf007beb43f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:26.523038 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f302dd-5d9b-46ff-b994-bf007beb43f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:45:26.524457 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f302dd-5d9b-46ff-b994-bf007beb43f2 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:45:26.533955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 761/1533] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:45:30.055241 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d737bd-587b-4a9f-a647-ab6d284c3660 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:30.055777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d737bd-587b-4a9f-a647-ab6d284c3660 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:30.055777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d737bd-587b-4a9f-a647-ab6d284c3660 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:30.057178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:45:30.062473 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d2990-bc5a-468d-b33d-4b01d191c26a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:30.062883 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d2990-bc5a-468d-b33d-4b01d191c26a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:30.063027 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d2990-bc5a-468d-b33d-4b01d191c26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:30.084600 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-659d2990-bc5a-468d-b33d-4b01d191c26a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:45:30.085849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-659d2990-bc5a-468d-b33d-4b01d191c26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:45:30.093735 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:45:30.399435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d737bd-587b-4a9f-a647-ab6d284c3660 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:45:30.401114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b3d737bd-587b-4a9f-a647-ab6d284c3660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:45:30.478475 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d737bd-587b-4a9f-a647-ab6d284c3660 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:45:30.482079 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce00ce-2c5e-4331-b140-64ef31e2862e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:45:30.482723 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce00ce-2c5e-4331-b140-64ef31e2862e service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:30.483008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce00ce-2c5e-4331-b140-64ef31e2862e service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:30.483284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce00ce-2c5e-4331-b140-64ef31e2862e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:30.492655 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce00ce-2c5e-4331-b140-64ef31e2862e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:45:30.494113 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce00ce-2c5e-4331-b140-64ef31e2862e service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:45:30.504000 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 774/1536] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:45:32.564152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf10fa9-23b6-42ca-8a31-b073900939df None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:32.564730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf10fa9-23b6-42ca-8a31-b073900939df None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:32.564730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf10fa9-23b6-42ca-8a31-b073900939df None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:32.566123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:45:32.571464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231387d8-6807-4a61-93e8-3f9b25c6434a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:32.571886 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231387d8-6807-4a61-93e8-3f9b25c6434a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:32.572022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231387d8-6807-4a61-93e8-3f9b25c6434a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:32.589242 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-231387d8-6807-4a61-93e8-3f9b25c6434a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:45:32.590517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-231387d8-6807-4a61-93e8-3f9b25c6434a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:45:32.598798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:45:32.910001 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf10fa9-23b6-42ca-8a31-b073900939df None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:45:32.911687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bcf10fa9-23b6-42ca-8a31-b073900939df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:45:32.924858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf10fa9-23b6-42ca-8a31-b073900939df None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:45:32.928753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c1143b-2481-42e7-bf06-8e9002518927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:45:32.929411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1143b-2481-42e7-bf06-8e9002518927 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:45:32.929693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1143b-2481-42e7-bf06-8e9002518927 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:45:32.929992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c1143b-2481-42e7-bf06-8e9002518927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:45:32.939635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1143b-2481-42e7-bf06-8e9002518927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:45:32.941064 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c1143b-2481-42e7-bf06-8e9002518927 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:45:32.950658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 764/1539] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:45:42.584561 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:45:42.946388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=33 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:04.775016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa5b74-9dc6-4021-a59c-151742b800fc None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:04.775684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa5b74-9dc6-4021-a59c-151742b800fc None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:04.775684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa5b74-9dc6-4021-a59c-151742b800fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:04.802686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-69fa5b74-9dc6-4021-a59c-151742b800fc None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:04.804152 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-69fa5b74-9dc6-4021-a59c-151742b800fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:04.818379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 776/1540] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:04.828090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30d6b4-d336-46c3-bdfb-63a5d622009e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:04.830297 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30d6b4-d336-46c3-bdfb-63a5d622009e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:04.830297 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30d6b4-d336-46c3-bdfb-63a5d622009e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:04.855076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bf30d6b4-d336-46c3-bdfb-63a5d622009e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:04.856852 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bf30d6b4-d336-46c3-bdfb-63a5d622009e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:04.871143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 765/1541] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:04.876181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa5b74-9dc6-4021-a59c-151742b800fc None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:04.880673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e561e9-63e6-43ea-9edb-da93e918bd49 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:04.881488 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e561e9-63e6-43ea-9edb-da93e918bd49 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:04.882064 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e561e9-63e6-43ea-9edb-da93e918bd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:04.888177 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa5b74-9dc6-4021-a59c-151742b800fc None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:04.900669 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a2657-678f-4f8a-a43c-960051c26563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:04.901801 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2657-678f-4f8a-a43c-960051c26563 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:04.902093 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2657-678f-4f8a-a43c-960051c26563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:04.902372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2657-678f-4f8a-a43c-960051c26563 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:04.903116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a2657-678f-4f8a-a43c-960051c26563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:04.903428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a2657-678f-4f8a-a43c-960051c26563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:04.905384 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a2657-678f-4f8a-a43c-960051c26563 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:04.918756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-45e561e9-63e6-43ea-9edb-da93e918bd49 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:04.921074 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-45e561e9-63e6-43ea-9edb-da93e918bd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:04.930670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 777/1542] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:04.943579 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 766/1543] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:04.945730 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a2657-678f-4f8a-a43c-960051c26563 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:04.952608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89cfc8-6968-4bdd-be9a-d3961b1eec39 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:04.953212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89cfc8-6968-4bdd-be9a-d3961b1eec39 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:04.953868 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89cfc8-6968-4bdd-be9a-d3961b1eec39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:04.960940 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a2657-678f-4f8a-a43c-960051c26563 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:04.974300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ca846e-086d-4c93-98f0-dba279c99cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:04.974627 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca846e-086d-4c93-98f0-dba279c99cee admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:04.974889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca846e-086d-4c93-98f0-dba279c99cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:04.975192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ca846e-086d-4c93-98f0-dba279c99cee admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:04.975895 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca846e-086d-4c93-98f0-dba279c99cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:04.981888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-68ca846e-086d-4c93-98f0-dba279c99cee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:47:04.981888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: warnings.warn(msg) Jul 20 22:47:04.981888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: Jul 20 22:47:04.981888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ca846e-086d-4c93-98f0-dba279c99cee admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:04.990761 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8a89cfc8-6968-4bdd-be9a-d3961b1eec39 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:04.992292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8a89cfc8-6968-4bdd-be9a-d3961b1eec39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:05.012323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 767/1544] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:05.017127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac931596-a904-4b2a-be8f-d741f84b5b57 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.017688 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac931596-a904-4b2a-be8f-d741f84b5b57 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.018225 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac931596-a904-4b2a-be8f-d741f84b5b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.054728 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ac931596-a904-4b2a-be8f-d741f84b5b57 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:05.056547 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ac931596-a904-4b2a-be8f-d741f84b5b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:05.084736 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 768/1545] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:05.085875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac931596-a904-4b2a-be8f-d741f84b5b57 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.104511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac931596-a904-4b2a-be8f-d741f84b5b57 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.112276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440df1eb-0330-490e-9461-b8aaf8b48ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.113035 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440df1eb-0330-490e-9461-b8aaf8b48ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.113346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440df1eb-0330-490e-9461-b8aaf8b48ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.113581 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440df1eb-0330-490e-9461-b8aaf8b48ce8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.114355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440df1eb-0330-490e-9461-b8aaf8b48ce8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:05.114660 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440df1eb-0330-490e-9461-b8aaf8b48ce8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.115685 dv-cinder-799871-38-smb devstack@keystone.service[80615]: WARNING py.warnings [None req-440df1eb-0330-490e-9461-b8aaf8b48ce8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:47:05.115685 dv-cinder-799871-38-smb devstack@keystone.service[80615]: warnings.warn(msg) Jul 20 22:47:05.115685 dv-cinder-799871-38-smb devstack@keystone.service[80615]: Jul 20 22:47:05.116584 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440df1eb-0330-490e-9461-b8aaf8b48ce8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.137973 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 769/1546] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:05.139093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535be12-6294-4040-bf48-f2e6dc5d1537 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.139385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535be12-6294-4040-bf48-f2e6dc5d1537 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.139663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535be12-6294-4040-bf48-f2e6dc5d1537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.139951 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 778/1547] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:04 2022] POST /identity/v3/projects => generated 389 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:05.141323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4ef0-752a-4424-8931-2bda59d20198 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.141768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4ef0-752a-4424-8931-2bda59d20198 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.142033 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a4ef0-752a-4424-8931-2bda59d20198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.173941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e535be12-6294-4040-bf48-f2e6dc5d1537 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:05.176980 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e535be12-6294-4040-bf48-f2e6dc5d1537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:05.178241 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-db8a4ef0-752a-4424-8931-2bda59d20198 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:05.180739 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-db8a4ef0-752a-4424-8931-2bda59d20198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:05.265231 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 770/1548] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:05.269767 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535be12-6294-4040-bf48-f2e6dc5d1537 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.276819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535be12-6294-4040-bf48-f2e6dc5d1537 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.280494 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 779/1549] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:05.281704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a4ef0-752a-4424-8931-2bda59d20198 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.281966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e95c1f-5159-43a8-a7e6-b3c1547fdd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.282647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e95c1f-5159-43a8-a7e6-b3c1547fdd2f admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.282935 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e95c1f-5159-43a8-a7e6-b3c1547fdd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.283217 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e95c1f-5159-43a8-a7e6-b3c1547fdd2f admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.284065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e95c1f-5159-43a8-a7e6-b3c1547fdd2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.288209 dv-cinder-799871-38-smb devstack@keystone.service[80615]: WARNING py.warnings [None req-52e95c1f-5159-43a8-a7e6-b3c1547fdd2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:47:05.288209 dv-cinder-799871-38-smb devstack@keystone.service[80615]: warnings.warn(msg) Jul 20 22:47:05.288209 dv-cinder-799871-38-smb devstack@keystone.service[80615]: Jul 20 22:47:05.288209 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e95c1f-5159-43a8-a7e6-b3c1547fdd2f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.292906 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a4ef0-752a-4424-8931-2bda59d20198 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.298103 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9d175-4537-4ad7-a67c-617ac88ad6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.298817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9d175-4537-4ad7-a67c-617ac88ad6a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.299109 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9d175-4537-4ad7-a67c-617ac88ad6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.299387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9d175-4537-4ad7-a67c-617ac88ad6a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.300216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9d175-4537-4ad7-a67c-617ac88ad6a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.302197 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9d175-4537-4ad7-a67c-617ac88ad6a1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.410282 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 771/1550] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/users => generated 295 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:05.411581 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688053b2-76a5-442d-97c8-ff1d24513362 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.411877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688053b2-76a5-442d-97c8-ff1d24513362 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.412158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688053b2-76a5-442d-97c8-ff1d24513362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.430566 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-688053b2-76a5-442d-97c8-ff1d24513362 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:05.431775 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-688053b2-76a5-442d-97c8-ff1d24513362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:05.439854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 772/1551] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:05.441683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb963ed6-eb58-4d1e-8f3a-b9d37ffbd115 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.442016 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb963ed6-eb58-4d1e-8f3a-b9d37ffbd115 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.442294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb963ed6-eb58-4d1e-8f3a-b9d37ffbd115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.445157 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 780/1552] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:05.446570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ee6e9-fc3e-4c43-ae24-e6cdcc8bae2c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.446866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ee6e9-fc3e-4c43-ae24-e6cdcc8bae2c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.447300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ee6e9-fc3e-4c43-ae24-e6cdcc8bae2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.461577 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-fb963ed6-eb58-4d1e-8f3a-b9d37ffbd115 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:05.462896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fb963ed6-eb58-4d1e-8f3a-b9d37ffbd115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:05.466150 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-994ee6e9-fc3e-4c43-ae24-e6cdcc8bae2c None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:05.467324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-994ee6e9-fc3e-4c43-ae24-e6cdcc8bae2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:05.525540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 773/1553] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:05.526784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7b11b-f6af-4778-a3a1-b3add7629fb5 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.527076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7b11b-f6af-4778-a3a1-b3add7629fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.527365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7b11b-f6af-4778-a3a1-b3add7629fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.537752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 781/1554] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:05.537752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ee6e9-fc3e-4c43-ae24-e6cdcc8bae2c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.543453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ee6e9-fc3e-4c43-ae24-e6cdcc8bae2c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.548043 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8c590-64f8-4abf-bf21-4ea8daf0fd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.548698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8c590-64f8-4abf-bf21-4ea8daf0fd4d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.548981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8c590-64f8-4abf-bf21-4ea8daf0fd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.549258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8c590-64f8-4abf-bf21-4ea8daf0fd4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.550067 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8c590-64f8-4abf-bf21-4ea8daf0fd4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:05.550374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8c590-64f8-4abf-bf21-4ea8daf0fd4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.550777 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-80e7b11b-f6af-4778-a3a1-b3add7629fb5 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:05.553826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8c590-64f8-4abf-bf21-4ea8daf0fd4d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.553968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-80e7b11b-f6af-4778-a3a1-b3add7629fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:05.560351 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 774/1555] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:05.561630 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e970e-e665-4dfb-b795-af0eb3510b12 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.561976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e970e-e665-4dfb-b795-af0eb3510b12 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.562275 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e970e-e665-4dfb-b795-af0eb3510b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.572615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 782/1556] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:05.572615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8c590-64f8-4abf-bf21-4ea8daf0fd4d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.580587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-235e970e-e665-4dfb-b795-af0eb3510b12 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:05.582499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8c590-64f8-4abf-bf21-4ea8daf0fd4d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.582623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-235e970e-e665-4dfb-b795-af0eb3510b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:05.587113 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bec47-2474-4080-b5f8-92116da8a313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.587779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bec47-2474-4080-b5f8-92116da8a313 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.588071 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bec47-2474-4080-b5f8-92116da8a313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.588352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bec47-2474-4080-b5f8-92116da8a313 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.589085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bec47-2474-4080-b5f8-92116da8a313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.590716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 775/1557] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:05.590849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bec47-2474-4080-b5f8-92116da8a313 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.591474 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e970e-e665-4dfb-b795-af0eb3510b12 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.602390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 783/1558] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:05.602577 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e970e-e665-4dfb-b795-af0eb3510b12 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.603534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0186f-abe6-4fed-a892-6f3ab5cfbe0a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.603829 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0186f-abe6-4fed-a892-6f3ab5cfbe0a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.604119 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0186f-abe6-4fed-a892-6f3ab5cfbe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.607458 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82967fa7-abb4-4cf9-ac52-c958bbb2e613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.608119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82967fa7-abb4-4cf9-ac52-c958bbb2e613 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.608407 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82967fa7-abb4-4cf9-ac52-c958bbb2e613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.608686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82967fa7-abb4-4cf9-ac52-c958bbb2e613 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.609376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82967fa7-abb4-4cf9-ac52-c958bbb2e613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.611347 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82967fa7-abb4-4cf9-ac52-c958bbb2e613 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.614818 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:05.625845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5af0186f-abe6-4fed-a892-6f3ab5cfbe0a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:05.627047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5af0186f-abe6-4fed-a892-6f3ab5cfbe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:05.635826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 784/1559] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:05.637704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3229871-fa1c-4ff8-95d9-14b0805807ab None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.638042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3229871-fa1c-4ff8-95d9-14b0805807ab None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.638319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3229871-fa1c-4ff8-95d9-14b0805807ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.655703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f3229871-fa1c-4ff8-95d9-14b0805807ab None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:05.656870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f3229871-fa1c-4ff8-95d9-14b0805807ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:05.665879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 785/1560] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:05.667133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dade7-2311-45f5-9c14-c3c5d0d43963 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.667422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dade7-2311-45f5-9c14-c3c5d0d43963 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.667695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dade7-2311-45f5-9c14-c3c5d0d43963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.687334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c99dade7-2311-45f5-9c14-c3c5d0d43963 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:05.688509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c99dade7-2311-45f5-9c14-c3c5d0d43963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:05.696387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 786/1561] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:05.697144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dade7-2311-45f5-9c14-c3c5d0d43963 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.706030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dade7-2311-45f5-9c14-c3c5d0d43963 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.711047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d85e11-2cb1-4fde-aec1-d40f3a4bb93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.711671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d85e11-2cb1-4fde-aec1-d40f3a4bb93a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.711966 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d85e11-2cb1-4fde-aec1-d40f3a4bb93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.712232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d85e11-2cb1-4fde-aec1-d40f3a4bb93a admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.712960 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d85e11-2cb1-4fde-aec1-d40f3a4bb93a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:05.713661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d85e11-2cb1-4fde-aec1-d40f3a4bb93a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.715793 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d85e11-2cb1-4fde-aec1-d40f3a4bb93a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.720447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 776/1562] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:05.722603 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82967fa7-abb4-4cf9-ac52-c958bbb2e613 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.736744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 787/1563] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:05.736744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944a0ba-355e-4420-a788-c7ae6cabc39e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.736744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944a0ba-355e-4420-a788-c7ae6cabc39e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.736744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944a0ba-355e-4420-a788-c7ae6cabc39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.737245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82967fa7-abb4-4cf9-ac52-c958bbb2e613 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.741915 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba53d9-36fa-4f1a-87d2-03a2ba4c4680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.742588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba53d9-36fa-4f1a-87d2-03a2ba4c4680 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.742874 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba53d9-36fa-4f1a-87d2-03a2ba4c4680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.743201 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba53d9-36fa-4f1a-87d2-03a2ba4c4680 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.743923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba53d9-36fa-4f1a-87d2-03a2ba4c4680 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.745937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba53d9-36fa-4f1a-87d2-03a2ba4c4680 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.749317 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0944a0ba-355e-4420-a788-c7ae6cabc39e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:05.749482 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:05.750653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0944a0ba-355e-4420-a788-c7ae6cabc39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:05.759502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 788/1564] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:05.760372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944a0ba-355e-4420-a788-c7ae6cabc39e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.770720 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944a0ba-355e-4420-a788-c7ae6cabc39e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.775143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f7ce8-1aa4-479c-b6bb-a05703b60432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.781212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f7ce8-1aa4-479c-b6bb-a05703b60432 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.781212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f7ce8-1aa4-479c-b6bb-a05703b60432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.781212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f7ce8-1aa4-479c-b6bb-a05703b60432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.781212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f7ce8-1aa4-479c-b6bb-a05703b60432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.781212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f7ce8-1aa4-479c-b6bb-a05703b60432 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.789553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 789/1565] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:05.790420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f7ce8-1aa4-479c-b6bb-a05703b60432 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.799687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f7ce8-1aa4-479c-b6bb-a05703b60432 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.804724 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0614e-bd66-48ae-b5cd-233d72778e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.805333 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0614e-bd66-48ae-b5cd-233d72778e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.805607 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0614e-bd66-48ae-b5cd-233d72778e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.805905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0614e-bd66-48ae-b5cd-233d72778e06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.806601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0614e-bd66-48ae-b5cd-233d72778e06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:05.806901 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0614e-bd66-48ae-b5cd-233d72778e06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.808418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0614e-bd66-48ae-b5cd-233d72778e06 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.820372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 790/1566] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:05.821269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0614e-bd66-48ae-b5cd-233d72778e06 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.830332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0614e-bd66-48ae-b5cd-233d72778e06 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.836049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a22d99-eea8-4e6c-9a61-46a1e0b9651f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.836768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a22d99-eea8-4e6c-9a61-46a1e0b9651f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.837120 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a22d99-eea8-4e6c-9a61-46a1e0b9651f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.837489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a22d99-eea8-4e6c-9a61-46a1e0b9651f admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.838321 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a22d99-eea8-4e6c-9a61-46a1e0b9651f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:05.838787 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a22d99-eea8-4e6c-9a61-46a1e0b9651f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.840489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a22d99-eea8-4e6c-9a61-46a1e0b9651f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.841863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 777/1567] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/projects => generated 365 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:05.842703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba53d9-36fa-4f1a-87d2-03a2ba4c4680 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.854475 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 791/1568] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:05.855291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a22d99-eea8-4e6c-9a61-46a1e0b9651f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.866189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a22d99-eea8-4e6c-9a61-46a1e0b9651f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.911800 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba53d9-36fa-4f1a-87d2-03a2ba4c4680 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.916925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baacfd-0e8f-4b5c-9ab6-257ab0822f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.917978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baacfd-0e8f-4b5c-9ab6-257ab0822f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.918348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baacfd-0e8f-4b5c-9ab6-257ab0822f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.918668 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6baacfd-0e8f-4b5c-9ab6-257ab0822f69 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.919465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baacfd-0e8f-4b5c-9ab6-257ab0822f69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:05.919838 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baacfd-0e8f-4b5c-9ab6-257ab0822f69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.921493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6baacfd-0e8f-4b5c-9ab6-257ab0822f69 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.922780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6554a8-e4d7-435d-9d94-44f34e19f458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.923453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6554a8-e4d7-435d-9d94-44f34e19f458 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.923733 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6554a8-e4d7-435d-9d94-44f34e19f458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.924398 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6554a8-e4d7-435d-9d94-44f34e19f458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.924757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6554a8-e4d7-435d-9d94-44f34e19f458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.926414 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6554a8-e4d7-435d-9d94-44f34e19f458 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.934156 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 778/1569] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:05.934816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baacfd-0e8f-4b5c-9ab6-257ab0822f69 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.936849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 792/1570] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:05.937761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6554a8-e4d7-435d-9d94-44f34e19f458 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.947627 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6554a8-e4d7-435d-9d94-44f34e19f458 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.947841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6baacfd-0e8f-4b5c-9ab6-257ab0822f69 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.952192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c02f2-59eb-4ac5-b1f5-25f5cdc9b924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.952377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95d438-ec14-4795-bddc-4778252e7899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.952911 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c02f2-59eb-4ac5-b1f5-25f5cdc9b924 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.953031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95d438-ec14-4795-bddc-4778252e7899 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.953201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c02f2-59eb-4ac5-b1f5-25f5cdc9b924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.953310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95d438-ec14-4795-bddc-4778252e7899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.953481 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c02f2-59eb-4ac5-b1f5-25f5cdc9b924 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.953579 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95d438-ec14-4795-bddc-4778252e7899 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.954240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c02f2-59eb-4ac5-b1f5-25f5cdc9b924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:05.954341 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95d438-ec14-4795-bddc-4778252e7899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.954552 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c02f2-59eb-4ac5-b1f5-25f5cdc9b924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:05.956614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c02f2-59eb-4ac5-b1f5-25f5cdc9b924 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.956736 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95d438-ec14-4795-bddc-4778252e7899 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:05.969203 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 793/1571] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:05.970022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c02f2-59eb-4ac5-b1f5-25f5cdc9b924 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:05.979988 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c02f2-59eb-4ac5-b1f5-25f5cdc9b924 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:05.984506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3767e-a41f-42aa-97d8-256c6edb68f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:05.991305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3767e-a41f-42aa-97d8-256c6edb68f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:05.991305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3767e-a41f-42aa-97d8-256c6edb68f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:05.991305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3767e-a41f-42aa-97d8-256c6edb68f2 admin admin] PATH_INFO: `/v3/projects/c037542d907a458fa792a3d55759c787/users/f6a84e6c6706453cb3973dd89c2ea1e1/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:05.999999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3767e-a41f-42aa-97d8-256c6edb68f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c037542d907a458fa792a3d55759c787, user_id=f6a84e6c6706453cb3973dd89c2ea1e1, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:06.001023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-20e3767e-a41f-42aa-97d8-256c6edb68f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:47:06.001023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: warnings.warn(msg) Jul 20 22:47:06.001023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: Jul 20 22:47:06.003025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3767e-a41f-42aa-97d8-256c6edb68f2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:06.044239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 779/1572] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:05 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:06.044239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95d438-ec14-4795-bddc-4778252e7899 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:06.070033 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 794/1573] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:05 2022] PUT /identity/v3/projects/c037542d907a458fa792a3d55759c787/users/f6a84e6c6706453cb3973dd89c2ea1e1/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:06.070033 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3767e-a41f-42aa-97d8-256c6edb68f2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:06.111283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95d438-ec14-4795-bddc-4778252e7899 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:06.125098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:06.140489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3767e-a41f-42aa-97d8-256c6edb68f2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:06.146312 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40784e-a80c-4d17-b2a6-6d9cf8a3b82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:06.147036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40784e-a80c-4d17-b2a6-6d9cf8a3b82d admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:06.147531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40784e-a80c-4d17-b2a6-6d9cf8a3b82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:06.147987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af40784e-a80c-4d17-b2a6-6d9cf8a3b82d admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:06.149070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40784e-a80c-4d17-b2a6-6d9cf8a3b82d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:06.151071 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af40784e-a80c-4d17-b2a6-6d9cf8a3b82d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:06.168952 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22e5af-d7d3-4c06-ba9d-ae6d87810128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:06.169616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22e5af-d7d3-4c06-ba9d-ae6d87810128 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:06.169926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22e5af-d7d3-4c06-ba9d-ae6d87810128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:06.170203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d22e5af-d7d3-4c06-ba9d-ae6d87810128 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:06.170890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22e5af-d7d3-4c06-ba9d-ae6d87810128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:06.172784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d22e5af-d7d3-4c06-ba9d-ae6d87810128 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:06.181066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:06.263209 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 795/1574] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:06 2022] POST /identity/v3/users => generated 283 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:06.264172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40784e-a80c-4d17-b2a6-6d9cf8a3b82d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:06.274773 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af40784e-a80c-4d17-b2a6-6d9cf8a3b82d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:06.279450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30ce75-5e42-4852-a8b4-9a91ad38220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:06.280115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ce75-5e42-4852-a8b4-9a91ad38220d admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:06.280412 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ce75-5e42-4852-a8b4-9a91ad38220d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:06.280681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ce75-5e42-4852-a8b4-9a91ad38220d admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:06.281362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30ce75-5e42-4852-a8b4-9a91ad38220d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:06.283365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30ce75-5e42-4852-a8b4-9a91ad38220d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:06.306000 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 780/1575] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:06 2022] POST /identity/v3/projects => generated 393 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:06.306000 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22e5af-d7d3-4c06-ba9d-ae6d87810128 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:06.362117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d22e5af-d7d3-4c06-ba9d-ae6d87810128 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:06.367015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19d26c-005f-4b76-ba14-dd5b65c4476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:06.367790 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19d26c-005f-4b76-ba14-dd5b65c4476f admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:06.368017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19d26c-005f-4b76-ba14-dd5b65c4476f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:06.368296 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19d26c-005f-4b76-ba14-dd5b65c4476f admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:06.369031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19d26c-005f-4b76-ba14-dd5b65c4476f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:06.370666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19d26c-005f-4b76-ba14-dd5b65c4476f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:06.380782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 781/1576] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:06.381976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19d26c-005f-4b76-ba14-dd5b65c4476f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:06.391365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19d26c-005f-4b76-ba14-dd5b65c4476f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:06.396800 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d85b-9fc4-45e5-812f-8591bbaedcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:06.397403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d85b-9fc4-45e5-812f-8591bbaedcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:06.397687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d85b-9fc4-45e5-812f-8591bbaedcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:06.397998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762d85b-9fc4-45e5-812f-8591bbaedcb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:06.398666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762d85b-9fc4-45e5-812f-8591bbaedcb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:06.400484 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762d85b-9fc4-45e5-812f-8591bbaedcb1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:06.457592 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 796/1577] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:06 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:06.458607 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30ce75-5e42-4852-a8b4-9a91ad38220d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:06.498297 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 782/1578] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:06 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:06.499238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d85b-9fc4-45e5-812f-8591bbaedcb1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:06.524021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30ce75-5e42-4852-a8b4-9a91ad38220d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:06.564619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762d85b-9fc4-45e5-812f-8591bbaedcb1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:06.569686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725e1db-f743-4cc5-9794-708ea4f61160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:06.570535 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e1db-f743-4cc5-9794-708ea4f61160 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:06.570818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e1db-f743-4cc5-9794-708ea4f61160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:06.571093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725e1db-f743-4cc5-9794-708ea4f61160 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:06.571781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725e1db-f743-4cc5-9794-708ea4f61160 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:06.573762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7725e1db-f743-4cc5-9794-708ea4f61160 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:06.582572 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911286c-d92c-4677-a4b1-d6d4005fcf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:06.583672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911286c-d92c-4677-a4b1-d6d4005fcf4e admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:06.584295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911286c-d92c-4677-a4b1-d6d4005fcf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:06.584584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911286c-d92c-4677-a4b1-d6d4005fcf4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:06.585426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911286c-d92c-4677-a4b1-d6d4005fcf4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:06.587422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c911286c-d92c-4677-a4b1-d6d4005fcf4e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:06.662192 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 783/1579] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:06 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:06.663521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160fe5-2849-4f7e-8ce1-eef51b4e3bcb None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:06.663804 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160fe5-2849-4f7e-8ce1-eef51b4e3bcb None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:06.664082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160fe5-2849-4f7e-8ce1-eef51b4e3bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:06.681282 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c5160fe5-2849-4f7e-8ce1-eef51b4e3bcb None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:06.682508 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c5160fe5-2849-4f7e-8ce1-eef51b4e3bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:06.690254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 784/1580] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:06.691541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5160fe5-2849-4f7e-8ce1-eef51b4e3bcb None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:06.693494 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 797/1581] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:06 2022] POST /identity/v3/projects => generated 367 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:06.694786 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911286c-d92c-4677-a4b1-d6d4005fcf4e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:06.703048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5160fe5-2849-4f7e-8ce1-eef51b4e3bcb None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:06.750367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:06.751082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:06.764381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313dcf3-e481-488d-acf7-61c48a7cdbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:06.765063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313dcf3-e481-488d-acf7-61c48a7cdbaa admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:06.765359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911286c-d92c-4677-a4b1-d6d4005fcf4e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:06.765472 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313dcf3-e481-488d-acf7-61c48a7cdbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:06.765654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a313dcf3-e481-488d-acf7-61c48a7cdbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:06.766375 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313dcf3-e481-488d-acf7-61c48a7cdbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:06.767974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a313dcf3-e481-488d-acf7-61c48a7cdbaa admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:06.771105 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74dc34-5e9b-4c80-b84a-e06daab879da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:06.771779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74dc34-5e9b-4c80-b84a-e06daab879da admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:06.772065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74dc34-5e9b-4c80-b84a-e06daab879da admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:06.772348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74dc34-5e9b-4c80-b84a-e06daab879da admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:06.773041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74dc34-5e9b-4c80-b84a-e06daab879da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:06.775153 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74dc34-5e9b-4c80-b84a-e06daab879da admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:06.778449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 785/1582] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:06.779224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313dcf3-e481-488d-acf7-61c48a7cdbaa admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:06.789570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a313dcf3-e481-488d-acf7-61c48a7cdbaa admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:06.794436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c27cf8-a93a-4bc7-94fe-b32d797c7c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:06.795308 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c27cf8-a93a-4bc7-94fe-b32d797c7c7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:06.795592 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c27cf8-a93a-4bc7-94fe-b32d797c7c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:06.795871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c27cf8-a93a-4bc7-94fe-b32d797c7c7b admin admin] PATH_INFO: `/v3/projects/9ad5b761a3584a2cb6cfbec8ac0fb697/users/1d15df7f6b0d45c2acb1935945b164ae/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:06.810184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c27cf8-a93a-4bc7-94fe-b32d797c7c7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad5b761a3584a2cb6cfbec8ac0fb697, user_id=1d15df7f6b0d45c2acb1935945b164ae, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:06.812836 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c27cf8-a93a-4bc7-94fe-b32d797c7c7b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:06.952305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 786/1583] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:06 2022] PUT /identity/v3/projects/9ad5b761a3584a2cb6cfbec8ac0fb697/users/1d15df7f6b0d45c2acb1935945b164ae/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:06.954515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 798/1584] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:06 2022] POST /identity/v3/users => generated 297 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:06.954637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c27cf8-a93a-4bc7-94fe-b32d797c7c7b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:06.954745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74dc34-5e9b-4c80-b84a-e06daab879da admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:06.964555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74dc34-5e9b-4c80-b84a-e06daab879da admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.019562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c27cf8-a93a-4bc7-94fe-b32d797c7c7b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.023688 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b398b4-7523-4458-80d6-93a978f745a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.024370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b398b4-7523-4458-80d6-93a978f745a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.024546 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b48d9-1d79-40ed-9b8b-b9e0c9d4e84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.024672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b398b4-7523-4458-80d6-93a978f745a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.024921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b398b4-7523-4458-80d6-93a978f745a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.025218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b48d9-1d79-40ed-9b8b-b9e0c9d4e84c admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.025525 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b48d9-1d79-40ed-9b8b-b9e0c9d4e84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.025646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b398b4-7523-4458-80d6-93a978f745a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.025859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b48d9-1d79-40ed-9b8b-b9e0c9d4e84c admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.026486 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b48d9-1d79-40ed-9b8b-b9e0c9d4e84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.027649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b398b4-7523-4458-80d6-93a978f745a8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.028361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b48d9-1d79-40ed-9b8b-b9e0c9d4e84c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.139069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 799/1585] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:06 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:07.139069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b398b4-7523-4458-80d6-93a978f745a8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.147498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b398b4-7523-4458-80d6-93a978f745a8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.148245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 787/1586] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:06 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:07.149262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b48d9-1d79-40ed-9b8b-b9e0c9d4e84c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.152591 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0678f7a-011c-423a-96a6-0bfb3c181d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.153258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0678f7a-011c-423a-96a6-0bfb3c181d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.153544 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0678f7a-011c-423a-96a6-0bfb3c181d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.153857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0678f7a-011c-423a-96a6-0bfb3c181d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.154599 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0678f7a-011c-423a-96a6-0bfb3c181d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.156335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0678f7a-011c-423a-96a6-0bfb3c181d6d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.159474 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b48d9-1d79-40ed-9b8b-b9e0c9d4e84c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.164304 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002cf0d-b8ad-4ad3-9411-183df8539dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.164991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002cf0d-b8ad-4ad3-9411-183df8539dce admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.165298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002cf0d-b8ad-4ad3-9411-183df8539dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.165570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002cf0d-b8ad-4ad3-9411-183df8539dce admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.166295 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002cf0d-b8ad-4ad3-9411-183df8539dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.168237 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002cf0d-b8ad-4ad3-9411-183df8539dce admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.168771 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 800/1587] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:07.172005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0678f7a-011c-423a-96a6-0bfb3c181d6d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.224515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0678f7a-011c-423a-96a6-0bfb3c181d6d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.228107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198a162-b3a2-41c6-8b39-8e6c4c54c4d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.228754 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a162-b3a2-41c6-8b39-8e6c4c54c4d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.229038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a162-b3a2-41c6-8b39-8e6c4c54c4d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.229317 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a162-b3a2-41c6-8b39-8e6c4c54c4d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.239502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198a162-b3a2-41c6-8b39-8e6c4c54c4d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.241143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198a162-b3a2-41c6-8b39-8e6c4c54c4d0 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.250881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 801/1588] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:07.251773 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198a162-b3a2-41c6-8b39-8e6c4c54c4d0 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.259302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 788/1589] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:07 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:07.263602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002cf0d-b8ad-4ad3-9411-183df8539dce admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.263721 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198a162-b3a2-41c6-8b39-8e6c4c54c4d0 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.268280 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6864d37-7b0d-435f-b21b-85f677835346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.269465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6864d37-7b0d-435f-b21b-85f677835346 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.269778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6864d37-7b0d-435f-b21b-85f677835346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.270064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6864d37-7b0d-435f-b21b-85f677835346 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.270169 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002cf0d-b8ad-4ad3-9411-183df8539dce admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.271240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6864d37-7b0d-435f-b21b-85f677835346 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.272583 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6864d37-7b0d-435f-b21b-85f677835346 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.275977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d2a7c-9c48-4efc-ab95-45f247fccaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.276691 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d2a7c-9c48-4efc-ab95-45f247fccaeb admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.276981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d2a7c-9c48-4efc-ab95-45f247fccaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.277264 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d2a7c-9c48-4efc-ab95-45f247fccaeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.278222 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d2a7c-9c48-4efc-ab95-45f247fccaeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.280242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5d2a7c-9c48-4efc-ab95-45f247fccaeb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.284780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 802/1590] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:07.285393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a8109-9760-41a5-b1ae-b8ec3bc127a7 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.285682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a8109-9760-41a5-b1ae-b8ec3bc127a7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.288430 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a8109-9760-41a5-b1ae-b8ec3bc127a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.293491 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 789/1591] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:07.294440 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d2a7c-9c48-4efc-ab95-45f247fccaeb admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.305067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d2a7c-9c48-4efc-ab95-45f247fccaeb admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.310099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152608ab-5508-4a3b-baa8-a17635a6f51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.310759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152608ab-5508-4a3b-baa8-a17635a6f51b admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.311050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152608ab-5508-4a3b-baa8-a17635a6f51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.311332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152608ab-5508-4a3b-baa8-a17635a6f51b admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.312068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152608ab-5508-4a3b-baa8-a17635a6f51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.313708 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152608ab-5508-4a3b-baa8-a17635a6f51b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.314302 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b27a8109-9760-41a5-b1ae-b8ec3bc127a7 None None] MFA Rules not processed for user `1d15df7f6b0d45c2acb1935945b164ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:07.316554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b27a8109-9760-41a5-b1ae-b8ec3bc127a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:07.325814 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 790/1592] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:07.326872 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152608ab-5508-4a3b-baa8-a17635a6f51b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.338294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152608ab-5508-4a3b-baa8-a17635a6f51b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.344178 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a392c18-f04c-465e-9bae-785f46e26647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.344854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a392c18-f04c-465e-9bae-785f46e26647 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.345131 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a392c18-f04c-465e-9bae-785f46e26647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.345402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a392c18-f04c-465e-9bae-785f46e26647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.346150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a392c18-f04c-465e-9bae-785f46e26647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.348268 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a392c18-f04c-465e-9bae-785f46e26647 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.350124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:07.358977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 791/1593] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:07.359992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a392c18-f04c-465e-9bae-785f46e26647 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.370587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a392c18-f04c-465e-9bae-785f46e26647 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.375748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe43ca-4d56-4dd8-8882-ba807a21fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.376410 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe43ca-4d56-4dd8-8882-ba807a21fd3b admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.376698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe43ca-4d56-4dd8-8882-ba807a21fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.376977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe43ca-4d56-4dd8-8882-ba807a21fd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.377707 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe43ca-4d56-4dd8-8882-ba807a21fd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.380998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe43ca-4d56-4dd8-8882-ba807a21fd3b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.384566 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 803/1594] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:07.385210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a8109-9760-41a5-b1ae-b8ec3bc127a7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.396110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a8109-9760-41a5-b1ae-b8ec3bc127a7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.397922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 792/1595] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:07.399734 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe43ca-4d56-4dd8-8882-ba807a21fd3b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.406336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7d6c2-1fc3-49c3-ada5-6d188050a429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.407574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d6c2-1fc3-49c3-ada5-6d188050a429 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.407762 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d6c2-1fc3-49c3-ada5-6d188050a429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.408057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7d6c2-1fc3-49c3-ada5-6d188050a429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.409064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7d6c2-1fc3-49c3-ada5-6d188050a429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.411426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe43ca-4d56-4dd8-8882-ba807a21fd3b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.411670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7d6c2-1fc3-49c3-ada5-6d188050a429 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.416560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6285fca-417d-40df-b039-cb1316740ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.417615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285fca-417d-40df-b039-cb1316740ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.417952 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285fca-417d-40df-b039-cb1316740ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.418336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6285fca-417d-40df-b039-cb1316740ceb admin admin] PATH_INFO: `/v3/projects/9afa05a1f4d24996a1ce92e2be836df0/users/54475a194f664817a9c5fd7fda87c08d/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.428381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 804/1596] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:07.429446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7d6c2-1fc3-49c3-ada5-6d188050a429 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.439390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6285fca-417d-40df-b039-cb1316740ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9afa05a1f4d24996a1ce92e2be836df0, user_id=54475a194f664817a9c5fd7fda87c08d, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.441407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7d6c2-1fc3-49c3-ada5-6d188050a429 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.443985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6285fca-417d-40df-b039-cb1316740ceb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.445874 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc59b3-6070-4013-aa83-17e24d07c1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.446501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc59b3-6070-4013-aa83-17e24d07c1de admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.446883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc59b3-6070-4013-aa83-17e24d07c1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.447221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcc59b3-6070-4013-aa83-17e24d07c1de admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.448013 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc59b3-6070-4013-aa83-17e24d07c1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.449652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcc59b3-6070-4013-aa83-17e24d07c1de admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.461549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 805/1597] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:07.464122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc59b3-6070-4013-aa83-17e24d07c1de admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.472674 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcc59b3-6070-4013-aa83-17e24d07c1de admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.477342 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c659d-e8df-477b-886c-7e96d6b15895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.477962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c659d-e8df-477b-886c-7e96d6b15895 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.478245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c659d-e8df-477b-886c-7e96d6b15895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.478522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c659d-e8df-477b-886c-7e96d6b15895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.479356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c659d-e8df-477b-886c-7e96d6b15895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.480841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c659d-e8df-477b-886c-7e96d6b15895 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.491739 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 806/1598] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:07.492543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c659d-e8df-477b-886c-7e96d6b15895 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.501605 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c659d-e8df-477b-886c-7e96d6b15895 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.507269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0fe40-58a9-4942-bbe6-e862c2f2f678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.507933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0fe40-58a9-4942-bbe6-e862c2f2f678 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.508223 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0fe40-58a9-4942-bbe6-e862c2f2f678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.508519 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0fe40-58a9-4942-bbe6-e862c2f2f678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.509257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0fe40-58a9-4942-bbe6-e862c2f2f678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.510846 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0fe40-58a9-4942-bbe6-e862c2f2f678 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.521109 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 807/1599] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:07.521907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0fe40-58a9-4942-bbe6-e862c2f2f678 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.530477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 793/1600] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:07 2022] PUT /identity/v3/projects/9afa05a1f4d24996a1ce92e2be836df0/users/54475a194f664817a9c5fd7fda87c08d/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:07.531368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0fe40-58a9-4942-bbe6-e862c2f2f678 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.532943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a83caa-50a3-4d23-b66f-f009eeb6ab1a None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.532943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a83caa-50a3-4d23-b66f-f009eeb6ab1a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.532943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a83caa-50a3-4d23-b66f-f009eeb6ab1a None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.533937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 794/1601] 10.222.0.83 () {54 vars in 962 bytes} [Wed Jul 20 22:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:47:07.534644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a83caa-50a3-4d23-b66f-f009eeb6ab1a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.569221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:07.615987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f060605-de59-465b-b3f6-8ec2350374d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.616901 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f060605-de59-465b-b3f6-8ec2350374d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.617183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f060605-de59-465b-b3f6-8ec2350374d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.617459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f060605-de59-465b-b3f6-8ec2350374d5 admin admin] PATH_INFO: `/v3/projects/356d78f2184241189afad7853708a8f2/users/d3366521d2f54b5e925103a0a5c60d2a/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.629003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a83caa-50a3-4d23-b66f-f009eeb6ab1a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.634982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4ed42-cea5-4cbf-a4c8-fdd91d1dc029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.635669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ed42-cea5-4cbf-a4c8-fdd91d1dc029 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.635955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ed42-cea5-4cbf-a4c8-fdd91d1dc029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.636105 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f060605-de59-465b-b3f6-8ec2350374d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=356d78f2184241189afad7853708a8f2, user_id=d3366521d2f54b5e925103a0a5c60d2a, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.636507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4ed42-cea5-4cbf-a4c8-fdd91d1dc029 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.637185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4ed42-cea5-4cbf-a4c8-fdd91d1dc029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.638851 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4ed42-cea5-4cbf-a4c8-fdd91d1dc029 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.638976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f060605-de59-465b-b3f6-8ec2350374d5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.653813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 795/1602] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:07 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:07.653813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4ed42-cea5-4cbf-a4c8-fdd91d1dc029 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.661377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4ed42-cea5-4cbf-a4c8-fdd91d1dc029 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.666165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcabf1e-cff8-4d2b-af33-39c7d0cec87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.667159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcabf1e-cff8-4d2b-af33-39c7d0cec87e admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.667447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcabf1e-cff8-4d2b-af33-39c7d0cec87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.667729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcabf1e-cff8-4d2b-af33-39c7d0cec87e admin admin] PATH_INFO: `/v3/projects/e28d823aff494d508bad80997d75b2e3/users/26ef0b53b0254e3a96490839cd4dd85f/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.682874 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcabf1e-cff8-4d2b-af33-39c7d0cec87e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28d823aff494d508bad80997d75b2e3, user_id=26ef0b53b0254e3a96490839cd4dd85f, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.685704 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcabf1e-cff8-4d2b-af33-39c7d0cec87e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.702871 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 808/1603] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:07 2022] PUT /identity/v3/projects/356d78f2184241189afad7853708a8f2/users/d3366521d2f54b5e925103a0a5c60d2a/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:07.703676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f060605-de59-465b-b3f6-8ec2350374d5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.766586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f060605-de59-465b-b3f6-8ec2350374d5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.771648 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 796/1604] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:07 2022] PUT /identity/v3/projects/e28d823aff494d508bad80997d75b2e3/users/26ef0b53b0254e3a96490839cd4dd85f/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:07.771648 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcabf1e-cff8-4d2b-af33-39c7d0cec87e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:07.790453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:07.831086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e21354a-b9a1-46ec-bdb6-7b355458c9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.832839 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcabf1e-cff8-4d2b-af33-39c7d0cec87e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:07.833534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21354a-b9a1-46ec-bdb6-7b355458c9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.834042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21354a-b9a1-46ec-bdb6-7b355458c9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.835449 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e21354a-b9a1-46ec-bdb6-7b355458c9e2 admin admin] PATH_INFO: `/v3/projects/043cf5d83ff3474a8e8058b0b7f4e7bc/users/df55949e69c24ce798f2e41f71176fc4/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.839269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7c65e-be26-4abd-932e-cf3fa30b0d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:07.843410 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7c65e-be26-4abd-932e-cf3fa30b0d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.843410 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7c65e-be26-4abd-932e-cf3fa30b0d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.843410 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7c65e-be26-4abd-932e-cf3fa30b0d1f admin admin] PATH_INFO: `/v3/projects/0973ceb5be53433ea23ee59a5db985e5/users/f31005489b554f97bc36e3ad928859cd/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.853664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21354a-b9a1-46ec-bdb6-7b355458c9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=043cf5d83ff3474a8e8058b0b7f4e7bc, user_id=df55949e69c24ce798f2e41f71176fc4, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.856629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e21354a-b9a1-46ec-bdb6-7b355458c9e2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.863182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7c65e-be26-4abd-932e-cf3fa30b0d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0973ceb5be53433ea23ee59a5db985e5, user_id=f31005489b554f97bc36e3ad928859cd, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:07.866372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f7c65e-be26-4abd-932e-cf3fa30b0d1f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:07.949286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 809/1605] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:07 2022] PUT /identity/v3/projects/043cf5d83ff3474a8e8058b0b7f4e7bc/users/df55949e69c24ce798f2e41f71176fc4/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:07.950811 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8381d-5b62-4f3a-975c-0cbb13a455c2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.951096 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8381d-5b62-4f3a-975c-0cbb13a455c2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.951371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a8381d-5b62-4f3a-975c-0cbb13a455c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.978045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 797/1606] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:07 2022] PUT /identity/v3/projects/0973ceb5be53433ea23ee59a5db985e5/users/f31005489b554f97bc36e3ad928859cd/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:07.979972 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35523d-5540-4026-911f-3c6e3f42a3c2 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:07.980265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35523d-5540-4026-911f-3c6e3f42a3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:07.980545 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35523d-5540-4026-911f-3c6e3f42a3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:07.990825 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-96a8381d-5b62-4f3a-975c-0cbb13a455c2 None None] MFA Rules not processed for user `54475a194f664817a9c5fd7fda87c08d`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:07.992625 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-96a8381d-5b62-4f3a-975c-0cbb13a455c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:08.022949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3f35523d-5540-4026-911f-3c6e3f42a3c2 None None] MFA Rules not processed for user `67c92c8d2b9d41e489e4c03ae4e71fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:08.024103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3f35523d-5540-4026-911f-3c6e3f42a3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:08.066405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 810/1607] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:08.067342 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8381d-5b62-4f3a-975c-0cbb13a455c2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:08.104220 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:08.120254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 798/1608] 10.222.0.83 () {58 vars in 1059 bytes} [Wed Jul 20 22:47:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:08.121561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173e643-d00c-4962-b416-3c441f744001 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:08.121993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173e643-d00c-4962-b416-3c441f744001 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:08.122274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d173e643-d00c-4962-b416-3c441f744001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:08.141483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d173e643-d00c-4962-b416-3c441f744001 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:08.142801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d173e643-d00c-4962-b416-3c441f744001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:08.144589 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a8381d-5b62-4f3a-975c-0cbb13a455c2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:08.149553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabbf34-c93a-428e-bf79-7d78514e69d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:08.150505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabbf34-c93a-428e-bf79-7d78514e69d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:08.150787 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabbf34-c93a-428e-bf79-7d78514e69d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:08.151066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabbf34-c93a-428e-bf79-7d78514e69d5 admin admin] PATH_INFO: `/v3/projects/81744b3ca1184ee99533055ef0f581eb/users/8ccc86d2a198464ea12ab44e2340e2de/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:08.154571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 799/1609] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:08.154571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062af28-f07b-428b-9af0-9666108b1637 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:08.154571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062af28-f07b-428b-9af0-9666108b1637 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:08.154571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062af28-f07b-428b-9af0-9666108b1637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:08.171344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d062af28-f07b-428b-9af0-9666108b1637 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:08.171542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabbf34-c93a-428e-bf79-7d78514e69d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81744b3ca1184ee99533055ef0f581eb, user_id=8ccc86d2a198464ea12ab44e2340e2de, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:08.172521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d062af28-f07b-428b-9af0-9666108b1637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:08.174070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabbf34-c93a-428e-bf79-7d78514e69d5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:08.181906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 800/1610] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:08.183309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666e1f0-0928-43f5-9bf7-19e6c137d710 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:08.183666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666e1f0-0928-43f5-9bf7-19e6c137d710 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:08.184023 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666e1f0-0928-43f5-9bf7-19e6c137d710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:08.212290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b666e1f0-0928-43f5-9bf7-19e6c137d710 None None] MFA Rules not processed for user `df55949e69c24ce798f2e41f71176fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:08.213500 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b666e1f0-0928-43f5-9bf7-19e6c137d710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:08.259177 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 811/1611] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:08 2022] PUT /identity/v3/projects/81744b3ca1184ee99533055ef0f581eb/users/8ccc86d2a198464ea12ab44e2340e2de/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:08.260741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051079-4f25-4f7c-9fc1-74ce8031ecc0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:08.261105 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051079-4f25-4f7c-9fc1-74ce8031ecc0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:08.261462 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051079-4f25-4f7c-9fc1-74ce8031ecc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:08.289097 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 801/1612] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:08.290290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666e1f0-0928-43f5-9bf7-19e6c137d710 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:08.290812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-68051079-4f25-4f7c-9fc1-74ce8031ecc0 None None] MFA Rules not processed for user `f31005489b554f97bc36e3ad928859cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:08.292165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-68051079-4f25-4f7c-9fc1-74ce8031ecc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:08.303425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666e1f0-0928-43f5-9bf7-19e6c137d710 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:08.316387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:08.368024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f82b8-ba37-4834-9dc8-16c3108976e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:08.368696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f82b8-ba37-4834-9dc8-16c3108976e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:08.368982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f82b8-ba37-4834-9dc8-16c3108976e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:08.369258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f82b8-ba37-4834-9dc8-16c3108976e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:08.369992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f82b8-ba37-4834-9dc8-16c3108976e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:08.371933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f82b8-ba37-4834-9dc8-16c3108976e0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:08.382704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 812/1613] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:08.382704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68051079-4f25-4f7c-9fc1-74ce8031ecc0 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:08.449862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68051079-4f25-4f7c-9fc1-74ce8031ecc0 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:08.456815 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32496d1-6e0c-4bd1-b0da-bb7b8a7b4c6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:08.457597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32496d1-6e0c-4bd1-b0da-bb7b8a7b4c6c service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:08.457970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32496d1-6e0c-4bd1-b0da-bb7b8a7b4c6c service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:08.458251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32496d1-6e0c-4bd1-b0da-bb7b8a7b4c6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:08.482101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 802/1614] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:08 2022] POST /identity/v3/projects => generated 365 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:08.482915 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f82b8-ba37-4834-9dc8-16c3108976e0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:08.533612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32496d1-6e0c-4bd1-b0da-bb7b8a7b4c6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:08.536351 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32496d1-6e0c-4bd1-b0da-bb7b8a7b4c6c service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:08.549152 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 813/1615] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:08.550492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32496d1-6e0c-4bd1-b0da-bb7b8a7b4c6c service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:08.552231 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b32496d1-6e0c-4bd1-b0da-bb7b8a7b4c6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:08.557701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f82b8-ba37-4834-9dc8-16c3108976e0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:08.562850 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54955774-6d86-409a-9a17-6afc4556ec16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:08.563572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54955774-6d86-409a-9a17-6afc4556ec16 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:08.564412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54955774-6d86-409a-9a17-6afc4556ec16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:08.564710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54955774-6d86-409a-9a17-6afc4556ec16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:08.583558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:08.627437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32496d1-6e0c-4bd1-b0da-bb7b8a7b4c6c service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:08.633563 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123412f-ae8b-4340-b1fd-8237d6f8a215 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:08.636063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123412f-ae8b-4340-b1fd-8237d6f8a215 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:08.636063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123412f-ae8b-4340-b1fd-8237d6f8a215 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:08.636063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123412f-ae8b-4340-b1fd-8237d6f8a215 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:08.667099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54955774-6d86-409a-9a17-6afc4556ec16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:08.669333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54955774-6d86-409a-9a17-6afc4556ec16 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:08.694590 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 803/1616] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:08.697799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2531f-5a81-4454-a045-e744b799c92c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:08.698093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2531f-5a81-4454-a045-e744b799c92c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:08.699362 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2531f-5a81-4454-a045-e744b799c92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:08.713161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:08.759002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-cca2531f-5a81-4454-a045-e744b799c92c None None] MFA Rules not processed for user `8ccc86d2a198464ea12ab44e2340e2de`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:08.760753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123412f-ae8b-4340-b1fd-8237d6f8a215 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:08.761356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cca2531f-5a81-4454-a045-e744b799c92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:08.763990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123412f-ae8b-4340-b1fd-8237d6f8a215 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:08.787783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 814/1617] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:08.791533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1745c-77cc-4309-aeb8-ec334fb603b2 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:08.792101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1745c-77cc-4309-aeb8-ec334fb603b2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:08.793084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1745c-77cc-4309-aeb8-ec334fb603b2 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:08.803791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 815/1618] 10.222.0.83 () {54 vars in 962 bytes} [Wed Jul 20 22:47:08 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:47:08.806798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1745c-77cc-4309-aeb8-ec334fb603b2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:08.839901 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b1745c-77cc-4309-aeb8-ec334fb603b2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:08.844966 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4255d-814e-403f-93f2-a4e00538d900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:08.845754 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4255d-814e-403f-93f2-a4e00538d900 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:08.846107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4255d-814e-403f-93f2-a4e00538d900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:08.846392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4255d-814e-403f-93f2-a4e00538d900 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:08.847631 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4255d-814e-403f-93f2-a4e00538d900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:08.849464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4255d-814e-403f-93f2-a4e00538d900 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:08.879723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 804/1619] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:08.882230 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cb9d3-3cfe-4784-8309-1e7f38bb4b06 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:08.883106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cb9d3-3cfe-4784-8309-1e7f38bb4b06 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:08.883703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cb9d3-3cfe-4784-8309-1e7f38bb4b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:08.907976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-117cb9d3-3cfe-4784-8309-1e7f38bb4b06 None None] MFA Rules not processed for user `67c92c8d2b9d41e489e4c03ae4e71fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:08.910713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-117cb9d3-3cfe-4784-8309-1e7f38bb4b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:08.960534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 816/1620] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:08 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:08.963034 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14a511-78b6-469d-b489-4f3cba1a0433 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:08.963451 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14a511-78b6-469d-b489-4f3cba1a0433 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:08.963797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d14a511-78b6-469d-b489-4f3cba1a0433 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:08.966443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 817/1621] 10.222.0.83 () {54 vars in 912 bytes} [Wed Jul 20 22:47:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:47:08.967633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14a511-78b6-469d-b489-4f3cba1a0433 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:09.008548 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 805/1622] 10.222.0.83 () {58 vars in 1059 bytes} [Wed Jul 20 22:47:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:09.009506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cb9d3-3cfe-4784-8309-1e7f38bb4b06 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:09.022161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cb9d3-3cfe-4784-8309-1e7f38bb4b06 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:09.027885 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e214e6-ad28-47db-b445-5aa902292d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:09.028590 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e214e6-ad28-47db-b445-5aa902292d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:09.028881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e214e6-ad28-47db-b445-5aa902292d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:09.029159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e214e6-ad28-47db-b445-5aa902292d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:09.029928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e214e6-ad28-47db-b445-5aa902292d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:09.031612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e214e6-ad28-47db-b445-5aa902292d50 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:09.042779 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 806/1623] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:09.043554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d14a511-78b6-469d-b489-4f3cba1a0433 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:09.044146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b6719-021e-4a9c-bd46-384262440110 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:09.044434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b6719-021e-4a9c-bd46-384262440110 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:09.044712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b6719-021e-4a9c-bd46-384262440110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:09.049114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b4f62-88fc-4ee2-8033-f793df156db1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:09.050427 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b4f62-88fc-4ee2-8033-f793df156db1 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:09.050845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b4f62-88fc-4ee2-8033-f793df156db1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:09.051245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b4f62-88fc-4ee2-8033-f793df156db1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:09.063912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b4f62-88fc-4ee2-8033-f793df156db1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:09.064933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-559b6719-021e-4a9c-bd46-384262440110 None None] MFA Rules not processed for user `67c92c8d2b9d41e489e4c03ae4e71fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:09.065127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-559b6719-021e-4a9c-bd46-384262440110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:09.065959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b4f62-88fc-4ee2-8033-f793df156db1 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:09.078086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 818/1624] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:08 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:09.078269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b4f62-88fc-4ee2-8033-f793df156db1 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:09.098936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 807/1625] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:47:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:09.099896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b6719-021e-4a9c-bd46-384262440110 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:09.118278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b4f62-88fc-4ee2-8033-f793df156db1 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:09.123223 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b6719-021e-4a9c-bd46-384262440110 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:09.134930 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af9623-b6d4-4948-993c-a59ca474d7da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:09.135665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af9623-b6d4-4948-993c-a59ca474d7da service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:09.135952 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af9623-b6d4-4948-993c-a59ca474d7da service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:09.136233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27af9623-b6d4-4948-993c-a59ca474d7da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:09.138699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac93ed-0e92-4536-bfd4-caa16b2ee80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:09.139739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac93ed-0e92-4536-bfd4-caa16b2ee80d admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:09.140028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac93ed-0e92-4536-bfd4-caa16b2ee80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:09.140306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac93ed-0e92-4536-bfd4-caa16b2ee80d admin admin] PATH_INFO: `/v3/projects/62537160a80241c0be88abe96f57288c/users/a05c5cd824c042358df4d58142c29d1f/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:09.170715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac93ed-0e92-4536-bfd4-caa16b2ee80d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62537160a80241c0be88abe96f57288c, user_id=a05c5cd824c042358df4d58142c29d1f, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:09.172941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:09.188646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac93ed-0e92-4536-bfd4-caa16b2ee80d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:09.275158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 808/1626] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:09 2022] PUT /identity/v3/projects/62537160a80241c0be88abe96f57288c/users/a05c5cd824c042358df4d58142c29d1f/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:09.276408 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af9623-b6d4-4948-993c-a59ca474d7da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:09.279177 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27af9623-b6d4-4948-993c-a59ca474d7da service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:09.279521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac93ed-0e92-4536-bfd4-caa16b2ee80d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:09.294592 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 819/1627] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:09.310139 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af9623-b6d4-4948-993c-a59ca474d7da service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:09.343013 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27af9623-b6d4-4948-993c-a59ca474d7da service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:09.389713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:09.439769 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac93ed-0e92-4536-bfd4-caa16b2ee80d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:09.450503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc234cb-4b05-4da9-b555-e59736249c9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:09.451259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc234cb-4b05-4da9-b555-e59736249c9c service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:09.451617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc234cb-4b05-4da9-b555-e59736249c9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:09.451994 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc234cb-4b05-4da9-b555-e59736249c9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:09.460804 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263104f1-df14-4e94-9774-c5ac46726e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:09.462875 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263104f1-df14-4e94-9774-c5ac46726e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:09.463425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263104f1-df14-4e94-9774-c5ac46726e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:09.463711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263104f1-df14-4e94-9774-c5ac46726e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:09.464467 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263104f1-df14-4e94-9774-c5ac46726e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:09.471263 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263104f1-df14-4e94-9774-c5ac46726e52 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:09.501665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 820/1628] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:09 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:09.507431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263104f1-df14-4e94-9774-c5ac46726e52 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:09.519638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263104f1-df14-4e94-9774-c5ac46726e52 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:09.529378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f24859-fabd-4a75-af2f-63c0ee22d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:09.536210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f24859-fabd-4a75-af2f-63c0ee22d731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:09.536210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f24859-fabd-4a75-af2f-63c0ee22d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:09.536210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f24859-fabd-4a75-af2f-63c0ee22d731 admin admin] PATH_INFO: `/v3/projects/62537160a80241c0be88abe96f57288c/users/a05c5cd824c042358df4d58142c29d1f/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:09.543723 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f24859-fabd-4a75-af2f-63c0ee22d731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62537160a80241c0be88abe96f57288c, user_id=a05c5cd824c042358df4d58142c29d1f, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:09.549883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f24859-fabd-4a75-af2f-63c0ee22d731 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:09.580253 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 821/1629] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:09 2022] PUT /identity/v3/projects/62537160a80241c0be88abe96f57288c/users/a05c5cd824c042358df4d58142c29d1f/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:09.583356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3fb2-1ccf-4ef1-a8c9-d8cfe22df3b1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:09.583791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3fb2-1ccf-4ef1-a8c9-d8cfe22df3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:09.584160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721e3fb2-1ccf-4ef1-a8c9-d8cfe22df3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:09.647294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc234cb-4b05-4da9-b555-e59736249c9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:09.648800 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc234cb-4b05-4da9-b555-e59736249c9c service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:09.664365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-721e3fb2-1ccf-4ef1-a8c9-d8cfe22df3b1 None None] MFA Rules not processed for user `a05c5cd824c042358df4d58142c29d1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:09.669160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-721e3fb2-1ccf-4ef1-a8c9-d8cfe22df3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:09.682227 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 809/1630] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:09.727937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc234cb-4b05-4da9-b555-e59736249c9c service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:09.745812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc234cb-4b05-4da9-b555-e59736249c9c service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:09.825385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 822/1631] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:09.939054 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bcecb7-9c4e-42c0-84b8-2926cd33cae7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:09.939957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcecb7-9c4e-42c0-84b8-2926cd33cae7 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:09.942187 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcecb7-9c4e-42c0-84b8-2926cd33cae7 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:09.942652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bcecb7-9c4e-42c0-84b8-2926cd33cae7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:10.071731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:10.118252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcecb7-9c4e-42c0-84b8-2926cd33cae7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:10.120582 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bcecb7-9c4e-42c0-84b8-2926cd33cae7 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:10.144188 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 810/1632] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:10.198202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048c8f2-7b8f-4f41-90ed-66d6c9a57de7 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:10.198739 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048c8f2-7b8f-4f41-90ed-66d6c9a57de7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:10.199376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c048c8f2-7b8f-4f41-90ed-66d6c9a57de7 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:10.201364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 823/1633] 10.222.0.83 () {54 vars in 912 bytes} [Wed Jul 20 22:47:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:47:10.211763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e6d9f-15c7-4712-8889-8576d1727395 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:10.212157 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e6d9f-15c7-4712-8889-8576d1727395 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:10.212513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e6d9f-15c7-4712-8889-8576d1727395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:10.240560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-fc2e6d9f-15c7-4712-8889-8576d1727395 None None] MFA Rules not processed for user `67c92c8d2b9d41e489e4c03ae4e71fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:10.244881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fc2e6d9f-15c7-4712-8889-8576d1727395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:10.261436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 811/1634] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:47:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:10.636998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048c8f2-7b8f-4f41-90ed-66d6c9a57de7 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:10.756016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c048c8f2-7b8f-4f41-90ed-66d6c9a57de7 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:10.777928 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904bc63-a603-4cb3-a620-7bef25385707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:10.780559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904bc63-a603-4cb3-a620-7bef25385707 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:10.780853 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904bc63-a603-4cb3-a620-7bef25385707 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:10.781136 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904bc63-a603-4cb3-a620-7bef25385707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:10.803201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904bc63-a603-4cb3-a620-7bef25385707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:10.804752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904bc63-a603-4cb3-a620-7bef25385707 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:10.878160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 824/1635] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:10 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:11.010854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e6d9f-15c7-4712-8889-8576d1727395 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:11.294461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e6d9f-15c7-4712-8889-8576d1727395 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:11.294461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69166366-6ae9-4a11-917a-1aa2cc300c99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:11.294461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166366-6ae9-4a11-917a-1aa2cc300c99 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:11.294461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166366-6ae9-4a11-917a-1aa2cc300c99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:11.303521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69166366-6ae9-4a11-917a-1aa2cc300c99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:11.303521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69166366-6ae9-4a11-917a-1aa2cc300c99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:11.303521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69166366-6ae9-4a11-917a-1aa2cc300c99 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:11.303521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 812/1636] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:11.624846 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904bc63-a603-4cb3-a620-7bef25385707 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:11.639869 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904bc63-a603-4cb3-a620-7bef25385707 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:11.648297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da82057-0444-4c10-a071-5fa58c1a4483 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:11.649068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da82057-0444-4c10-a071-5fa58c1a4483 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:11.656616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da82057-0444-4c10-a071-5fa58c1a4483 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:11.656616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da82057-0444-4c10-a071-5fa58c1a4483 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:11.691047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:11.757616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da82057-0444-4c10-a071-5fa58c1a4483 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:11.759407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da82057-0444-4c10-a071-5fa58c1a4483 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:11.770005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 825/1637] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:12.608513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69166366-6ae9-4a11-917a-1aa2cc300c99 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:12.759985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69166366-6ae9-4a11-917a-1aa2cc300c99 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:12.773028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9f150-19bf-4e3c-80ae-39fcc67b8251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:12.783561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9f150-19bf-4e3c-80ae-39fcc67b8251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:12.783561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9f150-19bf-4e3c-80ae-39fcc67b8251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:12.783561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9f150-19bf-4e3c-80ae-39fcc67b8251 admin admin] PATH_INFO: `/v3/users/df55949e69c24ce798f2e41f71176fc4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:12.783561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9f150-19bf-4e3c-80ae-39fcc67b8251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df55949e69c24ce798f2e41f71176fc4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:12.783561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9f150-19bf-4e3c-80ae-39fcc67b8251 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:13.075460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b2d9f150-19bf-4e3c-80ae-39fcc67b8251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df55949e69c24ce798f2e41f71176fc4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:13.077443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b2d9f150-19bf-4e3c-80ae-39fcc67b8251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df55949e69c24ce798f2e41f71176fc4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:13.078537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b2d9f150-19bf-4e3c-80ae-39fcc67b8251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df55949e69c24ce798f2e41f71176fc4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:13.122755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b2d9f150-19bf-4e3c-80ae-39fcc67b8251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df55949e69c24ce798f2e41f71176fc4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:13.147107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b2d9f150-19bf-4e3c-80ae-39fcc67b8251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df55949e69c24ce798f2e41f71176fc4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:13.246172 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 813/1638] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:12 2022] DELETE /identity/v3/users/df55949e69c24ce798f2e41f71176fc4 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:13.250681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e0db1-9c03-454b-bf43-29d2ca78a483 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:13.251253 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e0db1-9c03-454b-bf43-29d2ca78a483 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:13.251253 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e0db1-9c03-454b-bf43-29d2ca78a483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:13.294974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5e9e0db1-9c03-454b-bf43-29d2ca78a483 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:13.296243 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5e9e0db1-9c03-454b-bf43-29d2ca78a483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:13.386607 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 826/1639] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:13.393154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9f150-19bf-4e3c-80ae-39fcc67b8251 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:13.395025 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b2d9f150-19bf-4e3c-80ae-39fcc67b8251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:13.453525 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:13.533114 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9f150-19bf-4e3c-80ae-39fcc67b8251 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:13.540740 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdaca7-4d26-4df7-9b75-96d2794a7d34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:13.541425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdaca7-4d26-4df7-9b75-96d2794a7d34 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:13.541709 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdaca7-4d26-4df7-9b75-96d2794a7d34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:13.542078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bdaca7-4d26-4df7-9b75-96d2794a7d34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:13.572185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdaca7-4d26-4df7-9b75-96d2794a7d34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:13.573973 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bdaca7-4d26-4df7-9b75-96d2794a7d34 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:13.625348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 814/1640] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:47:15.868584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e0db1-9c03-454b-bf43-29d2ca78a483 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:15.871576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5e9e0db1-9c03-454b-bf43-29d2ca78a483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:15.931494 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e0db1-9c03-454b-bf43-29d2ca78a483 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:15.946620 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a7f827-da2c-46ae-9728-93e3695076c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:15.947486 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7f827-da2c-46ae-9728-93e3695076c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:15.947785 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7f827-da2c-46ae-9728-93e3695076c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:15.948070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a7f827-da2c-46ae-9728-93e3695076c2 admin admin] PATH_INFO: `/v3/projects/043cf5d83ff3474a8e8058b0b7f4e7bc` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:15.954091 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7f827-da2c-46ae-9728-93e3695076c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=043cf5d83ff3474a8e8058b0b7f4e7bc)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:15.955450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a7f827-da2c-46ae-9728-93e3695076c2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:15.966460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdaca7-4d26-4df7-9b75-96d2794a7d34 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:15.972052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-51bdaca7-4d26-4df7-9b75-96d2794a7d34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:15.994884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bdaca7-4d26-4df7-9b75-96d2794a7d34 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:16.013400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca6751-65a3-409f-b59b-d8e86a833930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:16.014415 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6751-65a3-409f-b59b-d8e86a833930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:16.014692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6751-65a3-409f-b59b-d8e86a833930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:16.014968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca6751-65a3-409f-b59b-d8e86a833930 admin admin] PATH_INFO: `/v3/users/f31005489b554f97bc36e3ad928859cd` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:16.021371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca6751-65a3-409f-b59b-d8e86a833930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f31005489b554f97bc36e3ad928859cd)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:16.040437 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca6751-65a3-409f-b59b-d8e86a833930 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:16.267248 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44a7f827-da2c-46ae-9728-93e3695076c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043cf5d83ff3474a8e8058b0b7f4e7bc', 'request_id': 'req-44a7f827-da2c-46ae-9728-93e3695076c2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:16.360275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44a7f827-da2c-46ae-9728-93e3695076c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043cf5d83ff3474a8e8058b0b7f4e7bc', 'request_id': 'req-44a7f827-da2c-46ae-9728-93e3695076c2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:16.370021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44a7f827-da2c-46ae-9728-93e3695076c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043cf5d83ff3474a8e8058b0b7f4e7bc', 'request_id': 'req-44a7f827-da2c-46ae-9728-93e3695076c2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:16.401421 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44a7f827-da2c-46ae-9728-93e3695076c2 admin admin] The token cache is being invalidate because project 043cf5d83ff3474a8e8058b0b7f4e7bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:16.401860 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44a7f827-da2c-46ae-9728-93e3695076c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:16.403547 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-44a7f827-da2c-46ae-9728-93e3695076c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:16.406761 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-69ca6751-65a3-409f-b59b-d8e86a833930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f31005489b554f97bc36e3ad928859cd'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:16.407673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-69ca6751-65a3-409f-b59b-d8e86a833930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f31005489b554f97bc36e3ad928859cd'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:16.408316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-69ca6751-65a3-409f-b59b-d8e86a833930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f31005489b554f97bc36e3ad928859cd'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:16.408446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 827/1641] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:15 2022] DELETE /identity/v3/projects/043cf5d83ff3474a8e8058b0b7f4e7bc => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:16.415351 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1a5a1-c350-4f95-9661-d1eed84eafeb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:16.416707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1a5a1-c350-4f95-9661-d1eed84eafeb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:16.417024 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1a5a1-c350-4f95-9661-d1eed84eafeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:16.434115 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-69ca6751-65a3-409f-b59b-d8e86a833930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f31005489b554f97bc36e3ad928859cd'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:16.463419 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-69ca6751-65a3-409f-b59b-d8e86a833930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f31005489b554f97bc36e3ad928859cd'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:16.509685 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-12d1a5a1-c350-4f95-9661-d1eed84eafeb None None] MFA Rules not processed for user `f6a84e6c6706453cb3973dd89c2ea1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:16.511271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-12d1a5a1-c350-4f95-9661-d1eed84eafeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:16.583879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 815/1642] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:15 2022] DELETE /identity/v3/users/f31005489b554f97bc36e3ad928859cd => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:16.586133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1daa3-db93-4d93-bf9f-b91cabe6742d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:16.586621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1daa3-db93-4d93-bf9f-b91cabe6742d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:16.586936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1daa3-db93-4d93-bf9f-b91cabe6742d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:16.630028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d9e1daa3-db93-4d93-bf9f-b91cabe6742d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:16.630853 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d9e1daa3-db93-4d93-bf9f-b91cabe6742d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:16.647328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:16.711167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 828/1643] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:16.716769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2275d-be86-4b6c-afec-5582d7deb829 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:16.716769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2275d-be86-4b6c-afec-5582d7deb829 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:16.716769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2275d-be86-4b6c-afec-5582d7deb829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:16.778754 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9dd2275d-be86-4b6c-afec-5582d7deb829 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:16.779923 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9dd2275d-be86-4b6c-afec-5582d7deb829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:16.823902 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 816/1644] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:16.825006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1daa3-db93-4d93-bf9f-b91cabe6742d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:16.829410 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d9e1daa3-db93-4d93-bf9f-b91cabe6742d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:16.974783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 829/1645] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:16.976657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0fa3-fe02-490f-8d38-879a7a7e9061 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:16.979220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0fa3-fe02-490f-8d38-879a7a7e9061 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:16.979683 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b0fa3-fe02-490f-8d38-879a7a7e9061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:16.983921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:17.018140 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-fb1b0fa3-fe02-490f-8d38-879a7a7e9061 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:17.019932 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fb1b0fa3-fe02-490f-8d38-879a7a7e9061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:17.030797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 830/1646] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:17.031701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b0fa3-fe02-490f-8d38-879a7a7e9061 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:17.033084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fb1b0fa3-fe02-490f-8d38-879a7a7e9061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:17.048317 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1daa3-db93-4d93-bf9f-b91cabe6742d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:17.076389 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e43d8-05a8-4d67-acb5-d7b2814dbcf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:17.077377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e43d8-05a8-4d67-acb5-d7b2814dbcf8 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:17.077917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e43d8-05a8-4d67-acb5-d7b2814dbcf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:17.078991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e43d8-05a8-4d67-acb5-d7b2814dbcf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:17.180139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e43d8-05a8-4d67-acb5-d7b2814dbcf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:17.182560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e43d8-05a8-4d67-acb5-d7b2814dbcf8 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:17.206761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1b0fa3-fe02-490f-8d38-879a7a7e9061 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:17.208890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 817/1647] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:17.210127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e43d8-05a8-4d67-acb5-d7b2814dbcf8 service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:17.217564 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72e6c3-cc8c-461d-b9ac-3580e1d095b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:17.218520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72e6c3-cc8c-461d-b9ac-3580e1d095b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:17.218962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72e6c3-cc8c-461d-b9ac-3580e1d095b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:17.219387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72e6c3-cc8c-461d-b9ac-3580e1d095b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:17.234212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72e6c3-cc8c-461d-b9ac-3580e1d095b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:17.236155 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72e6c3-cc8c-461d-b9ac-3580e1d095b5 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:17.240114 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e43d8-05a8-4d67-acb5-d7b2814dbcf8 service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:17.248372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 831/1648] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:17.254506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dadb42-2760-46fa-99b6-ef3d8f9a3f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:17.255500 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dadb42-2760-46fa-99b6-ef3d8f9a3f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:17.256283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dadb42-2760-46fa-99b6-ef3d8f9a3f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:17.258092 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dadb42-2760-46fa-99b6-ef3d8f9a3f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:17.259457 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dadb42-2760-46fa-99b6-ef3d8f9a3f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:17.261818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dadb42-2760-46fa-99b6-ef3d8f9a3f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:17.265215 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dadb42-2760-46fa-99b6-ef3d8f9a3f11 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:17.299066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 818/1649] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:17.303154 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72e6c3-cc8c-461d-b9ac-3580e1d095b5 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:17.314223 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72e6c3-cc8c-461d-b9ac-3580e1d095b5 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:17.328945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bb476-f550-4118-aea9-92405805c0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:17.329625 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bb476-f550-4118-aea9-92405805c0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:17.330060 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bb476-f550-4118-aea9-92405805c0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:17.330340 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bb476-f550-4118-aea9-92405805c0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:17.331579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bb476-f550-4118-aea9-92405805c0e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:17.333530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bb476-f550-4118-aea9-92405805c0e0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:17.378915 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dadb42-2760-46fa-99b6-ef3d8f9a3f11 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:17.381512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-14dadb42-2760-46fa-99b6-ef3d8f9a3f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:17.410611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dadb42-2760-46fa-99b6-ef3d8f9a3f11 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:17.417585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de78ae-c332-49f9-8b22-ddd7ec281773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:17.418931 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de78ae-c332-49f9-8b22-ddd7ec281773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:17.419224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de78ae-c332-49f9-8b22-ddd7ec281773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:17.419511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de78ae-c332-49f9-8b22-ddd7ec281773 admin admin] PATH_INFO: `/v3/users/54475a194f664817a9c5fd7fda87c08d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:17.435865 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de78ae-c332-49f9-8b22-ddd7ec281773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54475a194f664817a9c5fd7fda87c08d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:17.441465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de78ae-c332-49f9-8b22-ddd7ec281773 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:17.539764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 832/1650] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:17 2022] POST /identity/v3/projects => generated 365 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:17.544218 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bb476-f550-4118-aea9-92405805c0e0 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:17.697136 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bb476-f550-4118-aea9-92405805c0e0 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:17.701361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810295c-fb4b-45dd-bf09-c583246286ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:17.702242 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810295c-fb4b-45dd-bf09-c583246286ce admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:17.702708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810295c-fb4b-45dd-bf09-c583246286ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:17.706865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810295c-fb4b-45dd-bf09-c583246286ce admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:17.708225 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810295c-fb4b-45dd-bf09-c583246286ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:17.710510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810295c-fb4b-45dd-bf09-c583246286ce admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:17.744490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-51de78ae-c332-49f9-8b22-ddd7ec281773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54475a194f664817a9c5fd7fda87c08d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:17.745268 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-51de78ae-c332-49f9-8b22-ddd7ec281773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54475a194f664817a9c5fd7fda87c08d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:17.762042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-51de78ae-c332-49f9-8b22-ddd7ec281773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54475a194f664817a9c5fd7fda87c08d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:17.791562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-51de78ae-c332-49f9-8b22-ddd7ec281773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54475a194f664817a9c5fd7fda87c08d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:17.800779 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-51de78ae-c332-49f9-8b22-ddd7ec281773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54475a194f664817a9c5fd7fda87c08d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:17.836805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 833/1651] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:17 2022] POST /identity/v3/users => generated 283 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:17.841815 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810295c-fb4b-45dd-bf09-c583246286ce admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:17.846221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0810295c-fb4b-45dd-bf09-c583246286ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:17.881874 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 819/1652] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:17 2022] DELETE /identity/v3/users/54475a194f664817a9c5fd7fda87c08d => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:17.890175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bf491-2035-4414-af92-c59d80502c69 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:17.891197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bf491-2035-4414-af92-c59d80502c69 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:17.892187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810295c-fb4b-45dd-bf09-c583246286ce admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:17.892639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bf491-2035-4414-af92-c59d80502c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:17.977154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a92bf491-2035-4414-af92-c59d80502c69 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:17.978432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a92bf491-2035-4414-af92-c59d80502c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:18.095960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 820/1653] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:18.111611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2aff4c-8e12-44b6-b3e6-d078be1e284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:18.113270 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aff4c-8e12-44b6-b3e6-d078be1e284d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:18.113899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aff4c-8e12-44b6-b3e6-d078be1e284d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:18.114535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2aff4c-8e12-44b6-b3e6-d078be1e284d admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:18.115468 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2aff4c-8e12-44b6-b3e6-d078be1e284d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:18.117318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2aff4c-8e12-44b6-b3e6-d078be1e284d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:18.135242 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 834/1654] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:17 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:18.139166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bf491-2035-4414-af92-c59d80502c69 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:18.151844 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2aff4c-8e12-44b6-b3e6-d078be1e284d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:18.156922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bf491-2035-4414-af92-c59d80502c69 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:18.158881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ab2aff4c-8e12-44b6-b3e6-d078be1e284d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:18.171583 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c94d7-afac-473d-bade-55daa7b229dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:18.172290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c94d7-afac-473d-bade-55daa7b229dc admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:18.172574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c94d7-afac-473d-bade-55daa7b229dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:18.172859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c94d7-afac-473d-bade-55daa7b229dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:18.176889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c94d7-afac-473d-bade-55daa7b229dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:18.181134 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c94d7-afac-473d-bade-55daa7b229dc admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:18.208907 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 821/1655] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:18.213998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c94d7-afac-473d-bade-55daa7b229dc admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:18.237848 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c94d7-afac-473d-bade-55daa7b229dc admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:18.253072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc2760-cfae-40e8-a395-943a0ab2b66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:18.256313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc2760-cfae-40e8-a395-943a0ab2b66d admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:18.256313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc2760-cfae-40e8-a395-943a0ab2b66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:18.256313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc2760-cfae-40e8-a395-943a0ab2b66d admin admin] PATH_INFO: `/v3/projects/f2ff91457b4d4c72b1543f67c0af578a/users/74f5d9e4fe6943aca33aeea22bad6849/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:18.295953 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc2760-cfae-40e8-a395-943a0ab2b66d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ff91457b4d4c72b1543f67c0af578a, user_id=74f5d9e4fe6943aca33aeea22bad6849, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:18.302861 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc2760-cfae-40e8-a395-943a0ab2b66d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:18.308538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2aff4c-8e12-44b6-b3e6-d078be1e284d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:18.315009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090f716-b901-4c52-a9e1-88d4da9e3b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:18.316444 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090f716-b901-4c52-a9e1-88d4da9e3b10 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:18.316887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090f716-b901-4c52-a9e1-88d4da9e3b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:18.317318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090f716-b901-4c52-a9e1-88d4da9e3b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:18.334327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090f716-b901-4c52-a9e1-88d4da9e3b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:18.336671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090f716-b901-4c52-a9e1-88d4da9e3b10 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:18.350803 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 835/1656] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:18.444412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 822/1657] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:18 2022] PUT /identity/v3/projects/f2ff91457b4d4c72b1543f67c0af578a/users/74f5d9e4fe6943aca33aeea22bad6849/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:18.451517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2033-ca21-4ce3-8d51-451e83a1a285 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:18.451809 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2033-ca21-4ce3-8d51-451e83a1a285 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:18.452093 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2033-ca21-4ce3-8d51-451e83a1a285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:18.511320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b05b2033-ca21-4ce3-8d51-451e83a1a285 None None] MFA Rules not processed for user `74f5d9e4fe6943aca33aeea22bad6849`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:18.512539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b05b2033-ca21-4ce3-8d51-451e83a1a285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:18.683238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 836/1658] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:18.687905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc2760-cfae-40e8-a395-943a0ab2b66d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:18.822471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc2760-cfae-40e8-a395-943a0ab2b66d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:18.831541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f2008-9ea3-4563-8838-2822ccbd3948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:18.834013 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f2008-9ea3-4563-8838-2822ccbd3948 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:18.834224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f2008-9ea3-4563-8838-2822ccbd3948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:18.834482 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f2008-9ea3-4563-8838-2822ccbd3948 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:18.837998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f2008-9ea3-4563-8838-2822ccbd3948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:18.848118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9f2008-9ea3-4563-8838-2822ccbd3948 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:18.952047 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 823/1659] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:18 2022] POST /identity/v3/projects => generated 363 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:18.956500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2033-ca21-4ce3-8d51-451e83a1a285 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:18.978683 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2033-ca21-4ce3-8d51-451e83a1a285 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:19.088198 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732175b-3636-48b5-8fd3-4aef0a23a2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:19.088909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732175b-3636-48b5-8fd3-4aef0a23a2fc admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:19.090014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732175b-3636-48b5-8fd3-4aef0a23a2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:19.090606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732175b-3636-48b5-8fd3-4aef0a23a2fc admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:19.095550 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732175b-3636-48b5-8fd3-4aef0a23a2fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:19.103112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732175b-3636-48b5-8fd3-4aef0a23a2fc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:19.268054 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f2008-9ea3-4563-8838-2822ccbd3948 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:19.276604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ec9f2008-9ea3-4563-8838-2822ccbd3948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:19.290509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 837/1660] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:18 2022] POST /identity/v3/users => generated 288 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:19.294444 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732175b-3636-48b5-8fd3-4aef0a23a2fc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:19.311480 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732175b-3636-48b5-8fd3-4aef0a23a2fc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:19.329230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f097860-b2e7-496d-ae8d-83ddddcadb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:19.330917 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f097860-b2e7-496d-ae8d-83ddddcadb36 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:19.331356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f097860-b2e7-496d-ae8d-83ddddcadb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:19.331960 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f097860-b2e7-496d-ae8d-83ddddcadb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:19.332870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f097860-b2e7-496d-ae8d-83ddddcadb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:19.334741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f097860-b2e7-496d-ae8d-83ddddcadb36 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:19.337767 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f2008-9ea3-4563-8838-2822ccbd3948 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:19.351971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 838/1661] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:47:19.353196 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f097860-b2e7-496d-ae8d-83ddddcadb36 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:19.366835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3513d-c025-4fa9-a51f-edf3da852902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:19.368892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3513d-c025-4fa9-a51f-edf3da852902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:19.369254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3513d-c025-4fa9-a51f-edf3da852902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:19.369602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3513d-c025-4fa9-a51f-edf3da852902 admin admin] PATH_INFO: `/v3/users/1d15df7f6b0d45c2acb1935945b164ae` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:19.371487 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3513d-c025-4fa9-a51f-edf3da852902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d15df7f6b0d45c2acb1935945b164ae)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:19.373851 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f097860-b2e7-496d-ae8d-83ddddcadb36 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:19.375114 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c3513d-c025-4fa9-a51f-edf3da852902 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:19.383694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08144cd-8d40-4342-a3a7-43ce22db125f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:19.384945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08144cd-8d40-4342-a3a7-43ce22db125f admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:19.388012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08144cd-8d40-4342-a3a7-43ce22db125f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:19.388525 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08144cd-8d40-4342-a3a7-43ce22db125f admin admin] PATH_INFO: `/v3/projects/b55530205c954f49b76397230c5303be/users/f6244e2ccdf84a08afb353d616c09382/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:19.413768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08144cd-8d40-4342-a3a7-43ce22db125f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55530205c954f49b76397230c5303be, user_id=f6244e2ccdf84a08afb353d616c09382, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:19.418362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08144cd-8d40-4342-a3a7-43ce22db125f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:19.543624 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:19.553117 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 839/1662] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:19 2022] PUT /identity/v3/projects/b55530205c954f49b76397230c5303be/users/f6244e2ccdf84a08afb353d616c09382/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:19.553417 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08144cd-8d40-4342-a3a7-43ce22db125f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:19.555121 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b08144cd-8d40-4342-a3a7-43ce22db125f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:19.732125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-22c3513d-c025-4fa9-a51f-edf3da852902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d15df7f6b0d45c2acb1935945b164ae'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:19.733022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-22c3513d-c025-4fa9-a51f-edf3da852902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d15df7f6b0d45c2acb1935945b164ae'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:19.733848 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-22c3513d-c025-4fa9-a51f-edf3da852902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d15df7f6b0d45c2acb1935945b164ae'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:19.746649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08144cd-8d40-4342-a3a7-43ce22db125f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:19.760771 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-22c3513d-c025-4fa9-a51f-edf3da852902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d15df7f6b0d45c2acb1935945b164ae'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:19.764104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:19.764998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:19.765277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:19.765548 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0 admin admin] PATH_INFO: `/v3/projects/0973ceb5be53433ea23ee59a5db985e5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:19.772339 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0973ceb5be53433ea23ee59a5db985e5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:19.777918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-22c3513d-c025-4fa9-a51f-edf3da852902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d15df7f6b0d45c2acb1935945b164ae'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:19.778683 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:19.867265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:19.873501 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 824/1663] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:19 2022] DELETE /identity/v3/users/1d15df7f6b0d45c2acb1935945b164ae => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:47:19.875283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3513d-c025-4fa9-a51f-edf3da852902 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:19.876857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-22c3513d-c025-4fa9-a51f-edf3da852902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:20.008471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3513d-c025-4fa9-a51f-edf3da852902 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:20.024194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0973ceb5be53433ea23ee59a5db985e5', 'request_id': 'req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:20.091037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0973ceb5be53433ea23ee59a5db985e5', 'request_id': 'req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:20.098553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0973ceb5be53433ea23ee59a5db985e5', 'request_id': 'req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:20.121253 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0 admin admin] The token cache is being invalidate because project 0973ceb5be53433ea23ee59a5db985e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:20.121554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:20.123238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bdc78e0a-f88d-4b46-9ded-29cad7a684d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:20.129496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 840/1664] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:19 2022] DELETE /identity/v3/projects/0973ceb5be53433ea23ee59a5db985e5 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:20.130913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c07df-bb2d-41ae-8b7c-6a4c89b81fd1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:20.131543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c07df-bb2d-41ae-8b7c-6a4c89b81fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:20.131722 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c07df-bb2d-41ae-8b7c-6a4c89b81fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:20.138615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd87d9-e597-497e-9d8d-a3ff66140d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:20.141258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd87d9-e597-497e-9d8d-a3ff66140d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:20.141258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd87d9-e597-497e-9d8d-a3ff66140d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:20.141258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd87d9-e597-497e-9d8d-a3ff66140d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:20.141258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd87d9-e597-497e-9d8d-a3ff66140d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:20.142297 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd87d9-e597-497e-9d8d-a3ff66140d0d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:20.193461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 825/1665] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:20.196099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b48c07df-bb2d-41ae-8b7c-6a4c89b81fd1 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:20.197257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd87d9-e597-497e-9d8d-a3ff66140d0d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:20.199090 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b48c07df-bb2d-41ae-8b7c-6a4c89b81fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:20.202689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-11fd87d9-e597-497e-9d8d-a3ff66140d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:20.220193 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 841/1666] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:20.221782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d052de-854d-4c32-b525-97b4af67a68f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:20.222238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d052de-854d-4c32-b525-97b4af67a68f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:20.222901 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d052de-854d-4c32-b525-97b4af67a68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:20.234945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd87d9-e597-497e-9d8d-a3ff66140d0d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:20.261390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591a460-395b-41d8-ae86-bf4b94a70487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:20.262326 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a460-395b-41d8-ae86-bf4b94a70487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:20.262626 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a460-395b-41d8-ae86-bf4b94a70487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:20.262903 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591a460-395b-41d8-ae86-bf4b94a70487 admin admin] PATH_INFO: `/v3/projects/9afa05a1f4d24996a1ce92e2be836df0` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:20.264696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591a460-395b-41d8-ae86-bf4b94a70487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9afa05a1f4d24996a1ce92e2be836df0)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:20.265787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: WARNING py.warnings [None req-e591a460-395b-41d8-ae86-bf4b94a70487 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:47:20.265787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: warnings.warn(msg) Jul 20 22:47:20.265787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: Jul 20 22:47:20.266670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-03d052de-854d-4c32-b525-97b4af67a68f None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:20.267011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591a460-395b-41d8-ae86-bf4b94a70487 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:20.267915 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-03d052de-854d-4c32-b525-97b4af67a68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:20.281314 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 842/1667] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:20.283160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d052de-854d-4c32-b525-97b4af67a68f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:20.285127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-03d052de-854d-4c32-b525-97b4af67a68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:20.304732 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d052de-854d-4c32-b525-97b4af67a68f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:20.312136 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef35d63-c8f1-47f2-8176-5a1d0e64fce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:20.313277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef35d63-c8f1-47f2-8176-5a1d0e64fce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:20.313761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef35d63-c8f1-47f2-8176-5a1d0e64fce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:20.314185 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef35d63-c8f1-47f2-8176-5a1d0e64fce5 admin admin] PATH_INFO: `/v3/projects/b55530205c954f49b76397230c5303be/users/f6244e2ccdf84a08afb353d616c09382/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:20.317189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef35d63-c8f1-47f2-8176-5a1d0e64fce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b55530205c954f49b76397230c5303be, user_id=f6244e2ccdf84a08afb353d616c09382, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:20.320294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef35d63-c8f1-47f2-8176-5a1d0e64fce5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:20.334926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 843/1668] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:20 2022] PUT /identity/v3/projects/b55530205c954f49b76397230c5303be/users/f6244e2ccdf84a08afb353d616c09382/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:20.335866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef35d63-c8f1-47f2-8176-5a1d0e64fce5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:20.347059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0ef35d63-c8f1-47f2-8176-5a1d0e64fce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:20.429557 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e591a460-395b-41d8-ae86-bf4b94a70487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9afa05a1f4d24996a1ce92e2be836df0', 'request_id': 'req-e591a460-395b-41d8-ae86-bf4b94a70487'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:20.455109 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef35d63-c8f1-47f2-8176-5a1d0e64fce5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:20.522024 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f000c90-0402-4986-9a7f-7d393eeb67ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:20.522958 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000c90-0402-4986-9a7f-7d393eeb67ea service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:20.523519 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000c90-0402-4986-9a7f-7d393eeb67ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:20.523941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000c90-0402-4986-9a7f-7d393eeb67ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:20.546716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e591a460-395b-41d8-ae86-bf4b94a70487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9afa05a1f4d24996a1ce92e2be836df0', 'request_id': 'req-e591a460-395b-41d8-ae86-bf4b94a70487'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:20.557262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e591a460-395b-41d8-ae86-bf4b94a70487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9afa05a1f4d24996a1ce92e2be836df0', 'request_id': 'req-e591a460-395b-41d8-ae86-bf4b94a70487'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:20.605708 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e591a460-395b-41d8-ae86-bf4b94a70487 admin admin] The token cache is being invalidate because project 9afa05a1f4d24996a1ce92e2be836df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:20.605708 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e591a460-395b-41d8-ae86-bf4b94a70487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:20.605708 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e591a460-395b-41d8-ae86-bf4b94a70487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:20.610810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 826/1669] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:20 2022] DELETE /identity/v3/projects/9afa05a1f4d24996a1ce92e2be836df0 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:20.623040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a3a8d-0c80-46bb-9537-804f122b59b0 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:20.623488 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a3a8d-0c80-46bb-9537-804f122b59b0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:20.623995 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a3a8d-0c80-46bb-9537-804f122b59b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:20.635726 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f000c90-0402-4986-9a7f-7d393eeb67ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:20.637381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f000c90-0402-4986-9a7f-7d393eeb67ea service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:20.654494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1c2a3a8d-0c80-46bb-9537-804f122b59b0 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:20.660149 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1c2a3a8d-0c80-46bb-9537-804f122b59b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:20.663057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 844/1670] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:20.665775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8a153-98fb-4352-b088-9fce5f62f5c6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:20.670407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8a153-98fb-4352-b088-9fce5f62f5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:20.671180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8a153-98fb-4352-b088-9fce5f62f5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:20.673827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 827/1671] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:20.675567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a3a8d-0c80-46bb-9537-804f122b59b0 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:20.679002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1c2a3a8d-0c80-46bb-9537-804f122b59b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:20.697249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a3a8d-0c80-46bb-9537-804f122b59b0 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:20.705398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96d1b8-c359-4708-869d-450cbeaff2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:20.709120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d1b8-c359-4708-869d-450cbeaff2cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:20.709120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d1b8-c359-4708-869d-450cbeaff2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:20.709120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96d1b8-c359-4708-869d-450cbeaff2cd admin admin] PATH_INFO: `/v3/users/a05c5cd824c042358df4d58142c29d1f` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:20.710405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96d1b8-c359-4708-869d-450cbeaff2cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05c5cd824c042358df4d58142c29d1f)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:20.712839 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96d1b8-c359-4708-869d-450cbeaff2cd admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:20.739046 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e6c8a153-98fb-4352-b088-9fce5f62f5c6 None None] MFA Rules not processed for user `f6244e2ccdf84a08afb353d616c09382`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:20.741350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e6c8a153-98fb-4352-b088-9fce5f62f5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:20.876588 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 845/1672] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:20 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:20.877048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8a153-98fb-4352-b088-9fce5f62f5c6 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:20.889274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8a153-98fb-4352-b088-9fce5f62f5c6 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:20.899216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121c2d7-4aa3-4451-ac8b-16d8501c495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:20.900021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c2d7-4aa3-4451-ac8b-16d8501c495b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:20.909707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c2d7-4aa3-4451-ac8b-16d8501c495b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:20.909707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c2d7-4aa3-4451-ac8b-16d8501c495b admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:20.909707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121c2d7-4aa3-4451-ac8b-16d8501c495b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:20.909707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121c2d7-4aa3-4451-ac8b-16d8501c495b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:20.909707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121c2d7-4aa3-4451-ac8b-16d8501c495b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:20.930437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 846/1673] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:20.931523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121c2d7-4aa3-4451-ac8b-16d8501c495b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:20.934422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1121c2d7-4aa3-4451-ac8b-16d8501c495b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:20.960385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3f96d1b8-c359-4708-869d-450cbeaff2cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05c5cd824c042358df4d58142c29d1f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:20.961540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3f96d1b8-c359-4708-869d-450cbeaff2cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05c5cd824c042358df4d58142c29d1f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:20.962993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3f96d1b8-c359-4708-869d-450cbeaff2cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05c5cd824c042358df4d58142c29d1f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:20.983677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3f96d1b8-c359-4708-869d-450cbeaff2cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05c5cd824c042358df4d58142c29d1f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:21.015259 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121c2d7-4aa3-4451-ac8b-16d8501c495b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:21.020396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54a809-7c01-490d-96c0-5db947198a7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:21.021769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54a809-7c01-490d-96c0-5db947198a7f service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:21.022420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54a809-7c01-490d-96c0-5db947198a7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:21.025003 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54a809-7c01-490d-96c0-5db947198a7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:21.033510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-be54a809-7c01-490d-96c0-5db947198a7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:21.040738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3f96d1b8-c359-4708-869d-450cbeaff2cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05c5cd824c042358df4d58142c29d1f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:21.054793 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54a809-7c01-490d-96c0-5db947198a7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:21.057429 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54a809-7c01-490d-96c0-5db947198a7f service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:21.081348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 847/1674] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:20 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:21.086005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54a809-7c01-490d-96c0-5db947198a7f service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:21.088004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-be54a809-7c01-490d-96c0-5db947198a7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:21.104403 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54a809-7c01-490d-96c0-5db947198a7f service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:21.110038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29d912-fea4-48cc-bdc1-3a5d4f99eef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:21.110994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29d912-fea4-48cc-bdc1-3a5d4f99eef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:21.111619 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29d912-fea4-48cc-bdc1-3a5d4f99eef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:21.112135 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c29d912-fea4-48cc-bdc1-3a5d4f99eef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:21.113053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29d912-fea4-48cc-bdc1-3a5d4f99eef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:21.116364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c29d912-fea4-48cc-bdc1-3a5d4f99eef5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:21.140923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 828/1675] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:20 2022] DELETE /identity/v3/users/a05c5cd824c042358df4d58142c29d1f => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:21.264073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 848/1676] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:21 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:21.264951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96d1b8-c359-4708-869d-450cbeaff2cd admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:21.368491 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29d912-fea4-48cc-bdc1-3a5d4f99eef5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:21.371371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2c29d912-fea4-48cc-bdc1-3a5d4f99eef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:21.408155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96d1b8-c359-4708-869d-450cbeaff2cd admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:21.532014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c29d912-fea4-48cc-bdc1-3a5d4f99eef5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:21.537142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d1e00-f80b-4af4-a643-d5d9db265597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:21.537511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d1e00-f80b-4af4-a643-d5d9db265597 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:21.537883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d1e00-f80b-4af4-a643-d5d9db265597 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:21.538178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d1e00-f80b-4af4-a643-d5d9db265597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:21.544555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bb7d1e00-f80b-4af4-a643-d5d9db265597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:21.549976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58364f43-63e5-4773-83ae-7c0c71aef294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:21.554619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364f43-63e5-4773-83ae-7c0c71aef294 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:21.554619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364f43-63e5-4773-83ae-7c0c71aef294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:21.554619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58364f43-63e5-4773-83ae-7c0c71aef294 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:21.555646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58364f43-63e5-4773-83ae-7c0c71aef294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:21.561127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58364f43-63e5-4773-83ae-7c0c71aef294 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:21.659346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 829/1677] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:21 2022] POST /identity/v3/users => generated 291 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:21.664575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58364f43-63e5-4773-83ae-7c0c71aef294 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:21.672110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:21.684344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d1e00-f80b-4af4-a643-d5d9db265597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:21.685974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7d1e00-f80b-4af4-a643-d5d9db265597 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:21.703119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58364f43-63e5-4773-83ae-7c0c71aef294 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:21.728081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be83c33-2380-49d7-a4f0-1c31bbf51441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:21.728081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be83c33-2380-49d7-a4f0-1c31bbf51441 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:21.728081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be83c33-2380-49d7-a4f0-1c31bbf51441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:21.728817 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be83c33-2380-49d7-a4f0-1c31bbf51441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:21.729641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be83c33-2380-49d7-a4f0-1c31bbf51441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:21.734019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be83c33-2380-49d7-a4f0-1c31bbf51441 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:21.737499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 849/1678] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:21.740298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d1e00-f80b-4af4-a643-d5d9db265597 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:21.742100 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bb7d1e00-f80b-4af4-a643-d5d9db265597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:21.762457 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7d1e00-f80b-4af4-a643-d5d9db265597 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:21.767749 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e3b1c-bfbe-44d9-b083-b0436a300590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:21.768672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e3b1c-bfbe-44d9-b083-b0436a300590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:21.768958 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e3b1c-bfbe-44d9-b083-b0436a300590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:21.769486 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e3b1c-bfbe-44d9-b083-b0436a300590 admin admin] PATH_INFO: `/v3/projects/9ad5b761a3584a2cb6cfbec8ac0fb697` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:21.770474 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 830/1679] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:21.771380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e3b1c-bfbe-44d9-b083-b0436a300590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad5b761a3584a2cb6cfbec8ac0fb697)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:21.774001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e3b1c-bfbe-44d9-b083-b0436a300590 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:21.777384 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be83c33-2380-49d7-a4f0-1c31bbf51441 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:21.800568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be83c33-2380-49d7-a4f0-1c31bbf51441 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:21.812666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea62034-1e02-41a2-9d5b-6e08abc68020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:21.813949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea62034-1e02-41a2-9d5b-6e08abc68020 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:21.814493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea62034-1e02-41a2-9d5b-6e08abc68020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:21.815574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea62034-1e02-41a2-9d5b-6e08abc68020 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:21.816570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea62034-1e02-41a2-9d5b-6e08abc68020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:21.818481 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea62034-1e02-41a2-9d5b-6e08abc68020 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:21.836089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 831/1680] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:21.840123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea62034-1e02-41a2-9d5b-6e08abc68020 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:21.852724 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea62034-1e02-41a2-9d5b-6e08abc68020 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:21.859598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd473b-5916-40e2-829c-1e460fe3bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:21.861173 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd473b-5916-40e2-829c-1e460fe3bc0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:21.861173 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd473b-5916-40e2-829c-1e460fe3bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:21.861513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd473b-5916-40e2-829c-1e460fe3bc0d admin admin] PATH_INFO: `/v3/projects/90d17b2bd16e41569ed117e905f7e90d/users/c5787a51849e4890b33cc8bd11aca203/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:21.892614 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd473b-5916-40e2-829c-1e460fe3bc0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=90d17b2bd16e41569ed117e905f7e90d, user_id=c5787a51849e4890b33cc8bd11aca203, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:21.895933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd473b-5916-40e2-829c-1e460fe3bc0d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:22.050821 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 832/1681] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:21 2022] PUT /identity/v3/projects/90d17b2bd16e41569ed117e905f7e90d/users/c5787a51849e4890b33cc8bd11aca203/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:47:22.056988 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-550e3b1c-bfbe-44d9-b083-b0436a300590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad5b761a3584a2cb6cfbec8ac0fb697', 'request_id': 'req-550e3b1c-bfbe-44d9-b083-b0436a300590'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:22.060977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5ea8-341e-46b8-906d-cf2c0bddffc3 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:22.061399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5ea8-341e-46b8-906d-cf2c0bddffc3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:22.061833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd5ea8-341e-46b8-906d-cf2c0bddffc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:22.132686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6edd5ea8-341e-46b8-906d-cf2c0bddffc3 None None] MFA Rules not processed for user `c5787a51849e4890b33cc8bd11aca203`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:22.134678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6edd5ea8-341e-46b8-906d-cf2c0bddffc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:22.177073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-550e3b1c-bfbe-44d9-b083-b0436a300590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad5b761a3584a2cb6cfbec8ac0fb697', 'request_id': 'req-550e3b1c-bfbe-44d9-b083-b0436a300590'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:22.184262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-550e3b1c-bfbe-44d9-b083-b0436a300590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad5b761a3584a2cb6cfbec8ac0fb697', 'request_id': 'req-550e3b1c-bfbe-44d9-b083-b0436a300590'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:22.226496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-550e3b1c-bfbe-44d9-b083-b0436a300590 admin admin] The token cache is being invalidate because project 9ad5b761a3584a2cb6cfbec8ac0fb697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:22.230388 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-550e3b1c-bfbe-44d9-b083-b0436a300590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:22.233228 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-550e3b1c-bfbe-44d9-b083-b0436a300590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:22.239674 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 850/1682] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:21 2022] DELETE /identity/v3/projects/9ad5b761a3584a2cb6cfbec8ac0fb697 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:22.245283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b0b6b-a444-4787-8091-6bf49cae0801 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:22.245818 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b0b6b-a444-4787-8091-6bf49cae0801 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:22.246236 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b0b6b-a444-4787-8091-6bf49cae0801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:22.276894 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 833/1683] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:22.277965 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd5ea8-341e-46b8-906d-cf2c0bddffc3 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:22.280163 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6edd5ea8-341e-46b8-906d-cf2c0bddffc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:22.310750 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-508b0b6b-a444-4787-8091-6bf49cae0801 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:22.314682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-508b0b6b-a444-4787-8091-6bf49cae0801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:22.402743 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd5ea8-341e-46b8-906d-cf2c0bddffc3 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:22.411184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30643b0e-68bc-4105-a491-354d7b9c03ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:22.413011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30643b0e-68bc-4105-a491-354d7b9c03ad admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:22.413618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30643b0e-68bc-4105-a491-354d7b9c03ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:22.414125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30643b0e-68bc-4105-a491-354d7b9c03ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:22.415399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30643b0e-68bc-4105-a491-354d7b9c03ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:22.419151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30643b0e-68bc-4105-a491-354d7b9c03ad admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:22.442344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 851/1684] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:22.446350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce729045-5786-4a05-90ff-c82977e93019 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:22.446640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce729045-5786-4a05-90ff-c82977e93019 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:22.446921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce729045-5786-4a05-90ff-c82977e93019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:22.473056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ce729045-5786-4a05-90ff-c82977e93019 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:22.474452 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ce729045-5786-4a05-90ff-c82977e93019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:22.486324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 852/1685] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:22.490503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce729045-5786-4a05-90ff-c82977e93019 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:22.512381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce729045-5786-4a05-90ff-c82977e93019 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:22.519447 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d333647-3a0f-45f4-994a-a983c97a244b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:22.520389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d333647-3a0f-45f4-994a-a983c97a244b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:22.521135 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d333647-3a0f-45f4-994a-a983c97a244b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:22.521135 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d333647-3a0f-45f4-994a-a983c97a244b admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:22.522516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d333647-3a0f-45f4-994a-a983c97a244b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:22.522836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d333647-3a0f-45f4-994a-a983c97a244b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:22.525696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d333647-3a0f-45f4-994a-a983c97a244b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:22.531383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:22.575942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 834/1686] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:22 2022] POST /identity/v3/projects => generated 381 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:22.576570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 853/1687] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:22.576570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d333647-3a0f-45f4-994a-a983c97a244b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:22.582203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30643b0e-68bc-4105-a491-354d7b9c03ad admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:22.591251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d333647-3a0f-45f4-994a-a983c97a244b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:22.702384 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe1916-e23a-455e-b2ab-f8730240e268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:22.702634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30643b0e-68bc-4105-a491-354d7b9c03ad admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:22.703696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe1916-e23a-455e-b2ab-f8730240e268 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:22.704201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe1916-e23a-455e-b2ab-f8730240e268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:22.704645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe1916-e23a-455e-b2ab-f8730240e268 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:22.706546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe1916-e23a-455e-b2ab-f8730240e268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:22.712496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe1916-e23a-455e-b2ab-f8730240e268 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:22.719719 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06819c59-1749-4a07-aa4e-7ae52f2b901e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:22.721012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06819c59-1749-4a07-aa4e-7ae52f2b901e admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:22.721790 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06819c59-1749-4a07-aa4e-7ae52f2b901e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:22.722233 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06819c59-1749-4a07-aa4e-7ae52f2b901e admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:22.732357 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06819c59-1749-4a07-aa4e-7ae52f2b901e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:22.732713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06819c59-1749-4a07-aa4e-7ae52f2b901e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:22.831591 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 854/1688] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:22 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:22.837618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe1916-e23a-455e-b2ab-f8730240e268 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:22.844828 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-23fe1916-e23a-455e-b2ab-f8730240e268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:22.849273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 835/1689] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:22 2022] POST /identity/v3/projects => generated 373 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:22.851043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06819c59-1749-4a07-aa4e-7ae52f2b901e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:22.883615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe1916-e23a-455e-b2ab-f8730240e268 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:22.972943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06819c59-1749-4a07-aa4e-7ae52f2b901e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:22.986328 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edf871-1e0a-4556-893f-9b3b209b2765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:22.987658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edf871-1e0a-4556-893f-9b3b209b2765 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:22.989869 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edf871-1e0a-4556-893f-9b3b209b2765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:22.990167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edf871-1e0a-4556-893f-9b3b209b2765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:22.990951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edf871-1e0a-4556-893f-9b3b209b2765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:22.996663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edf871-1e0a-4556-893f-9b3b209b2765 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:22.999406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:23.000223 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:23.000513 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:23.000852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] PATH_INFO: `/v3/projects/62537160a80241c0be88abe96f57288c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:23.003535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] RBAC: Authorizing `identity:delete_project(project_id=62537160a80241c0be88abe96f57288c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:23.006944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:23.024496 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 836/1690] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:23.031144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edf871-1e0a-4556-893f-9b3b209b2765 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:23.059566 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edf871-1e0a-4556-893f-9b3b209b2765 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:23.091902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:23.092098 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef18136-d467-45f7-8ea5-2e7a40a81fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:23.092960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18136-d467-45f7-8ea5-2e7a40a81fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:23.093339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18136-d467-45f7-8ea5-2e7a40a81fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:23.093737 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef18136-d467-45f7-8ea5-2e7a40a81fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:23.094550 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef18136-d467-45f7-8ea5-2e7a40a81fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:23.097440 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef18136-d467-45f7-8ea5-2e7a40a81fc8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:23.189545 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62537160a80241c0be88abe96f57288c', 'request_id': 'req-436831eb-033f-453b-9f5e-6c3bafa63cac'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:23.253648 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 837/1691] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:23 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:23.255087 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef18136-d467-45f7-8ea5-2e7a40a81fc8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:23.279548 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef18136-d467-45f7-8ea5-2e7a40a81fc8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:23.297576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62537160a80241c0be88abe96f57288c', 'request_id': 'req-436831eb-033f-453b-9f5e-6c3bafa63cac'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:23.308963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62537160a80241c0be88abe96f57288c', 'request_id': 'req-436831eb-033f-453b-9f5e-6c3bafa63cac'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:23.361356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] The token cache is being invalidate because project 62537160a80241c0be88abe96f57288c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:23.362700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:23.366098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:23.368429 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 855/1692] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:22 2022] DELETE /identity/v3/projects/62537160a80241c0be88abe96f57288c => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:23.376803 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:23.381686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:23.408141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfa1b48-333a-4c8c-b2d6-86e525064631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:23.412654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa1b48-333a-4c8c-b2d6-86e525064631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:23.412952 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa1b48-333a-4c8c-b2d6-86e525064631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:23.413238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfa1b48-333a-4c8c-b2d6-86e525064631 admin admin] PATH_INFO: `/v3/projects/7433253cf90e4a33aa955d036254a526/users/7a172ab350d64598ad31dcd25d9db9ec/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:23.441638 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa1b48-333a-4c8c-b2d6-86e525064631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7433253cf90e4a33aa955d036254a526, user_id=7a172ab350d64598ad31dcd25d9db9ec, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:23.445951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfa1b48-333a-4c8c-b2d6-86e525064631 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:23.535096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 838/1693] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:23 2022] PUT /identity/v3/projects/7433253cf90e4a33aa955d036254a526/users/7a172ab350d64598ad31dcd25d9db9ec/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:23.540621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f3bdd-4d98-4c7d-885c-57afb169086e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:23.549279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f3bdd-4d98-4c7d-885c-57afb169086e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:23.550577 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f3bdd-4d98-4c7d-885c-57afb169086e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:23.595498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b41f3bdd-4d98-4c7d-885c-57afb169086e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:23.598054 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b41f3bdd-4d98-4c7d-885c-57afb169086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:23.603250 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436831eb-033f-453b-9f5e-6c3bafa63cac admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:23.732080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1560ce2-ccdd-4d86-959b-796e88e1c0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:23.733753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1560ce2-ccdd-4d86-959b-796e88e1c0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:23.734099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1560ce2-ccdd-4d86-959b-796e88e1c0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:23.734309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1560ce2-ccdd-4d86-959b-796e88e1c0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:23.735216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1560ce2-ccdd-4d86-959b-796e88e1c0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:23.738336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1560ce2-ccdd-4d86-959b-796e88e1c0f1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:23.761913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 856/1694] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:23.763079 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1560ce2-ccdd-4d86-959b-796e88e1c0f1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:23.766405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e1560ce2-ccdd-4d86-959b-796e88e1c0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:23.785910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 839/1695] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:23.788688 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f3bdd-4d98-4c7d-885c-57afb169086e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:23.791558 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1560ce2-ccdd-4d86-959b-796e88e1c0f1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:23.800182 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ade2a3d-03a0-4978-a313-4dd8ee1b7f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:23.801161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2a3d-03a0-4978-a313-4dd8ee1b7f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:23.801514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2a3d-03a0-4978-a313-4dd8ee1b7f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:23.802283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade2a3d-03a0-4978-a313-4dd8ee1b7f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:23.803943 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade2a3d-03a0-4978-a313-4dd8ee1b7f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:23.805302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f3bdd-4d98-4c7d-885c-57afb169086e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:23.805415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ade2a3d-03a0-4978-a313-4dd8ee1b7f70 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:23.814177 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07daa6-3f37-4e89-9e00-4596a6c98132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:23.815273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07daa6-3f37-4e89-9e00-4596a6c98132 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:23.815951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07daa6-3f37-4e89-9e00-4596a6c98132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:23.817107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07daa6-3f37-4e89-9e00-4596a6c98132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:23.818167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07daa6-3f37-4e89-9e00-4596a6c98132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:23.820207 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07daa6-3f37-4e89-9e00-4596a6c98132 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:23.823201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 857/1696] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:23.824746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fdd65-c476-4975-bc64-6ca7dcd2c6e8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:23.825044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fdd65-c476-4975-bc64-6ca7dcd2c6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:23.825343 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fdd65-c476-4975-bc64-6ca7dcd2c6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:23.842923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 840/1697] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:23.843682 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07daa6-3f37-4e89-9e00-4596a6c98132 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:23.850456 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9d07daa6-3f37-4e89-9e00-4596a6c98132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:23.863610 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f81fdd65-c476-4975-bc64-6ca7dcd2c6e8 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:23.864828 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f81fdd65-c476-4975-bc64-6ca7dcd2c6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:23.880637 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 858/1698] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:23.882126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fdd65-c476-4975-bc64-6ca7dcd2c6e8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:23.886316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07daa6-3f37-4e89-9e00-4596a6c98132 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:23.895512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fdd65-c476-4975-bc64-6ca7dcd2c6e8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:23.896499 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07151b-cd71-4ca5-828b-ed31f9cc9be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:23.898144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07151b-cd71-4ca5-828b-ed31f9cc9be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:23.899213 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07151b-cd71-4ca5-828b-ed31f9cc9be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:23.899674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07151b-cd71-4ca5-828b-ed31f9cc9be8 admin admin] PATH_INFO: `/v3/users/8ccc86d2a198464ea12ab44e2340e2de` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:23.900812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e23957-4d11-40ac-8361-b5ed5a5577fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:23.901938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e23957-4d11-40ac-8361-b5ed5a5577fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:23.902334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e23957-4d11-40ac-8361-b5ed5a5577fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:23.902684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e23957-4d11-40ac-8361-b5ed5a5577fc admin admin] PATH_INFO: `/v3/projects/7433253cf90e4a33aa955d036254a526/users/7a172ab350d64598ad31dcd25d9db9ec/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:23.904075 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07151b-cd71-4ca5-828b-ed31f9cc9be8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ccc86d2a198464ea12ab44e2340e2de)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:23.905069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e23957-4d11-40ac-8361-b5ed5a5577fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7433253cf90e4a33aa955d036254a526, user_id=7a172ab350d64598ad31dcd25d9db9ec, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:23.908073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e23957-4d11-40ac-8361-b5ed5a5577fc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:23.910114 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07151b-cd71-4ca5-828b-ed31f9cc9be8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:23.923420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 859/1699] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:23 2022] PUT /identity/v3/projects/7433253cf90e4a33aa955d036254a526/users/7a172ab350d64598ad31dcd25d9db9ec/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:23.926406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ea734-116b-459a-a001-9b965ff20be2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:23.926702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ea734-116b-459a-a001-9b965ff20be2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:23.930665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ea734-116b-459a-a001-9b965ff20be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:23.992380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-181ea734-116b-459a-a001-9b965ff20be2 None None] MFA Rules not processed for user `d3366521d2f54b5e925103a0a5c60d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:23.994249 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-181ea734-116b-459a-a001-9b965ff20be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:24.112853 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 860/1700] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:24.112853 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ea734-116b-459a-a001-9b965ff20be2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:24.192203 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ea734-116b-459a-a001-9b965ff20be2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:24.197555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4051d-bf00-4dcf-b1ff-868503bc8806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:24.198992 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4051d-bf00-4dcf-b1ff-868503bc8806 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:24.199439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4051d-bf00-4dcf-b1ff-868503bc8806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:24.199909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4051d-bf00-4dcf-b1ff-868503bc8806 admin admin] PATH_INFO: `/v3/projects/353c6335e8ce464ba8acba765089e717/users/5b457e6841124086a06fb9b7f609c9a0/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:24.222187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4051d-bf00-4dcf-b1ff-868503bc8806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=353c6335e8ce464ba8acba765089e717, user_id=5b457e6841124086a06fb9b7f609c9a0, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:24.226021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d4051d-bf00-4dcf-b1ff-868503bc8806 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:24.232719 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5b07151b-cd71-4ca5-828b-ed31f9cc9be8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ccc86d2a198464ea12ab44e2340e2de'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:24.233804 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5b07151b-cd71-4ca5-828b-ed31f9cc9be8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ccc86d2a198464ea12ab44e2340e2de'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:24.234697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5b07151b-cd71-4ca5-828b-ed31f9cc9be8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ccc86d2a198464ea12ab44e2340e2de'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:24.271623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5b07151b-cd71-4ca5-828b-ed31f9cc9be8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ccc86d2a198464ea12ab44e2340e2de'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:24.276767 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:24.298755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5b07151b-cd71-4ca5-828b-ed31f9cc9be8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ccc86d2a198464ea12ab44e2340e2de'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:24.316832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 861/1701] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:24 2022] PUT /identity/v3/projects/353c6335e8ce464ba8acba765089e717/users/5b457e6841124086a06fb9b7f609c9a0/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:24.320686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4051d-bf00-4dcf-b1ff-868503bc8806 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:24.320686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b6d4051d-bf00-4dcf-b1ff-868503bc8806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:24.397792 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 841/1702] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:23 2022] DELETE /identity/v3/users/8ccc86d2a198464ea12ab44e2340e2de => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:24.397792 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eacfad-b604-4989-bdcc-86c686efa562 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:24.397792 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eacfad-b604-4989-bdcc-86c686efa562 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:24.397792 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eacfad-b604-4989-bdcc-86c686efa562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:24.425603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4051d-bf00-4dcf-b1ff-868503bc8806 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:24.504932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-91eacfad-b604-4989-bdcc-86c686efa562 None None] MFA Rules not processed for user `7a172ab350d64598ad31dcd25d9db9ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:24.506927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-91eacfad-b604-4989-bdcc-86c686efa562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:24.554442 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2380e92-d4ac-4dc1-95b0-d2407c49c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:24.555133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2380e92-d4ac-4dc1-95b0-d2407c49c0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:24.555415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2380e92-d4ac-4dc1-95b0-d2407c49c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:24.555689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2380e92-d4ac-4dc1-95b0-d2407c49c0d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:24.556436 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2380e92-d4ac-4dc1-95b0-d2407c49c0d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:24.556744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2380e92-d4ac-4dc1-95b0-d2407c49c0d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:24.558392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2380e92-d4ac-4dc1-95b0-d2407c49c0d1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:24.589520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 862/1703] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:24.590937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e362d4-429c-475f-bad0-9cf8c62b4b47 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:24.591247 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e362d4-429c-475f-bad0-9cf8c62b4b47 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:24.591502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e362d4-429c-475f-bad0-9cf8c62b4b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:24.655045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c0e362d4-429c-475f-bad0-9cf8c62b4b47 None None] MFA Rules not processed for user `d3366521d2f54b5e925103a0a5c60d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:24.656370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c0e362d4-429c-475f-bad0-9cf8c62b4b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:24.701906 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:24.716575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 842/1704] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:24 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:24.718819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c99303-99a6-4158-81a7-89a1f3a3a277 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:24.719400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c99303-99a6-4158-81a7-89a1f3a3a277 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:24.719884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c99303-99a6-4158-81a7-89a1f3a3a277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:24.756361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d4c99303-99a6-4158-81a7-89a1f3a3a277 None None] MFA Rules not processed for user `f6a84e6c6706453cb3973dd89c2ea1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:24.760646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d4c99303-99a6-4158-81a7-89a1f3a3a277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:24.787668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 863/1705] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:24.802798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5133ab-85fa-4308-98d4-b92d4ab0621a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:24.802798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5133ab-85fa-4308-98d4-b92d4ab0621a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:24.802798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5133ab-85fa-4308-98d4-b92d4ab0621a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:24.843628 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6a5133ab-85fa-4308-98d4-b92d4ab0621a None None] MFA Rules not processed for user `26ef0b53b0254e3a96490839cd4dd85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:24.844860 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6a5133ab-85fa-4308-98d4-b92d4ab0621a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:24.896165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 843/1706] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:24.903284 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d617e-22ac-4f03-9219-7770ddde776a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:24.903573 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d617e-22ac-4f03-9219-7770ddde776a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:24.903856 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d617e-22ac-4f03-9219-7770ddde776a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:24.967462 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-527d617e-22ac-4f03-9219-7770ddde776a None None] MFA Rules not processed for user `5b457e6841124086a06fb9b7f609c9a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:24.974668 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-527d617e-22ac-4f03-9219-7770ddde776a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:24.978606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 864/1707] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:24.978606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4adc03-2be2-4782-8a5e-e961d4faae84 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:24.978606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4adc03-2be2-4782-8a5e-e961d4faae84 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:24.978606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4adc03-2be2-4782-8a5e-e961d4faae84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:25.012462 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ed4adc03-2be2-4782-8a5e-e961d4faae84 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:25.014453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ed4adc03-2be2-4782-8a5e-e961d4faae84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:25.032100 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 865/1708] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:25.033393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4adc03-2be2-4782-8a5e-e961d4faae84 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:25.064261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4adc03-2be2-4782-8a5e-e961d4faae84 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:25.086189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bafa72-8cd0-4288-8c5a-5fbf81cec656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:25.086988 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bafa72-8cd0-4288-8c5a-5fbf81cec656 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:25.087355 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bafa72-8cd0-4288-8c5a-5fbf81cec656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:25.087715 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bafa72-8cd0-4288-8c5a-5fbf81cec656 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:25.088501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bafa72-8cd0-4288-8c5a-5fbf81cec656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:25.096841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bafa72-8cd0-4288-8c5a-5fbf81cec656 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:25.134843 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 844/1709] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:25.135888 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d617e-22ac-4f03-9219-7770ddde776a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:25.137498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-527d617e-22ac-4f03-9219-7770ddde776a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:25.213963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 866/1710] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:25 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:25.213963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bafa72-8cd0-4288-8c5a-5fbf81cec656 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:25.215535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-08bafa72-8cd0-4288-8c5a-5fbf81cec656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:25.235598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d617e-22ac-4f03-9219-7770ddde776a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:25.309311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bafa72-8cd0-4288-8c5a-5fbf81cec656 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:25.316119 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d952ce-2309-4704-9d90-baca0d415f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:25.316610 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d952ce-2309-4704-9d90-baca0d415f52 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:25.316967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d952ce-2309-4704-9d90-baca0d415f52 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:25.317284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d952ce-2309-4704-9d90-baca0d415f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:25.319422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c9d952ce-2309-4704-9d90-baca0d415f52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:25.341739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79166d5a-f212-42fd-938e-a904616eacd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:25.343198 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79166d5a-f212-42fd-938e-a904616eacd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:25.343600 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79166d5a-f212-42fd-938e-a904616eacd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:25.343954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79166d5a-f212-42fd-938e-a904616eacd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:25.409168 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d952ce-2309-4704-9d90-baca0d415f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:25.411874 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d952ce-2309-4704-9d90-baca0d415f52 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:25.428649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 867/1711] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:25.439612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37b9d0-b010-42dd-b8bc-66ba4be6149b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:25.440295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37b9d0-b010-42dd-b8bc-66ba4be6149b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:25.440611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37b9d0-b010-42dd-b8bc-66ba4be6149b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:25.490574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8c37b9d0-b010-42dd-b8bc-66ba4be6149b None None] MFA Rules not processed for user `26ef0b53b0254e3a96490839cd4dd85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:25.491942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8c37b9d0-b010-42dd-b8bc-66ba4be6149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:25.504646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79166d5a-f212-42fd-938e-a904616eacd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:25.507622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79166d5a-f212-42fd-938e-a904616eacd5 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:25.545656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 845/1712] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:25.549313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79166d5a-f212-42fd-938e-a904616eacd5 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:25.553430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-79166d5a-f212-42fd-938e-a904616eacd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:25.613224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 868/1713] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:25.614283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37b9d0-b010-42dd-b8bc-66ba4be6149b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:25.615937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8c37b9d0-b010-42dd-b8bc-66ba4be6149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:25.696101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:25.753280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79166d5a-f212-42fd-938e-a904616eacd5 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:25.767633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd9160-1881-4012-bd5b-65fcfcec2f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:25.767837 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37b9d0-b010-42dd-b8bc-66ba4be6149b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:25.768455 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd9160-1881-4012-bd5b-65fcfcec2f18 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:25.768887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd9160-1881-4012-bd5b-65fcfcec2f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:25.769179 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd9160-1881-4012-bd5b-65fcfcec2f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:25.783056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af7457-ebdc-4c50-8f21-7a40e86a1a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:25.786597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af7457-ebdc-4c50-8f21-7a40e86a1a31 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:25.786895 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af7457-ebdc-4c50-8f21-7a40e86a1a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:25.787202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af7457-ebdc-4c50-8f21-7a40e86a1a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:25.787904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af7457-ebdc-4c50-8f21-7a40e86a1a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:25.797549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af7457-ebdc-4c50-8f21-7a40e86a1a31 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:25.831768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd9160-1881-4012-bd5b-65fcfcec2f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:25.835068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd9160-1881-4012-bd5b-65fcfcec2f18 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:25.850111 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:25.888335 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 846/1714] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:25.889280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd9160-1881-4012-bd5b-65fcfcec2f18 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:25.906578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd9160-1881-4012-bd5b-65fcfcec2f18 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:25.914925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf2ac5-f8ca-4c01-a0dd-a3557ebf5a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:25.915675 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf2ac5-f8ca-4c01-a0dd-a3557ebf5a90 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:25.927655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf2ac5-f8ca-4c01-a0dd-a3557ebf5a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:25.927655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf2ac5-f8ca-4c01-a0dd-a3557ebf5a90 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:25.927655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf2ac5-f8ca-4c01-a0dd-a3557ebf5a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:25.927655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf2ac5-f8ca-4c01-a0dd-a3557ebf5a90 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:25.956544 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 869/1715] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:25 2022] POST /identity/v3/projects => generated 373 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:25.957534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af7457-ebdc-4c50-8f21-7a40e86a1a31 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:26.035590 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 847/1716] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:25 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:26.041406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf2ac5-f8ca-4c01-a0dd-a3557ebf5a90 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:26.087088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf2ac5-f8ca-4c01-a0dd-a3557ebf5a90 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:26.110543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af7457-ebdc-4c50-8f21-7a40e86a1a31 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:26.121219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb82936-93a4-477a-879f-53e6e54d9bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:26.122042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82936-93a4-477a-879f-53e6e54d9bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:26.122319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82936-93a4-477a-879f-53e6e54d9bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:26.122654 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82936-93a4-477a-879f-53e6e54d9bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:26.126232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5bb82936-93a4-477a-879f-53e6e54d9bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:26.192313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d581c1d-d2e2-4a34-a5f2-806ef2921967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:26.193366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d581c1d-d2e2-4a34-a5f2-806ef2921967 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:26.193931 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d581c1d-d2e2-4a34-a5f2-806ef2921967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:26.194511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d581c1d-d2e2-4a34-a5f2-806ef2921967 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:26.196821 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d581c1d-d2e2-4a34-a5f2-806ef2921967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:26.202359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d581c1d-d2e2-4a34-a5f2-806ef2921967 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:26.225244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82936-93a4-477a-879f-53e6e54d9bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:26.226789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82936-93a4-477a-879f-53e6e54d9bb3 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:26.242266 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 870/1717] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:26.243973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440014f-6ed4-431c-a37e-8e394fdf6992 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:26.244337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440014f-6ed4-431c-a37e-8e394fdf6992 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:26.245490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440014f-6ed4-431c-a37e-8e394fdf6992 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:26.247092 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 871/1718] 10.222.0.83 () {54 vars in 912 bytes} [Wed Jul 20 22:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:47:26.248073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440014f-6ed4-431c-a37e-8e394fdf6992 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:26.264333 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440014f-6ed4-431c-a37e-8e394fdf6992 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:26.280914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e9b42-361d-41c1-b37f-5792e3542dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:26.281674 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e9b42-361d-41c1-b37f-5792e3542dfa admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:26.286775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e9b42-361d-41c1-b37f-5792e3542dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:26.286775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e9b42-361d-41c1-b37f-5792e3542dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:26.286775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e9b42-361d-41c1-b37f-5792e3542dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:26.286775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e9b42-361d-41c1-b37f-5792e3542dfa admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:26.297094 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 872/1719] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:26.298457 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a162d4-7b0a-4f46-a4e2-a2478a83050d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:26.298749 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a162d4-7b0a-4f46-a4e2-a2478a83050d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:26.299028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a162d4-7b0a-4f46-a4e2-a2478a83050d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:26.327575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 848/1720] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:26 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:26.328968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4087b-e79e-4602-a2ed-706188132611 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:26.329235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4087b-e79e-4602-a2ed-706188132611 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:26.329622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4087b-e79e-4602-a2ed-706188132611 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:26.332261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 849/1721] 10.222.0.83 () {54 vars in 912 bytes} [Wed Jul 20 22:47:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:47:26.333680 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4087b-e79e-4602-a2ed-706188132611 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:26.348207 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4087b-e79e-4602-a2ed-706188132611 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:26.353183 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16046c-ff2e-4366-8615-f1685aa44d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:26.353909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16046c-ff2e-4366-8615-f1685aa44d42 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:26.354198 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16046c-ff2e-4366-8615-f1685aa44d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:26.354483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16046c-ff2e-4366-8615-f1685aa44d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:26.355226 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16046c-ff2e-4366-8615-f1685aa44d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:26.356934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16046c-ff2e-4366-8615-f1685aa44d42 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:26.372345 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f2a162d4-7b0a-4f46-a4e2-a2478a83050d None None] MFA Rules not processed for user `d3faac5703c54396bcdba9e149a6d35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:26.374847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f2a162d4-7b0a-4f46-a4e2-a2478a83050d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:26.387282 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 850/1722] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:26.391648 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16046c-ff2e-4366-8615-f1685aa44d42 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:26.411713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16046c-ff2e-4366-8615-f1685aa44d42 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:26.440826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c53fb-6ffb-4d7c-92a5-06b8fba83a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:26.441583 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c53fb-6ffb-4d7c-92a5-06b8fba83a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:26.441914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c53fb-6ffb-4d7c-92a5-06b8fba83a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:26.442198 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c53fb-6ffb-4d7c-92a5-06b8fba83a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:26.443040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c53fb-6ffb-4d7c-92a5-06b8fba83a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:26.444710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c53fb-6ffb-4d7c-92a5-06b8fba83a5b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:26.481912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 851/1723] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:26.483083 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 873/1724] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:47:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:26.483577 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a962c-fece-4682-81de-54dcf5aee04d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:26.483872 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a962c-fece-4682-81de-54dcf5aee04d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:26.484238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a962c-fece-4682-81de-54dcf5aee04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:26.485048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a162d4-7b0a-4f46-a4e2-a2478a83050d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:26.516141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ea2a962c-fece-4682-81de-54dcf5aee04d None None] MFA Rules not processed for user `d3faac5703c54396bcdba9e149a6d35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:26.517687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ea2a962c-fece-4682-81de-54dcf5aee04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:26.529436 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a162d4-7b0a-4f46-a4e2-a2478a83050d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:26.538009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 852/1725] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:47:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:26.538896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a962c-fece-4682-81de-54dcf5aee04d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:26.542829 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b3c13-2e84-438a-b00d-69034fb9bba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:26.545423 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b3c13-2e84-438a-b00d-69034fb9bba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:26.548913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b3c13-2e84-438a-b00d-69034fb9bba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:26.549917 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b3c13-2e84-438a-b00d-69034fb9bba5 admin admin] PATH_INFO: `/v3/projects/76198e5f546c410bb6587855ffec4de7/users/8bf62ed58d17497cac52eae9fe457c2c/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:26.567536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a962c-fece-4682-81de-54dcf5aee04d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:26.584986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab9e8c-50f1-47ee-9924-e901470b15bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:26.586182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab9e8c-50f1-47ee-9924-e901470b15bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:26.587151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab9e8c-50f1-47ee-9924-e901470b15bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:26.587626 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab9e8c-50f1-47ee-9924-e901470b15bf admin admin] PATH_INFO: `/v3/projects/d112672847a044f4ba754efee9739717/users/5236b5a8c180434d9cdd3c47a24d8ffb/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:26.614301 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b3c13-2e84-438a-b00d-69034fb9bba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76198e5f546c410bb6587855ffec4de7, user_id=8bf62ed58d17497cac52eae9fe457c2c, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:26.628815 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab9e8c-50f1-47ee-9924-e901470b15bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d112672847a044f4ba754efee9739717, user_id=5236b5a8c180434d9cdd3c47a24d8ffb, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:26.629065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b3c13-2e84-438a-b00d-69034fb9bba5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:26.633934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab9e8c-50f1-47ee-9924-e901470b15bf admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:26.730916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 874/1726] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:26 2022] PUT /identity/v3/projects/76198e5f546c410bb6587855ffec4de7/users/8bf62ed58d17497cac52eae9fe457c2c/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:26.731572 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b3c13-2e84-438a-b00d-69034fb9bba5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:26.757955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 853/1727] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:26 2022] PUT /identity/v3/projects/d112672847a044f4ba754efee9739717/users/5236b5a8c180434d9cdd3c47a24d8ffb/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:26.759824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab9e8c-50f1-47ee-9924-e901470b15bf admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:26.765173 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3dab9e8c-50f1-47ee-9924-e901470b15bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:26.906131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b3c13-2e84-438a-b00d-69034fb9bba5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:26.924287 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab9e8c-50f1-47ee-9924-e901470b15bf admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:26.930611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ce7ed-a3a7-4793-9470-c516e78169b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:26.931567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ce7ed-a3a7-4793-9470-c516e78169b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:26.934199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ce7ed-a3a7-4793-9470-c516e78169b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:26.935578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ce7ed-a3a7-4793-9470-c516e78169b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:26.939432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:26.953458 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ce7ed-a3a7-4793-9470-c516e78169b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:26.954974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ce7ed-a3a7-4793-9470-c516e78169b9 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:26.985618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 854/1728] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:26.988791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df619-de79-474b-98d8-cc6dd92a742e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:26.989097 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df619-de79-474b-98d8-cc6dd92a742e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:26.989383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1df619-de79-474b-98d8-cc6dd92a742e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:27.050210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f428b-7874-442f-a85b-2700924021b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:27.052229 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f428b-7874-442f-a85b-2700924021b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:27.052523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f428b-7874-442f-a85b-2700924021b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:27.052805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f428b-7874-442f-a85b-2700924021b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:27.064466 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-aa1df619-de79-474b-98d8-cc6dd92a742e None None] MFA Rules not processed for user `8bf62ed58d17497cac52eae9fe457c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:27.070739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-aa1df619-de79-474b-98d8-cc6dd92a742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:27.074267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f428b-7874-442f-a85b-2700924021b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:27.081117 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f428b-7874-442f-a85b-2700924021b8 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:27.091777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 875/1729] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:27.093777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f428b-7874-442f-a85b-2700924021b8 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:27.248176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 855/1730] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:27.249531 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1df619-de79-474b-98d8-cc6dd92a742e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:27.278305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-aa1df619-de79-474b-98d8-cc6dd92a742e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:27.298788 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f428b-7874-442f-a85b-2700924021b8 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:27.303785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1df619-de79-474b-98d8-cc6dd92a742e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:27.309842 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1409fe4-91bc-472f-8fcb-2370abb12e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:27.311063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1409fe4-91bc-472f-8fcb-2370abb12e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:27.311654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1409fe4-91bc-472f-8fcb-2370abb12e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:27.312299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1409fe4-91bc-472f-8fcb-2370abb12e70 admin admin] PATH_INFO: `/v3/projects/81744b3ca1184ee99533055ef0f581eb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:27.313992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1409fe4-91bc-472f-8fcb-2370abb12e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81744b3ca1184ee99533055ef0f581eb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:27.324190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1409fe4-91bc-472f-8fcb-2370abb12e70 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:27.335118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143b721-8599-41df-bc33-4ae827a53ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:27.335825 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143b721-8599-41df-bc33-4ae827a53ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:27.336363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143b721-8599-41df-bc33-4ae827a53ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:27.336363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143b721-8599-41df-bc33-4ae827a53ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:27.337104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143b721-8599-41df-bc33-4ae827a53ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:27.345029 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143b721-8599-41df-bc33-4ae827a53ee5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:27.374500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 876/1731] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:27.384981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143b721-8599-41df-bc33-4ae827a53ee5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:27.493441 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143b721-8599-41df-bc33-4ae827a53ee5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:27.506340 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a1409fe4-91bc-472f-8fcb-2370abb12e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81744b3ca1184ee99533055ef0f581eb', 'request_id': 'req-a1409fe4-91bc-472f-8fcb-2370abb12e70'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:27.573831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60da02-58bc-40f1-98ba-585fdab40497 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:27.573831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60da02-58bc-40f1-98ba-585fdab40497 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:27.573831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60da02-58bc-40f1-98ba-585fdab40497 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:27.573831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60da02-58bc-40f1-98ba-585fdab40497 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:27.605216 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a1409fe4-91bc-472f-8fcb-2370abb12e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81744b3ca1184ee99533055ef0f581eb', 'request_id': 'req-a1409fe4-91bc-472f-8fcb-2370abb12e70'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:27.612653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a1409fe4-91bc-472f-8fcb-2370abb12e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81744b3ca1184ee99533055ef0f581eb', 'request_id': 'req-a1409fe4-91bc-472f-8fcb-2370abb12e70'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:27.646478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60da02-58bc-40f1-98ba-585fdab40497 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:27.647968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60da02-58bc-40f1-98ba-585fdab40497 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:27.660205 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 877/1732] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:27.667124 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a1409fe4-91bc-472f-8fcb-2370abb12e70 admin admin] The token cache is being invalidate because project 81744b3ca1184ee99533055ef0f581eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:27.668491 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a1409fe4-91bc-472f-8fcb-2370abb12e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:27.673292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a1409fe4-91bc-472f-8fcb-2370abb12e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:27.674001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60da02-58bc-40f1-98ba-585fdab40497 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:27.677351 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 856/1733] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:27 2022] DELETE /identity/v3/projects/81744b3ca1184ee99533055ef0f581eb => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:27.684426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aeccc-7e19-48d5-9551-29a8b0e9f1f6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:27.685497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aeccc-7e19-48d5-9551-29a8b0e9f1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:27.687405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345aeccc-7e19-48d5-9551-29a8b0e9f1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:27.764847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-345aeccc-7e19-48d5-9551-29a8b0e9f1f6 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:27.764847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-345aeccc-7e19-48d5-9551-29a8b0e9f1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:27.780484 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:27.880062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60da02-58bc-40f1-98ba-585fdab40497 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:27.891841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9d20f-0a36-4414-96e2-8e1c3da1b652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:27.892773 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9d20f-0a36-4414-96e2-8e1c3da1b652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:27.894835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9d20f-0a36-4414-96e2-8e1c3da1b652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:27.895143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9d20f-0a36-4414-96e2-8e1c3da1b652 admin admin] PATH_INFO: `/v3/projects/d112672847a044f4ba754efee9739717/users/5236b5a8c180434d9cdd3c47a24d8ffb/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:27.902501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9d20f-0a36-4414-96e2-8e1c3da1b652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d112672847a044f4ba754efee9739717, user_id=5236b5a8c180434d9cdd3c47a24d8ffb, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:27.906800 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9d20f-0a36-4414-96e2-8e1c3da1b652 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:27.959116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 878/1734] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:27 2022] PUT /identity/v3/projects/d112672847a044f4ba754efee9739717/users/5236b5a8c180434d9cdd3c47a24d8ffb/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:27.959116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9d20f-0a36-4414-96e2-8e1c3da1b652 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:27.960990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-07c9d20f-0a36-4414-96e2-8e1c3da1b652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:27.988478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 857/1735] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:27.996794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe978b1-b6b1-43b9-a8e2-f07c62df8e5e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:27.997088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe978b1-b6b1-43b9-a8e2-f07c62df8e5e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:27.997375 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe978b1-b6b1-43b9-a8e2-f07c62df8e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:28.102265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1fe978b1-b6b1-43b9-a8e2-f07c62df8e5e None None] MFA Rules not processed for user `5236b5a8c180434d9cdd3c47a24d8ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:28.106463 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1fe978b1-b6b1-43b9-a8e2-f07c62df8e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:28.173430 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9d20f-0a36-4414-96e2-8e1c3da1b652 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:28.189840 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62de0ba-bebd-46b4-9552-d3bc8c27e600 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:28.190529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de0ba-bebd-46b4-9552-d3bc8c27e600 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:28.190911 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de0ba-bebd-46b4-9552-d3bc8c27e600 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:28.191188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62de0ba-bebd-46b4-9552-d3bc8c27e600 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:28.194012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d62de0ba-bebd-46b4-9552-d3bc8c27e600 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:28.336182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 858/1736] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:28.340132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f802541-5730-41ec-97a7-0be94a8ce54a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:28.341542 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f802541-5730-41ec-97a7-0be94a8ce54a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:28.342234 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f802541-5730-41ec-97a7-0be94a8ce54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:28.384572 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62de0ba-bebd-46b4-9552-d3bc8c27e600 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:28.386265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62de0ba-bebd-46b4-9552-d3bc8c27e600 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:28.406765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4f802541-5730-41ec-97a7-0be94a8ce54a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:28.407901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4f802541-5730-41ec-97a7-0be94a8ce54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:28.426651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 879/1737] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:28.428044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ed531-3b16-4d9a-9dfc-498719cf835f None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:28.428341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ed531-3b16-4d9a-9dfc-498719cf835f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:28.428624 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86ed531-3b16-4d9a-9dfc-498719cf835f None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:28.430344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 880/1738] 10.222.0.83 () {54 vars in 961 bytes} [Wed Jul 20 22:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:47:28.431255 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ed531-3b16-4d9a-9dfc-498719cf835f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:28.432950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b86ed531-3b16-4d9a-9dfc-498719cf835f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:28.484498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 859/1739] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:28.486134 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d3a41-f7be-4efb-a1c4-31835409f15d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:28.486424 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d3a41-f7be-4efb-a1c4-31835409f15d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:28.486784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d3a41-f7be-4efb-a1c4-31835409f15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:28.521763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3e8d3a41-f7be-4efb-a1c4-31835409f15d None None] MFA Rules not processed for user `65c9898ccf874dce88f08bebdbae02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:28.521763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3e8d3a41-f7be-4efb-a1c4-31835409f15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:28.593875 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86ed531-3b16-4d9a-9dfc-498719cf835f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:28.605972 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ca8cf-4eb4-4546-91f7-c665733e03cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c9898ccf874dce88f08bebdbae02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:28.607172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ca8cf-4eb4-4546-91f7-c665733e03cd service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:28.607172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ca8cf-4eb4-4546-91f7-c665733e03cd service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:28.607393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ca8cf-4eb4-4546-91f7-c665733e03cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:28.612505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5f8ca8cf-4eb4-4546-91f7-c665733e03cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:28.639352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ca8cf-4eb4-4546-91f7-c665733e03cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:28.641430 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ca8cf-4eb4-4546-91f7-c665733e03cd service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:28.650425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 860/1740] 10.222.0.83 () {58 vars in 1058 bytes} [Wed Jul 20 22:47:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:28.651740 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d3a41-f7be-4efb-a1c4-31835409f15d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:28.665111 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 881/1741] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:28.666669 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ca8cf-4eb4-4546-91f7-c665733e03cd service placement] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:28.668922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d3a41-f7be-4efb-a1c4-31835409f15d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:28.686420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ca8cf-4eb4-4546-91f7-c665733e03cd service placement] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:28.688741 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90fa2e-31f9-400a-be1c-c87f71161d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:28.690406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90fa2e-31f9-400a-be1c-c87f71161d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:28.690902 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90fa2e-31f9-400a-be1c-c87f71161d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:28.691865 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90fa2e-31f9-400a-be1c-c87f71161d89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:28.693116 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90fa2e-31f9-400a-be1c-c87f71161d89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:28.693699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90fa2e-31f9-400a-be1c-c87f71161d89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:28.696937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90fa2e-31f9-400a-be1c-c87f71161d89 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:28.699027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbe2fd-7581-42b3-a2eb-dfa2ffa1852c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c9898ccf874dce88f08bebdbae02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:28.699911 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbe2fd-7581-42b3-a2eb-dfa2ffa1852c service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:28.701439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbe2fd-7581-42b3-a2eb-dfa2ffa1852c service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:28.701863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbe2fd-7581-42b3-a2eb-dfa2ffa1852c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:28.716757 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 861/1742] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:28.720977 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbe2fd-7581-42b3-a2eb-dfa2ffa1852c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:28.722727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90fa2e-31f9-400a-be1c-c87f71161d89 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:28.727442 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfbe2fd-7581-42b3-a2eb-dfa2ffa1852c service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:28.750837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90fa2e-31f9-400a-be1c-c87f71161d89 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:28.751564 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 882/1743] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:28.763858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e2d1f-f8cb-4e9d-b83f-aa1779094e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:28.764392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e2d1f-f8cb-4e9d-b83f-aa1779094e82 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:28.764679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e2d1f-f8cb-4e9d-b83f-aa1779094e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:28.764959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e2d1f-f8cb-4e9d-b83f-aa1779094e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:28.765671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e2d1f-f8cb-4e9d-b83f-aa1779094e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:28.767619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e2d1f-f8cb-4e9d-b83f-aa1779094e82 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:28.919934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 862/1744] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:28 2022] POST /identity/v3/projects => generated 403 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:28.921844 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbe2fd-7581-42b3-a2eb-dfa2ffa1852c service placement] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:28.941645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfbe2fd-7581-42b3-a2eb-dfa2ffa1852c service placement] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:29.077953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:29.116881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b586a-fc5a-4aea-bf15-02a92efe9303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:29.117903 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b586a-fc5a-4aea-bf15-02a92efe9303 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:29.124708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b586a-fc5a-4aea-bf15-02a92efe9303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:29.124708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b586a-fc5a-4aea-bf15-02a92efe9303 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:29.124708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b586a-fc5a-4aea-bf15-02a92efe9303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:29.124708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b586a-fc5a-4aea-bf15-02a92efe9303 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:29.141463 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e2d1f-f8cb-4e9d-b83f-aa1779094e82 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:29.147270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-102e2d1f-f8cb-4e9d-b83f-aa1779094e82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:29.235191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e2d1f-f8cb-4e9d-b83f-aa1779094e82 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:29.239796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f075c-afa5-439d-8ee3-fee5916a423e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:29.240632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f075c-afa5-439d-8ee3-fee5916a423e service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:29.241051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f075c-afa5-439d-8ee3-fee5916a423e service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:29.241636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f075c-afa5-439d-8ee3-fee5916a423e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:29.266069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 883/1745] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:28 2022] POST /identity/v3/users => generated 302 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:29.274276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b586a-fc5a-4aea-bf15-02a92efe9303 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:29.305574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b586a-fc5a-4aea-bf15-02a92efe9303 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:29.316271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a1190-54d7-4ec5-8920-a72650d7305c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:29.316977 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1190-54d7-4ec5-8920-a72650d7305c admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:29.318561 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1190-54d7-4ec5-8920-a72650d7305c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:29.318981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1190-54d7-4ec5-8920-a72650d7305c admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:29.319896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a1190-54d7-4ec5-8920-a72650d7305c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:29.325714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a1190-54d7-4ec5-8920-a72650d7305c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:29.357962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 884/1746] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:47:29.364059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a1190-54d7-4ec5-8920-a72650d7305c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:29.376859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:29.386517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a1190-54d7-4ec5-8920-a72650d7305c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:29.392721 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c6265-9cda-4677-9051-e9e55aa5b81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:29.393706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c6265-9cda-4677-9051-e9e55aa5b81f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:29.394030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c6265-9cda-4677-9051-e9e55aa5b81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:29.397254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c6265-9cda-4677-9051-e9e55aa5b81f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:29.416472 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c6265-9cda-4677-9051-e9e55aa5b81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:29.426280 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c6265-9cda-4677-9051-e9e55aa5b81f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:29.429057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f075c-afa5-439d-8ee3-fee5916a423e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:29.433446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f075c-afa5-439d-8ee3-fee5916a423e service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:29.446810 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 885/1747] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:29.457827 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c6265-9cda-4677-9051-e9e55aa5b81f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:29.472485 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 863/1748] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:47:29.496580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c6265-9cda-4677-9051-e9e55aa5b81f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:29.514463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac205bac-e92f-41b5-941e-43bd1864e0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:29.515381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac205bac-e92f-41b5-941e-43bd1864e0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:29.515701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac205bac-e92f-41b5-941e-43bd1864e0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:29.519640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac205bac-e92f-41b5-941e-43bd1864e0e3 admin admin] PATH_INFO: `/v3/projects/bb270650f3ec462f81c1d14838caeec9/users/fc9f78d88d4b47609b6c6672723505e0/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:29.571686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac205bac-e92f-41b5-941e-43bd1864e0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb270650f3ec462f81c1d14838caeec9, user_id=fc9f78d88d4b47609b6c6672723505e0, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:29.574504 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac205bac-e92f-41b5-941e-43bd1864e0e3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:29.727295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 886/1749] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:29 2022] PUT /identity/v3/projects/bb270650f3ec462f81c1d14838caeec9/users/fc9f78d88d4b47609b6c6672723505e0/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:29.735109 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77fec5-e2f0-40b6-bb7f-b5e9942cf037 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:29.735413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77fec5-e2f0-40b6-bb7f-b5e9942cf037 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:29.735700 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c77fec5-e2f0-40b6-bb7f-b5e9942cf037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:29.759112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0c77fec5-e2f0-40b6-bb7f-b5e9942cf037 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:29.760797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0c77fec5-e2f0-40b6-bb7f-b5e9942cf037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:29.844840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 864/1750] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:29.865572 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac205bac-e92f-41b5-941e-43bd1864e0e3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:29.878005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77fec5-e2f0-40b6-bb7f-b5e9942cf037 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:29.878005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0c77fec5-e2f0-40b6-bb7f-b5e9942cf037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:29.969860 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac205bac-e92f-41b5-941e-43bd1864e0e3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:29.975065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c77fec5-e2f0-40b6-bb7f-b5e9942cf037 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:29.975700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fc8bb4-9ebb-4b4f-9a91-0eaa755e7e3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:29.976383 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc8bb4-9ebb-4b4f-9a91-0eaa755e7e3b service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:29.976702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc8bb4-9ebb-4b4f-9a91-0eaa755e7e3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:29.976981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc8bb4-9ebb-4b4f-9a91-0eaa755e7e3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:29.981318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e2fc8bb4-9ebb-4b4f-9a91-0eaa755e7e3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:29.982812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bfaba-2019-4d15-8b79-0a702bc475f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:29.984315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bfaba-2019-4d15-8b79-0a702bc475f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:29.985036 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bfaba-2019-4d15-8b79-0a702bc475f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:29.985574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bfaba-2019-4d15-8b79-0a702bc475f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:30.023551 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bfaba-2019-4d15-8b79-0a702bc475f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:30.026470 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bfaba-2019-4d15-8b79-0a702bc475f7 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:30.102480 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 865/1751] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:47:30.116034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71d4b6-db0d-4665-82a3-51fe1961fdf5 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:30.119238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71d4b6-db0d-4665-82a3-51fe1961fdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:30.119238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71d4b6-db0d-4665-82a3-51fe1961fdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:30.161784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0f71d4b6-db0d-4665-82a3-51fe1961fdf5 None None] MFA Rules not processed for user `26ef0b53b0254e3a96490839cd4dd85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:30.161784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0f71d4b6-db0d-4665-82a3-51fe1961fdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:30.162560 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc8bb4-9ebb-4b4f-9a91-0eaa755e7e3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:30.164361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fc8bb4-9ebb-4b4f-9a91-0eaa755e7e3b service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:30.203933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 887/1752] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:30.249775 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 866/1753] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:31.297594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:32.216800 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ecb3-4981-4190-9cea-d7095a5fba20 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:32.217703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ecb3-4981-4190-9cea-d7095a5fba20 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:32.218000 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724ecb3-4981-4190-9cea-d7095a5fba20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:32.274327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8724ecb3-4981-4190-9cea-d7095a5fba20 None None] MFA Rules not processed for user `fc9f78d88d4b47609b6c6672723505e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:32.275628 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8724ecb3-4981-4190-9cea-d7095a5fba20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:32.331527 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:32.353014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 888/1754] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:32.357567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71d4b6-db0d-4665-82a3-51fe1961fdf5 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:32.371008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71d4b6-db0d-4665-82a3-51fe1961fdf5 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:32.375886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c55ee-a1b0-435e-b4b5-66937c0cc699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:32.376733 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c55ee-a1b0-435e-b4b5-66937c0cc699 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:32.377030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c55ee-a1b0-435e-b4b5-66937c0cc699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:32.377376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c55ee-a1b0-435e-b4b5-66937c0cc699 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:32.378253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c55ee-a1b0-435e-b4b5-66937c0cc699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:32.380346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5c55ee-a1b0-435e-b4b5-66937c0cc699 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:32.508768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 867/1755] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:32 2022] POST /identity/v3/projects => generated 405 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:32.512986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724ecb3-4981-4190-9cea-d7095a5fba20 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:32.526602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724ecb3-4981-4190-9cea-d7095a5fba20 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:32.582590 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b0d59-e035-4343-b6a3-dd9bc605eaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:32.583373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b0d59-e035-4343-b6a3-dd9bc605eaf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:32.583659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b0d59-e035-4343-b6a3-dd9bc605eaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:32.583934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b0d59-e035-4343-b6a3-dd9bc605eaf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:32.584652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b0d59-e035-4343-b6a3-dd9bc605eaf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:32.586607 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b0d59-e035-4343-b6a3-dd9bc605eaf7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:32.713477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 889/1756] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:32 2022] POST /identity/v3/users => generated 309 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:32.716275 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c55ee-a1b0-435e-b4b5-66937c0cc699 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:32.728211 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5c55ee-a1b0-435e-b4b5-66937c0cc699 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:32.737941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c07c0f-f1f2-49e0-ba2c-4e0c9b740ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:32.739697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c07c0f-f1f2-49e0-ba2c-4e0c9b740ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:32.739992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c07c0f-f1f2-49e0-ba2c-4e0c9b740ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:32.740618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c07c0f-f1f2-49e0-ba2c-4e0c9b740ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:32.741472 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c07c0f-f1f2-49e0-ba2c-4e0c9b740ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:32.743314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c07c0f-f1f2-49e0-ba2c-4e0c9b740ba4 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:32.754181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 868/1757] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:32.758900 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b0d59-e035-4343-b6a3-dd9bc605eaf7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:32.769829 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b0d59-e035-4343-b6a3-dd9bc605eaf7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:32.776465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40c869-2a55-4fb0-8c68-02ff2f05d56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:32.776465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40c869-2a55-4fb0-8c68-02ff2f05d56e admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:32.776465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40c869-2a55-4fb0-8c68-02ff2f05d56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:32.776465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40c869-2a55-4fb0-8c68-02ff2f05d56e admin admin] PATH_INFO: `/v3/projects/3aa668a0557349f78102560fa886ac37/users/cdcabffb61684252a23f495015d76377/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:32.793707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40c869-2a55-4fb0-8c68-02ff2f05d56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa668a0557349f78102560fa886ac37, user_id=cdcabffb61684252a23f495015d76377, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:32.796427 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40c869-2a55-4fb0-8c68-02ff2f05d56e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:32.953332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 890/1758] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:32 2022] PUT /identity/v3/projects/3aa668a0557349f78102560fa886ac37/users/cdcabffb61684252a23f495015d76377/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:32.954232 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c07c0f-f1f2-49e0-ba2c-4e0c9b740ba4 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:32.981555 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c07c0f-f1f2-49e0-ba2c-4e0c9b740ba4 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:33.216872 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b98e5-9d72-4bb6-b6b1-279483c26bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:33.218092 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b98e5-9d72-4bb6-b6b1-279483c26bbc admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:33.218383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b98e5-9d72-4bb6-b6b1-279483c26bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:33.218691 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b98e5-9d72-4bb6-b6b1-279483c26bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:33.219558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b98e5-9d72-4bb6-b6b1-279483c26bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:33.221451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b98e5-9d72-4bb6-b6b1-279483c26bbc admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:33.242392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40c869-2a55-4fb0-8c68-02ff2f05d56e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:33.249430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 869/1759] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:47:33.277312 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40c869-2a55-4fb0-8c68-02ff2f05d56e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:33.300818 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4690f09-4e6c-4fd0-9720-044cc8f294ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:33.302495 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4690f09-4e6c-4fd0-9720-044cc8f294ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:33.303247 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4690f09-4e6c-4fd0-9720-044cc8f294ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:33.306169 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4690f09-4e6c-4fd0-9720-044cc8f294ce admin admin] PATH_INFO: `/v3/projects/3aa668a0557349f78102560fa886ac37/users/cdcabffb61684252a23f495015d76377/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:33.317144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4690f09-4e6c-4fd0-9720-044cc8f294ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa668a0557349f78102560fa886ac37, user_id=cdcabffb61684252a23f495015d76377, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:33.322405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4690f09-4e6c-4fd0-9720-044cc8f294ce admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:33.364359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 891/1760] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:33 2022] PUT /identity/v3/projects/3aa668a0557349f78102560fa886ac37/users/cdcabffb61684252a23f495015d76377/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:33.892118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b7852-8fb8-45ce-a9a8-bdcd331cc8d0 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:33.894270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b7852-8fb8-45ce-a9a8-bdcd331cc8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:33.894704 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b7852-8fb8-45ce-a9a8-bdcd331cc8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:33.954667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ec9b7852-8fb8-45ce-a9a8-bdcd331cc8d0 None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:33.957355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ec9b7852-8fb8-45ce-a9a8-bdcd331cc8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:34.005605 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:34.023229 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4690f09-4e6c-4fd0-9720-044cc8f294ce admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:34.026470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f4690f09-4e6c-4fd0-9720-044cc8f294ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:34.036140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 870/1761] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:47:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:34.116164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4690f09-4e6c-4fd0-9720-044cc8f294ce admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:34.128172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:34.132173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:34.132462 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:34.132743 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] PATH_INFO: `/v3/users/74f5d9e4fe6943aca33aeea22bad6849` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:34.135363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f5d9e4fe6943aca33aeea22bad6849)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:34.138412 dv-cinder-799871-38-smb devstack@keystone.service[80614]: WARNING py.warnings [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:47:34.138412 dv-cinder-799871-38-smb devstack@keystone.service[80614]: warnings.warn(msg) Jul 20 22:47:34.138412 dv-cinder-799871-38-smb devstack@keystone.service[80614]: Jul 20 22:47:34.145587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:34.190016 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:34.430593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b7852-8fb8-45ce-a9a8-bdcd331cc8d0 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:34.432730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ec9b7852-8fb8-45ce-a9a8-bdcd331cc8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:34.494352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f5d9e4fe6943aca33aeea22bad6849'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:34.629023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f5d9e4fe6943aca33aeea22bad6849'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:34.629775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f5d9e4fe6943aca33aeea22bad6849'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:34.652616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f5d9e4fe6943aca33aeea22bad6849'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:34.655057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f5d9e4fe6943aca33aeea22bad6849'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:34.656249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b7852-8fb8-45ce-a9a8-bdcd331cc8d0 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:34.672630 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f21f5-135c-4212-b6f4-3131b8c2ed0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:34.678891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f21f5-135c-4212-b6f4-3131b8c2ed0d service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:34.678891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f21f5-135c-4212-b6f4-3131b8c2ed0d service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:34.678891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f21f5-135c-4212-b6f4-3131b8c2ed0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:34.678891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-931f21f5-135c-4212-b6f4-3131b8c2ed0d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:34.689343 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f21f5-135c-4212-b6f4-3131b8c2ed0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:34.691880 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f21f5-135c-4212-b6f4-3131b8c2ed0d service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:34.712267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 871/1762] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:47:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:47:34.734225 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 892/1763] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:34 2022] DELETE /identity/v3/users/74f5d9e4fe6943aca33aeea22bad6849 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:47:34.739933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a46cf-c3e8-48ae-a33d-74c9a0f1ff9b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:34.740542 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a46cf-c3e8-48ae-a33d-74c9a0f1ff9b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:34.741113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a46cf-c3e8-48ae-a33d-74c9a0f1ff9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:34.808813 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a45a46cf-c3e8-48ae-a33d-74c9a0f1ff9b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:34.813494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a45a46cf-c3e8-48ae-a33d-74c9a0f1ff9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:34.896323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:34.976758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 872/1764] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:34.990413 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:34.992002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:35.130776 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9cf57-4f4e-436a-a087-7883ffbc8692 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:35.137120 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dbe68-9e75-4797-8e6c-6cd39a618594 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:35.139368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dbe68-9e75-4797-8e6c-6cd39a618594 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:35.140301 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dbe68-9e75-4797-8e6c-6cd39a618594 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:35.140694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dbe68-9e75-4797-8e6c-6cd39a618594 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:35.178874 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dbe68-9e75-4797-8e6c-6cd39a618594 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:35.180362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dbe68-9e75-4797-8e6c-6cd39a618594 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:35.204874 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 893/1765] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:35.399959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:35.423171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbade26d-6ea1-469e-9d94-64149b7b443a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:35.423631 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbade26d-6ea1-469e-9d94-64149b7b443a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:35.424089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbade26d-6ea1-469e-9d94-64149b7b443a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:35.473575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bbade26d-6ea1-469e-9d94-64149b7b443a None None] MFA Rules not processed for user `d3faac5703c54396bcdba9e149a6d35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:35.475043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bbade26d-6ea1-469e-9d94-64149b7b443a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:35.491237 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 873/1766] 10.222.0.15 () {58 vars in 1015 bytes} [Wed Jul 20 22:47:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:35.608806 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dbe68-9e75-4797-8e6c-6cd39a618594 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:35.618145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dbe68-9e75-4797-8e6c-6cd39a618594 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:35.636792 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fa61a-058b-4b12-98e4-eefcfc8441d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:35.637499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fa61a-058b-4b12-98e4-eefcfc8441d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:35.637892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fa61a-058b-4b12-98e4-eefcfc8441d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:35.638219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82fa61a-058b-4b12-98e4-eefcfc8441d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:35.666433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fa61a-058b-4b12-98e4-eefcfc8441d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:35.668177 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82fa61a-058b-4b12-98e4-eefcfc8441d2 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:35.703828 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 894/1767] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:36.939177 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbade26d-6ea1-469e-9d94-64149b7b443a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:36.942980 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bbade26d-6ea1-469e-9d94-64149b7b443a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:36.953454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:36.978656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbade26d-6ea1-469e-9d94-64149b7b443a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:37.000654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611f36f-f676-487f-8d00-19c37106c8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:37.005960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611f36f-f676-487f-8d00-19c37106c8c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:37.005960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611f36f-f676-487f-8d00-19c37106c8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:37.005960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611f36f-f676-487f-8d00-19c37106c8c9 admin admin] PATH_INFO: `/v3/projects/f2ff91457b4d4c72b1543f67c0af578a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:37.012121 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611f36f-f676-487f-8d00-19c37106c8c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ff91457b4d4c72b1543f67c0af578a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:37.025302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611f36f-f676-487f-8d00-19c37106c8c9 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:37.250261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d611f36f-f676-487f-8d00-19c37106c8c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ff91457b4d4c72b1543f67c0af578a', 'request_id': 'req-d611f36f-f676-487f-8d00-19c37106c8c9'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:37.346716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d611f36f-f676-487f-8d00-19c37106c8c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ff91457b4d4c72b1543f67c0af578a', 'request_id': 'req-d611f36f-f676-487f-8d00-19c37106c8c9'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:37.354098 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d611f36f-f676-487f-8d00-19c37106c8c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ff91457b4d4c72b1543f67c0af578a', 'request_id': 'req-d611f36f-f676-487f-8d00-19c37106c8c9'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:37.359574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:37.391698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d611f36f-f676-487f-8d00-19c37106c8c9 admin admin] The token cache is being invalidate because project f2ff91457b4d4c72b1543f67c0af578a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:37.400796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d611f36f-f676-487f-8d00-19c37106c8c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:37.400796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d611f36f-f676-487f-8d00-19c37106c8c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:37.400796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 874/1768] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:36 2022] DELETE /identity/v3/projects/f2ff91457b4d4c72b1543f67c0af578a => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:37.401232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fa61a-058b-4b12-98e4-eefcfc8441d2 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:37.446359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82fa61a-058b-4b12-98e4-eefcfc8441d2 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:37.650153 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056b686-c664-4505-a0b3-65efd0ca7353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:37.652086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056b686-c664-4505-a0b3-65efd0ca7353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:37.658894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056b686-c664-4505-a0b3-65efd0ca7353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:37.661414 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056b686-c664-4505-a0b3-65efd0ca7353 admin admin] PATH_INFO: `/v3/users/f6244e2ccdf84a08afb353d616c09382` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:37.668801 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056b686-c664-4505-a0b3-65efd0ca7353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6244e2ccdf84a08afb353d616c09382)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:37.690197 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056b686-c664-4505-a0b3-65efd0ca7353 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:37.882953 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798ff4-a622-44bf-ad4e-7ce0c81e1716 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:37.883247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798ff4-a622-44bf-ad4e-7ce0c81e1716 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:37.883519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd798ff4-a622-44bf-ad4e-7ce0c81e1716 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:37.885202 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 875/1769] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 20 22:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:47:37.957315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397bd97-dd70-41f8-866b-a0bc8f4f52b9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:37.958378 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397bd97-dd70-41f8-866b-a0bc8f4f52b9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:37.958819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397bd97-dd70-41f8-866b-a0bc8f4f52b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:37.997991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-9397bd97-dd70-41f8-866b-a0bc8f4f52b9 None None] MFA Rules not processed for user `67c92c8d2b9d41e489e4c03ae4e71fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:37.999387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9397bd97-dd70-41f8-866b-a0bc8f4f52b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:38.155557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1056b686-c664-4505-a0b3-65efd0ca7353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6244e2ccdf84a08afb353d616c09382'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:38.222437 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 876/1770] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 20 22:47:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:38.306883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1056b686-c664-4505-a0b3-65efd0ca7353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6244e2ccdf84a08afb353d616c09382'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:38.307891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1056b686-c664-4505-a0b3-65efd0ca7353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6244e2ccdf84a08afb353d616c09382'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:38.319804 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1056b686-c664-4505-a0b3-65efd0ca7353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6244e2ccdf84a08afb353d616c09382'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:38.320832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1056b686-c664-4505-a0b3-65efd0ca7353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6244e2ccdf84a08afb353d616c09382'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:38.354635 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 895/1771] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:37 2022] DELETE /identity/v3/users/f6244e2ccdf84a08afb353d616c09382 => generated 0 bytes in 951 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:38.440612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397bd97-dd70-41f8-866b-a0bc8f4f52b9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:38.442366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9397bd97-dd70-41f8-866b-a0bc8f4f52b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:38.466640 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397bd97-dd70-41f8-866b-a0bc8f4f52b9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:38.635520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c227f-651d-4bd9-ab58-93e6e892195b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:38.643157 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c227f-651d-4bd9-ab58-93e6e892195b service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:38.643157 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c227f-651d-4bd9-ab58-93e6e892195b service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:38.643157 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c227f-651d-4bd9-ab58-93e6e892195b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:38.643157 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-958c227f-651d-4bd9-ab58-93e6e892195b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:38.660723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c227f-651d-4bd9-ab58-93e6e892195b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:38.662665 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c227f-651d-4bd9-ab58-93e6e892195b service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:38.696760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 877/1772] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:39.136900 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:39.287589 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056b686-c664-4505-a0b3-65efd0ca7353 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:39.291090 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1056b686-c664-4505-a0b3-65efd0ca7353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:39.336480 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:39.366982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699580-e156-47a9-a7a8-46ff8567045f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:39.370374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699580-e156-47a9-a7a8-46ff8567045f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:39.374312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d699580-e156-47a9-a7a8-46ff8567045f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:39.436901 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056b686-c664-4505-a0b3-65efd0ca7353 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:39.453708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1c137-5e15-4cd2-a16c-b6739e654232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:39.454299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-5d699580-e156-47a9-a7a8-46ff8567045f None None] MFA Rules not processed for user `cdcabffb61684252a23f495015d76377`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:39.455985 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1c137-5e15-4cd2-a16c-b6739e654232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:39.456428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1c137-5e15-4cd2-a16c-b6739e654232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:39.457008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1c137-5e15-4cd2-a16c-b6739e654232 admin admin] PATH_INFO: `/v3/users/8bf62ed58d17497cac52eae9fe457c2c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:39.458476 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1c137-5e15-4cd2-a16c-b6739e654232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bf62ed58d17497cac52eae9fe457c2c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:39.459981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5d699580-e156-47a9-a7a8-46ff8567045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:39.461343 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1c137-5e15-4cd2-a16c-b6739e654232 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:39.602011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 878/1773] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:39 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:39.685356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d699580-e156-47a9-a7a8-46ff8567045f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:39.686962 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5d699580-e156-47a9-a7a8-46ff8567045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:39.703543 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d699580-e156-47a9-a7a8-46ff8567045f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:39.709529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbbb760-e652-4322-835a-4555bff494fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:39.711118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbb760-e652-4322-835a-4555bff494fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:39.711118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbb760-e652-4322-835a-4555bff494fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:39.711118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbbb760-e652-4322-835a-4555bff494fa admin admin] PATH_INFO: `/v3/projects/b55530205c954f49b76397230c5303be` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:39.712287 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbbb760-e652-4322-835a-4555bff494fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b55530205c954f49b76397230c5303be)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:39.714274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbbb760-e652-4322-835a-4555bff494fa admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:39.754728 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b8b1c137-5e15-4cd2-a16c-b6739e654232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bf62ed58d17497cac52eae9fe457c2c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:39.874603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b8b1c137-5e15-4cd2-a16c-b6739e654232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bf62ed58d17497cac52eae9fe457c2c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:39.875309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b8b1c137-5e15-4cd2-a16c-b6739e654232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bf62ed58d17497cac52eae9fe457c2c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:39.880984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dbbbb760-e652-4322-835a-4555bff494fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55530205c954f49b76397230c5303be', 'request_id': 'req-dbbbb760-e652-4322-835a-4555bff494fa'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:39.886558 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b8b1c137-5e15-4cd2-a16c-b6739e654232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bf62ed58d17497cac52eae9fe457c2c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:39.887325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b8b1c137-5e15-4cd2-a16c-b6739e654232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bf62ed58d17497cac52eae9fe457c2c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:39.930757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 896/1774] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:39 2022] DELETE /identity/v3/users/8bf62ed58d17497cac52eae9fe457c2c => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:39.937696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9181-70f6-4a8b-9379-3de8106e0d83 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:39.938876 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9181-70f6-4a8b-9379-3de8106e0d83 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:39.939773 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b9181-70f6-4a8b-9379-3de8106e0d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:40.027654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dbbbb760-e652-4322-835a-4555bff494fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55530205c954f49b76397230c5303be', 'request_id': 'req-dbbbb760-e652-4322-835a-4555bff494fa'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:40.036167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dbbbb760-e652-4322-835a-4555bff494fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55530205c954f49b76397230c5303be', 'request_id': 'req-dbbbb760-e652-4322-835a-4555bff494fa'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:40.038208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7f2b9181-70f6-4a8b-9379-3de8106e0d83 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:40.058099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7f2b9181-70f6-4a8b-9379-3de8106e0d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:40.083721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dbbbb760-e652-4322-835a-4555bff494fa admin admin] The token cache is being invalidate because project b55530205c954f49b76397230c5303be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:40.084057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dbbbb760-e652-4322-835a-4555bff494fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:40.084749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dbbbb760-e652-4322-835a-4555bff494fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:40.086951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 879/1775] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:39 2022] DELETE /identity/v3/projects/b55530205c954f49b76397230c5303be => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:47:40.099097 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a94262-7ddf-40f8-b427-66c28912f59c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:40.099935 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a94262-7ddf-40f8-b427-66c28912f59c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:40.105974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a94262-7ddf-40f8-b427-66c28912f59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:40.130358 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-68a94262-7ddf-40f8-b427-66c28912f59c None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:40.131855 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-68a94262-7ddf-40f8-b427-66c28912f59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:40.270597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 897/1776] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:40.271629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b9181-70f6-4a8b-9379-3de8106e0d83 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:40.273538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7f2b9181-70f6-4a8b-9379-3de8106e0d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:40.277904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 880/1777] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:40.281575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1a2ab-9e52-469f-89e3-96c90f6de1c1 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:40.284179 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1a2ab-9e52-469f-89e3-96c90f6de1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:40.284743 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1a2ab-9e52-469f-89e3-96c90f6de1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:40.295260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:40.308647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b9181-70f6-4a8b-9379-3de8106e0d83 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:40.315494 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e76fe1-a215-48cb-9f22-a34eb0b0e72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:40.316500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e76fe1-a215-48cb-9f22-a34eb0b0e72b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:40.316863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e76fe1-a215-48cb-9f22-a34eb0b0e72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:40.317235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e76fe1-a215-48cb-9f22-a34eb0b0e72b admin admin] PATH_INFO: `/v3/users/c5787a51849e4890b33cc8bd11aca203` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:40.318760 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e76fe1-a215-48cb-9f22-a34eb0b0e72b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5787a51849e4890b33cc8bd11aca203)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:40.320760 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e76fe1-a215-48cb-9f22-a34eb0b0e72b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:40.368831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-41c1a2ab-9e52-469f-89e3-96c90f6de1c1 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:40.368831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-41c1a2ab-9e52-469f-89e3-96c90f6de1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:40.387317 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 881/1778] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:40.389114 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1a2ab-9e52-469f-89e3-96c90f6de1c1 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:40.391122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-41c1a2ab-9e52-469f-89e3-96c90f6de1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:40.496316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c1a2ab-9e52-469f-89e3-96c90f6de1c1 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:40.509814 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a17d4-43d5-43a6-a81d-27b6299de152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:40.511212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a17d4-43d5-43a6-a81d-27b6299de152 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:40.511569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a17d4-43d5-43a6-a81d-27b6299de152 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:40.511961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842a17d4-43d5-43a6-a81d-27b6299de152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:40.540637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a17d4-43d5-43a6-a81d-27b6299de152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:40.544182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842a17d4-43d5-43a6-a81d-27b6299de152 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:40.572364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 882/1779] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:40.575385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a17d4-43d5-43a6-a81d-27b6299de152 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:40.586233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:40.603957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842a17d4-43d5-43a6-a81d-27b6299de152 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:40.612272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd67e-1908-4454-9799-f58381e9cab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:40.613215 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd67e-1908-4454-9799-f58381e9cab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:40.613577 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd67e-1908-4454-9799-f58381e9cab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:40.613987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9bd67e-1908-4454-9799-f58381e9cab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:40.615629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bd67e-1908-4454-9799-f58381e9cab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:40.615984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bd67e-1908-4454-9799-f58381e9cab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:40.620076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9bd67e-1908-4454-9799-f58381e9cab6 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:40.646901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 883/1780] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:40.651197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd67e-1908-4454-9799-f58381e9cab6 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:40.679963 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9bd67e-1908-4454-9799-f58381e9cab6 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:40.692330 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a0e76fe1-a215-48cb-9f22-a34eb0b0e72b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5787a51849e4890b33cc8bd11aca203'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:40.694546 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e168259-bd86-4c85-9219-c3d09e971049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:40.695253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e168259-bd86-4c85-9219-c3d09e971049 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:40.695737 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e168259-bd86-4c85-9219-c3d09e971049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:40.696027 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e168259-bd86-4c85-9219-c3d09e971049 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:40.698004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e168259-bd86-4c85-9219-c3d09e971049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:40.700136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e168259-bd86-4c85-9219-c3d09e971049 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:40.851099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a0e76fe1-a215-48cb-9f22-a34eb0b0e72b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5787a51849e4890b33cc8bd11aca203'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:40.853052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a0e76fe1-a215-48cb-9f22-a34eb0b0e72b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5787a51849e4890b33cc8bd11aca203'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:40.864770 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 884/1781] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:40 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:40.866469 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e168259-bd86-4c85-9219-c3d09e971049 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:40.868782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a0e76fe1-a215-48cb-9f22-a34eb0b0e72b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5787a51849e4890b33cc8bd11aca203'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:40.870723 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a0e76fe1-a215-48cb-9f22-a34eb0b0e72b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5787a51849e4890b33cc8bd11aca203'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:40.955049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 898/1782] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:40 2022] DELETE /identity/v3/users/c5787a51849e4890b33cc8bd11aca203 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:40.955049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ffafc-fa3e-4783-a80a-c44722a75815 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:40.955049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ffafc-fa3e-4783-a80a-c44722a75815 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:40.955049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ffafc-fa3e-4783-a80a-c44722a75815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:40.982563 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-308ffafc-fa3e-4783-a80a-c44722a75815 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:40.985190 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-308ffafc-fa3e-4783-a80a-c44722a75815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:41.070445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e168259-bd86-4c85-9219-c3d09e971049 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:41.184318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 899/1783] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:41.235353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:41.247580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ffafc-fa3e-4783-a80a-c44722a75815 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:41.249014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-308ffafc-fa3e-4783-a80a-c44722a75815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:41.258421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57801e3c-91b1-4bfa-9212-6548666772d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:41.262141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57801e3c-91b1-4bfa-9212-6548666772d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:41.262141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57801e3c-91b1-4bfa-9212-6548666772d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:41.262141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57801e3c-91b1-4bfa-9212-6548666772d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:41.262141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57801e3c-91b1-4bfa-9212-6548666772d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:41.263832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57801e3c-91b1-4bfa-9212-6548666772d2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:41.384059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ffafc-fa3e-4783-a80a-c44722a75815 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:41.389882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eeb336-e92b-4225-b75f-1efd25a1eff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:41.391597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeb336-e92b-4225-b75f-1efd25a1eff2 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:41.392032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeb336-e92b-4225-b75f-1efd25a1eff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:41.393264 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eeb336-e92b-4225-b75f-1efd25a1eff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:41.407018 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eeb336-e92b-4225-b75f-1efd25a1eff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:41.412571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 885/1784] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:40 2022] POST /identity/v3/users => generated 289 bytes in 547 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:41.414080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eeb336-e92b-4225-b75f-1efd25a1eff2 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:41.416791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57801e3c-91b1-4bfa-9212-6548666772d2 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:41.420214 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-57801e3c-91b1-4bfa-9212-6548666772d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:41.433267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 900/1785] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:47:41.441067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57801e3c-91b1-4bfa-9212-6548666772d2 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:41.452570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b236f-56fa-4134-8f32-58286d326c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:41.453371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b236f-56fa-4134-8f32-58286d326c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:41.453916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b236f-56fa-4134-8f32-58286d326c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:41.454509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b236f-56fa-4134-8f32-58286d326c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:41.456424 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b236f-56fa-4134-8f32-58286d326c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:41.459157 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b236f-56fa-4134-8f32-58286d326c15 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:41.485105 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 886/1786] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:41.490820 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eeb336-e92b-4225-b75f-1efd25a1eff2 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:41.533254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eeb336-e92b-4225-b75f-1efd25a1eff2 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:41.540268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8ff6c-6ca9-4c52-9de1-25293febe529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:41.542646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8ff6c-6ca9-4c52-9de1-25293febe529 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:41.544221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8ff6c-6ca9-4c52-9de1-25293febe529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:41.544221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8ff6c-6ca9-4c52-9de1-25293febe529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:41.545680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8ff6c-6ca9-4c52-9de1-25293febe529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:41.548722 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8ff6c-6ca9-4c52-9de1-25293febe529 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:41.549239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:41.569577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 901/1787] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:41.575248 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b236f-56fa-4134-8f32-58286d326c15 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:41.619143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b236f-56fa-4134-8f32-58286d326c15 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:41.626608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03186fd-f6fa-4c57-96bb-8a43ada2fb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:41.628592 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03186fd-f6fa-4c57-96bb-8a43ada2fb30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:41.629216 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03186fd-f6fa-4c57-96bb-8a43ada2fb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:41.630042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03186fd-f6fa-4c57-96bb-8a43ada2fb30 admin admin] PATH_INFO: `/v3/projects/21d33326e5fd4e9680b8f970858a0e91/users/6319d6181e174f01808bc5fd90a90307/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:41.657872 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03186fd-f6fa-4c57-96bb-8a43ada2fb30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d33326e5fd4e9680b8f970858a0e91, user_id=6319d6181e174f01808bc5fd90a90307, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:41.661977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03186fd-f6fa-4c57-96bb-8a43ada2fb30 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:41.737140 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 887/1788] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:41 2022] PUT /identity/v3/projects/21d33326e5fd4e9680b8f970858a0e91/users/6319d6181e174f01808bc5fd90a90307/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:41.750994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603b3bf-cc7f-4e8d-8035-7e0c44ec78f8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:41.752005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603b3bf-cc7f-4e8d-8035-7e0c44ec78f8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:41.752729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e603b3bf-cc7f-4e8d-8035-7e0c44ec78f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:41.815962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e603b3bf-cc7f-4e8d-8035-7e0c44ec78f8 None None] MFA Rules not processed for user `6319d6181e174f01808bc5fd90a90307`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:41.818664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e603b3bf-cc7f-4e8d-8035-7e0c44ec78f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:41.939580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 902/1789] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:41.944065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03186fd-f6fa-4c57-96bb-8a43ada2fb30 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:42.064196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03186fd-f6fa-4c57-96bb-8a43ada2fb30 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:42.107981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcbb8b-e752-4145-81fa-629d8c372aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:42.107981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcbb8b-e752-4145-81fa-629d8c372aca admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:42.107981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcbb8b-e752-4145-81fa-629d8c372aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:42.107981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcbb8b-e752-4145-81fa-629d8c372aca admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:42.108391 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcbb8b-e752-4145-81fa-629d8c372aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:42.108888 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcbb8b-e752-4145-81fa-629d8c372aca admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:42.231116 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 888/1790] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:41 2022] POST /identity/v3/projects => generated 377 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:47:42.235361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603b3bf-cc7f-4e8d-8035-7e0c44ec78f8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:42.247866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e603b3bf-cc7f-4e8d-8035-7e0c44ec78f8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:42.380453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c914b-9d7c-465a-a15a-1597d349aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:42.382594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c914b-9d7c-465a-a15a-1597d349aa1e admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:42.383041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c914b-9d7c-465a-a15a-1597d349aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:42.383487 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971c914b-9d7c-465a-a15a-1597d349aa1e admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:42.385523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c914b-9d7c-465a-a15a-1597d349aa1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:42.388333 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971c914b-9d7c-465a-a15a-1597d349aa1e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:42.442167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e60c0-69ea-4e6a-8cad-87348b4d9a91 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:42.442755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e60c0-69ea-4e6a-8cad-87348b4d9a91 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:42.442866 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e60c0-69ea-4e6a-8cad-87348b4d9a91 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:42.447603 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 889/1791] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 20 22:47:42 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:47:42.503649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e75f3-cad5-45fc-9204-dc5ecd62c7d2 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:42.503791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e75f3-cad5-45fc-9204-dc5ecd62c7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:42.504243 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e75f3-cad5-45fc-9204-dc5ecd62c7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:42.527697 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 903/1792] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:42 2022] POST /identity/v3/users => generated 295 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:42.532000 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c914b-9d7c-465a-a15a-1597d349aa1e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:42.568751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d02e75f3-cad5-45fc-9204-dc5ecd62c7d2 None None] MFA Rules not processed for user `65c9898ccf874dce88f08bebdbae02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:42.572611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971c914b-9d7c-465a-a15a-1597d349aa1e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:42.574516 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d02e75f3-cad5-45fc-9204-dc5ecd62c7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:42.589616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab10864-813c-4b79-ab9d-03e4855f7e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:42.592172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab10864-813c-4b79-ab9d-03e4855f7e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:42.592725 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab10864-813c-4b79-ab9d-03e4855f7e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:42.596340 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab10864-813c-4b79-ab9d-03e4855f7e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:42.600385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab10864-813c-4b79-ab9d-03e4855f7e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:42.604914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab10864-813c-4b79-ab9d-03e4855f7e02 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:42.633568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 904/1793] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:42.637780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab10864-813c-4b79-ab9d-03e4855f7e02 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:42.660594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab10864-813c-4b79-ab9d-03e4855f7e02 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:42.678703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac1148-6b9a-47b4-849b-418084a31f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:42.681283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac1148-6b9a-47b4-849b-418084a31f8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:42.689864 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:42.689864 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac1148-6b9a-47b4-849b-418084a31f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:42.689864 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac1148-6b9a-47b4-849b-418084a31f8a admin admin] PATH_INFO: `/v3/projects/7981bce36b8b43f2a4dc18ac530165b2/users/3cba37fca5ec4f56a10da1428d0bbbff/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:42.771781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac1148-6b9a-47b4-849b-418084a31f8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7981bce36b8b43f2a4dc18ac530165b2, user_id=3cba37fca5ec4f56a10da1428d0bbbff, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:42.775701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac1148-6b9a-47b4-849b-418084a31f8a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:42.786004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 890/1794] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 20 22:47:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:42.787537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01c4c4-e31a-4769-a5bb-0cdc6b7595e8 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:42.787833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01c4c4-e31a-4769-a5bb-0cdc6b7595e8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:42.788165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a01c4c4-e31a-4769-a5bb-0cdc6b7595e8 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:42.792039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 891/1795] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 20 22:47:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:47:42.822388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01c4c4-e31a-4769-a5bb-0cdc6b7595e8 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:42.824135 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9a01c4c4-e31a-4769-a5bb-0cdc6b7595e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:42.860405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a01c4c4-e31a-4769-a5bb-0cdc6b7595e8 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:42.875875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b647ccc-fe1b-46f2-bb12-8833ff157d35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c9898ccf874dce88f08bebdbae02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:42.878281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b647ccc-fe1b-46f2-bb12-8833ff157d35 service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:42.878614 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b647ccc-fe1b-46f2-bb12-8833ff157d35 service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:42.878895 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b647ccc-fe1b-46f2-bb12-8833ff157d35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:42.902466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 905/1796] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:42 2022] PUT /identity/v3/projects/7981bce36b8b43f2a4dc18ac530165b2/users/3cba37fca5ec4f56a10da1428d0bbbff/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:47:42.906310 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac1148-6b9a-47b4-849b-418084a31f8a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:42.908510 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b647ccc-fe1b-46f2-bb12-8833ff157d35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:42.913152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b647ccc-fe1b-46f2-bb12-8833ff157d35 service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:42.961299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 892/1797] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:47:43.102272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3678d-0329-4b0b-9aa4-c42596a21c9e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:43.103265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3678d-0329-4b0b-9aa4-c42596a21c9e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:43.103547 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3678d-0329-4b0b-9aa4-c42596a21c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:43.130190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c9d3678d-0329-4b0b-9aa4-c42596a21c9e None None] MFA Rules not processed for user `67c92c8d2b9d41e489e4c03ae4e71fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:43.131810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c9d3678d-0329-4b0b-9aa4-c42596a21c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:43.147533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac1148-6b9a-47b4-849b-418084a31f8a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:43.162534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49516ee-d4d8-45e0-9230-a3ad9d37cbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:43.164048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49516ee-d4d8-45e0-9230-a3ad9d37cbbe admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:43.164549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49516ee-d4d8-45e0-9230-a3ad9d37cbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:43.165139 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49516ee-d4d8-45e0-9230-a3ad9d37cbbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:43.166367 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49516ee-d4d8-45e0-9230-a3ad9d37cbbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:43.175651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49516ee-d4d8-45e0-9230-a3ad9d37cbbe admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:43.221054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 906/1798] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:43.224459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49516ee-d4d8-45e0-9230-a3ad9d37cbbe admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:43.250282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49516ee-d4d8-45e0-9230-a3ad9d37cbbe admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:43.258679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe2fff-0e6f-4660-ad39-636a79b044af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:43.260152 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe2fff-0e6f-4660-ad39-636a79b044af admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:43.260653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe2fff-0e6f-4660-ad39-636a79b044af admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:43.261145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe2fff-0e6f-4660-ad39-636a79b044af admin admin] PATH_INFO: `/v3/projects/7981bce36b8b43f2a4dc18ac530165b2/users/3cba37fca5ec4f56a10da1428d0bbbff/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:43.263744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 893/1799] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 20 22:47:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:43.264370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe2fff-0e6f-4660-ad39-636a79b044af admin admin] RBAC: Authorizing `identity:create_grant(project_id=7981bce36b8b43f2a4dc18ac530165b2, user_id=3cba37fca5ec4f56a10da1428d0bbbff, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:43.268646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe2fff-0e6f-4660-ad39-636a79b044af admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:43.317388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbdeb4-c189-4749-a881-2e8a2187e639 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:43.317582 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbdeb4-c189-4749-a881-2e8a2187e639 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:43.317892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbdeb4-c189-4749-a881-2e8a2187e639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:43.319232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 907/1800] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:43 2022] PUT /identity/v3/projects/7981bce36b8b43f2a4dc18ac530165b2/users/3cba37fca5ec4f56a10da1428d0bbbff/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:43.389399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-54fbdeb4-c189-4749-a881-2e8a2187e639 None None] MFA Rules not processed for user `3cba37fca5ec4f56a10da1428d0bbbff`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:43.390663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-54fbdeb4-c189-4749-a881-2e8a2187e639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:43.498727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 894/1801] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:43.507847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe2fff-0e6f-4660-ad39-636a79b044af admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:43.510867 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e5fe2fff-0e6f-4660-ad39-636a79b044af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:43.547806 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:43.582858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbdeb4-c189-4749-a881-2e8a2187e639 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:43.584851 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-54fbdeb4-c189-4749-a881-2e8a2187e639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:43.682854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbdeb4-c189-4749-a881-2e8a2187e639 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:43.690118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324890c-b91d-4a01-8ce6-011782089104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:43.691670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe2fff-0e6f-4660-ad39-636a79b044af admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:43.691858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324890c-b91d-4a01-8ce6-011782089104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:43.692364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324890c-b91d-4a01-8ce6-011782089104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:43.692965 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324890c-b91d-4a01-8ce6-011782089104 admin admin] PATH_INFO: `/v3/projects/76198e5f546c410bb6587855ffec4de7` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:43.694452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324890c-b91d-4a01-8ce6-011782089104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76198e5f546c410bb6587855ffec4de7)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:43.697698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324890c-b91d-4a01-8ce6-011782089104 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:43.703084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bf8d0-f275-476d-9952-4883ab9c41ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:43.704715 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bf8d0-f275-476d-9952-4883ab9c41ef service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:43.705817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bf8d0-f275-476d-9952-4883ab9c41ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:43.706246 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bf8d0-f275-476d-9952-4883ab9c41ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:43.815983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bf8d0-f275-476d-9952-4883ab9c41ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:43.817792 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bf8d0-f275-476d-9952-4883ab9c41ef service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:43.832345 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 908/1802] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:47:43.834986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bf8d0-f275-476d-9952-4883ab9c41ef service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:43.846477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5324890c-b91d-4a01-8ce6-011782089104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76198e5f546c410bb6587855ffec4de7', 'request_id': 'req-5324890c-b91d-4a01-8ce6-011782089104'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:43.854849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e63bf8d0-f275-476d-9952-4883ab9c41ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:43.992091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5324890c-b91d-4a01-8ce6-011782089104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76198e5f546c410bb6587855ffec4de7', 'request_id': 'req-5324890c-b91d-4a01-8ce6-011782089104'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:43.999055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5324890c-b91d-4a01-8ce6-011782089104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76198e5f546c410bb6587855ffec4de7', 'request_id': 'req-5324890c-b91d-4a01-8ce6-011782089104'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:44.051459 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5324890c-b91d-4a01-8ce6-011782089104 admin admin] The token cache is being invalidate because project 76198e5f546c410bb6587855ffec4de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:44.052353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5324890c-b91d-4a01-8ce6-011782089104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:44.053991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5324890c-b91d-4a01-8ce6-011782089104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:44.057892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 895/1803] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:43 2022] DELETE /identity/v3/projects/76198e5f546c410bb6587855ffec4de7 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:44.063106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bf8d0-f275-476d-9952-4883ab9c41ef service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:44.079096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7292190-24fa-4e6f-9627-3f0b4873a7a8 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:44.079431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7292190-24fa-4e6f-9627-3f0b4873a7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:44.079668 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7292190-24fa-4e6f-9627-3f0b4873a7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:44.148441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f7292190-24fa-4e6f-9627-3f0b4873a7a8 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:44.149689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f7292190-24fa-4e6f-9627-3f0b4873a7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:44.295279 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6880dd-006b-44dc-8f75-4391640e4735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:44.296248 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6880dd-006b-44dc-8f75-4391640e4735 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:44.296848 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6880dd-006b-44dc-8f75-4391640e4735 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:44.297290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6880dd-006b-44dc-8f75-4391640e4735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:44.301135 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3e6880dd-006b-44dc-8f75-4391640e4735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:44.301634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:44.345986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 896/1804] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:44.353305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d66e-3dbf-40ab-81f4-811aacc0d3e4 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:44.353865 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d66e-3dbf-40ab-81f4-811aacc0d3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:44.354901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3d66e-3dbf-40ab-81f4-811aacc0d3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:44.390731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-29e3d66e-3dbf-40ab-81f4-811aacc0d3e4 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:44.393348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-29e3d66e-3dbf-40ab-81f4-811aacc0d3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:44.399894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6880dd-006b-44dc-8f75-4391640e4735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:44.403910 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6880dd-006b-44dc-8f75-4391640e4735 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:44.426632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 897/1805] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:44.431892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3d66e-3dbf-40ab-81f4-811aacc0d3e4 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:44.440459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:44.445775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 909/1806] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:44.448230 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3d66e-3dbf-40ab-81f4-811aacc0d3e4 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:44.454645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739c268-787a-41eb-9440-0b34d7f4ab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:44.456051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739c268-787a-41eb-9440-0b34d7f4ab02 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:44.456630 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739c268-787a-41eb-9440-0b34d7f4ab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:44.457056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739c268-787a-41eb-9440-0b34d7f4ab02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:44.458686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739c268-787a-41eb-9440-0b34d7f4ab02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:44.459155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739c268-787a-41eb-9440-0b34d7f4ab02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:44.461237 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739c268-787a-41eb-9440-0b34d7f4ab02 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:44.474521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6880dd-006b-44dc-8f75-4391640e4735 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:44.476747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3e6880dd-006b-44dc-8f75-4391640e4735 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:44.483021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 898/1807] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:47:44.486032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739c268-787a-41eb-9440-0b34d7f4ab02 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:44.499205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739c268-787a-41eb-9440-0b34d7f4ab02 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:44.505671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b1d96-13ce-4663-a1eb-62ef4e9461c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:44.506709 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1d96-13ce-4663-a1eb-62ef4e9461c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:44.507065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1d96-13ce-4663-a1eb-62ef4e9461c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:44.507419 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b1d96-13ce-4663-a1eb-62ef4e9461c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:44.508203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b1d96-13ce-4663-a1eb-62ef4e9461c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:44.510496 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b1d96-13ce-4663-a1eb-62ef4e9461c6 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:44.532083 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6880dd-006b-44dc-8f75-4391640e4735 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:44.622226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:44.624570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 899/1808] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:44 2022] POST /identity/v3/projects => generated 361 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:44.626208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:44.628209 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b1d96-13ce-4663-a1eb-62ef4e9461c6 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:44.628667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:44.629379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] PATH_INFO: `/v3/projects/90d17b2bd16e41569ed117e905f7e90d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:44.640305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90d17b2bd16e41569ed117e905f7e90d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:44.654733 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:44.848266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b1d96-13ce-4663-a1eb-62ef4e9461c6 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:44.866368 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e9443-7336-4252-abdd-3ea5bca6a692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:44.867259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e9443-7336-4252-abdd-3ea5bca6a692 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:44.867673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e9443-7336-4252-abdd-3ea5bca6a692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:44.868085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e9443-7336-4252-abdd-3ea5bca6a692 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:44.868983 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e9443-7336-4252-abdd-3ea5bca6a692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:44.871236 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e9443-7336-4252-abdd-3ea5bca6a692 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:44.945907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90d17b2bd16e41569ed117e905f7e90d', 'request_id': 'req-1f909141-0949-4aa9-a26b-97e219b7eb46'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:45.038604 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90d17b2bd16e41569ed117e905f7e90d', 'request_id': 'req-1f909141-0949-4aa9-a26b-97e219b7eb46'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:45.045451 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90d17b2bd16e41569ed117e905f7e90d', 'request_id': 'req-1f909141-0949-4aa9-a26b-97e219b7eb46'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:45.046802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 900/1809] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:44 2022] POST /identity/v3/users => generated 281 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:45.051024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e9443-7336-4252-abdd-3ea5bca6a692 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:45.068269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e9443-7336-4252-abdd-3ea5bca6a692 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:45.102724 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] The token cache is being invalidate because project 90d17b2bd16e41569ed117e905f7e90d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:45.102878 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:45.103669 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:45.108441 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 910/1810] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:44 2022] DELETE /identity/v3/projects/90d17b2bd16e41569ed117e905f7e90d => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:45.109381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:45.110833 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:45.212681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140566a-74d8-4ad4-8b25-88d523b17ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:45.226169 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140566a-74d8-4ad4-8b25-88d523b17ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:45.226654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140566a-74d8-4ad4-8b25-88d523b17ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:45.226908 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140566a-74d8-4ad4-8b25-88d523b17ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:45.227780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140566a-74d8-4ad4-8b25-88d523b17ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:45.228686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f909141-0949-4aa9-a26b-97e219b7eb46 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:45.230603 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140566a-74d8-4ad4-8b25-88d523b17ea0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:45.237633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab84185-e7c8-44e9-91c4-942e340619c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:45.239134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab84185-e7c8-44e9-91c4-942e340619c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:45.243141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab84185-e7c8-44e9-91c4-942e340619c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:45.243141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab84185-e7c8-44e9-91c4-942e340619c1 admin admin] PATH_INFO: `/v3/users/7a172ab350d64598ad31dcd25d9db9ec` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:45.243141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab84185-e7c8-44e9-91c4-942e340619c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a172ab350d64598ad31dcd25d9db9ec)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:45.244284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab84185-e7c8-44e9-91c4-942e340619c1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:45.267064 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 901/1811] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:47:45.269178 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140566a-74d8-4ad4-8b25-88d523b17ea0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:45.271199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a140566a-74d8-4ad4-8b25-88d523b17ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:45.290922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140566a-74d8-4ad4-8b25-88d523b17ea0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:45.316781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f5229-e7a9-4935-bba8-5cee2aff1ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:45.318282 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f5229-e7a9-4935-bba8-5cee2aff1ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:45.318744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f5229-e7a9-4935-bba8-5cee2aff1ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:45.319116 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f5229-e7a9-4935-bba8-5cee2aff1ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:45.320129 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f5229-e7a9-4935-bba8-5cee2aff1ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:45.322069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f5229-e7a9-4935-bba8-5cee2aff1ed4 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:45.345314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 902/1812] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:47:45.353630 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f5229-e7a9-4935-bba8-5cee2aff1ed4 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:45.387341 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f5229-e7a9-4935-bba8-5cee2aff1ed4 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:45.434059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e79f6b-9f1e-4eae-a6b1-9cdd114dbfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:45.434059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e79f6b-9f1e-4eae-a6b1-9cdd114dbfed admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:45.434059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e79f6b-9f1e-4eae-a6b1-9cdd114dbfed admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:45.434059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e79f6b-9f1e-4eae-a6b1-9cdd114dbfed admin admin] PATH_INFO: `/v3/projects/6a429abe0e1f48ebbca8f3ae730fe0ac/users/fd64617236194063a086885f7addd566/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:45.470117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e79f6b-9f1e-4eae-a6b1-9cdd114dbfed admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a429abe0e1f48ebbca8f3ae730fe0ac, user_id=fd64617236194063a086885f7addd566, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:45.481405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e79f6b-9f1e-4eae-a6b1-9cdd114dbfed admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:45.509694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bab84185-e7c8-44e9-91c4-942e340619c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a172ab350d64598ad31dcd25d9db9ec'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:45.557892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 903/1813] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:45 2022] PUT /identity/v3/projects/6a429abe0e1f48ebbca8f3ae730fe0ac/users/fd64617236194063a086885f7addd566/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:45.569633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128f43-4a24-4aed-a7ff-97282573efb9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:45.569973 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128f43-4a24-4aed-a7ff-97282573efb9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:45.570258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d128f43-4a24-4aed-a7ff-97282573efb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:45.607360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bab84185-e7c8-44e9-91c4-942e340619c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a172ab350d64598ad31dcd25d9db9ec'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:45.608931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bab84185-e7c8-44e9-91c4-942e340619c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a172ab350d64598ad31dcd25d9db9ec'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:45.638118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bab84185-e7c8-44e9-91c4-942e340619c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a172ab350d64598ad31dcd25d9db9ec'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:45.641004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-bab84185-e7c8-44e9-91c4-942e340619c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a172ab350d64598ad31dcd25d9db9ec'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:45.654911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7d128f43-4a24-4aed-a7ff-97282573efb9 None None] MFA Rules not processed for user `fd64617236194063a086885f7addd566`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:45.656208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7d128f43-4a24-4aed-a7ff-97282573efb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:45.690638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 911/1814] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:45 2022] DELETE /identity/v3/users/7a172ab350d64598ad31dcd25d9db9ec => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:45.693996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab84185-e7c8-44e9-91c4-942e340619c1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:45.698836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bab84185-e7c8-44e9-91c4-942e340619c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:45.813029 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 904/1815] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:45.853996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab84185-e7c8-44e9-91c4-942e340619c1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:45.855503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d128f43-4a24-4aed-a7ff-97282573efb9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:45.857066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7d128f43-4a24-4aed-a7ff-97282573efb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:45.865042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a2e67-02a3-464f-9c0f-1b7ed4caf47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:45.866448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a2e67-02a3-464f-9c0f-1b7ed4caf47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:45.867789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a2e67-02a3-464f-9c0f-1b7ed4caf47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:45.868189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a2e67-02a3-464f-9c0f-1b7ed4caf47a admin admin] PATH_INFO: `/v3/users/fc9f78d88d4b47609b6c6672723505e0` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:45.871307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a2e67-02a3-464f-9c0f-1b7ed4caf47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc9f78d88d4b47609b6c6672723505e0)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:45.878527 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422a2e67-02a3-464f-9c0f-1b7ed4caf47a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:45.984093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d128f43-4a24-4aed-a7ff-97282573efb9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:46.048211 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912542f-1140-43b9-bb7b-31fd6800354b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:46.049409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912542f-1140-43b9-bb7b-31fd6800354b service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:46.049409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912542f-1140-43b9-bb7b-31fd6800354b service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:46.050091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912542f-1140-43b9-bb7b-31fd6800354b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:46.110659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-422a2e67-02a3-464f-9c0f-1b7ed4caf47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc9f78d88d4b47609b6c6672723505e0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:46.164256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912542f-1140-43b9-bb7b-31fd6800354b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:46.167277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2912542f-1140-43b9-bb7b-31fd6800354b service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:46.179929 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 905/1816] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:46.187935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-422a2e67-02a3-464f-9c0f-1b7ed4caf47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc9f78d88d4b47609b6c6672723505e0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:46.189609 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-422a2e67-02a3-464f-9c0f-1b7ed4caf47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc9f78d88d4b47609b6c6672723505e0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:46.202187 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912542f-1140-43b9-bb7b-31fd6800354b service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:46.209333 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-422a2e67-02a3-464f-9c0f-1b7ed4caf47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc9f78d88d4b47609b6c6672723505e0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:46.210204 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-422a2e67-02a3-464f-9c0f-1b7ed4caf47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc9f78d88d4b47609b6c6672723505e0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:46.211134 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2912542f-1140-43b9-bb7b-31fd6800354b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:46.249895 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912542f-1140-43b9-bb7b-31fd6800354b service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:46.251241 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 912/1817] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:45 2022] DELETE /identity/v3/users/fc9f78d88d4b47609b6c6672723505e0 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:46.382943 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:46.451033 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e0324-dca2-4e74-adc2-61bd69634879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:46.453130 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e0324-dca2-4e74-adc2-61bd69634879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:46.459014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e0324-dca2-4e74-adc2-61bd69634879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:46.459014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e0324-dca2-4e74-adc2-61bd69634879 admin admin] PATH_INFO: `/v3/users/fd64617236194063a086885f7addd566` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:46.459014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e0324-dca2-4e74-adc2-61bd69634879 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd64617236194063a086885f7addd566)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:46.459544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e0324-dca2-4e74-adc2-61bd69634879 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:46.736808 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-185e0324-dca2-4e74-adc2-61bd69634879 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd64617236194063a086885f7addd566'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:46.738158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-185e0324-dca2-4e74-adc2-61bd69634879 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd64617236194063a086885f7addd566'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:46.739333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-185e0324-dca2-4e74-adc2-61bd69634879 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd64617236194063a086885f7addd566'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:46.775676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-185e0324-dca2-4e74-adc2-61bd69634879 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd64617236194063a086885f7addd566'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:46.777633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a2e67-02a3-464f-9c0f-1b7ed4caf47a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:46.779338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-422a2e67-02a3-464f-9c0f-1b7ed4caf47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:46.812935 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-185e0324-dca2-4e74-adc2-61bd69634879 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd64617236194063a086885f7addd566'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:46.817997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a2e67-02a3-464f-9c0f-1b7ed4caf47a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:46.835383 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:46.838441 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:46.838803 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:46.839161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] PATH_INFO: `/v3/projects/bb270650f3ec462f81c1d14838caeec9` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:46.841145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb270650f3ec462f81c1d14838caeec9)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:46.843341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:46.928824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 906/1818] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:46 2022] DELETE /identity/v3/users/fd64617236194063a086885f7addd566 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:46.934345 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301d735-eaec-4676-9762-1b6ca993e826 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:46.934845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301d735-eaec-4676-9762-1b6ca993e826 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:46.936365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301d735-eaec-4676-9762-1b6ca993e826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:46.992438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a301d735-eaec-4676-9762-1b6ca993e826 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:46.997670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a301d735-eaec-4676-9762-1b6ca993e826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:47.107753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb270650f3ec462f81c1d14838caeec9', 'request_id': 'req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.144694 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 907/1819] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:47.148439 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:47.151634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301d735-eaec-4676-9762-1b6ca993e826 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:47.153271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a301d735-eaec-4676-9762-1b6ca993e826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:47.177969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb270650f3ec462f81c1d14838caeec9', 'request_id': 'req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.194834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb270650f3ec462f81c1d14838caeec9', 'request_id': 'req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.212948 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] The token cache is being invalidate because project bb270650f3ec462f81c1d14838caeec9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:47.213537 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.214730 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.221403 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 913/1820] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:46 2022] DELETE /identity/v3/projects/bb270650f3ec462f81c1d14838caeec9 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:47:47.221403 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:47.223370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:47.258786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301d735-eaec-4676-9762-1b6ca993e826 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:47.340016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bad4b96-5cea-4ddb-8c0d-c9621d8fba3e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:47.347186 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be3e31-8289-4300-9485-719d3bbb80b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:47.348473 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be3e31-8289-4300-9485-719d3bbb80b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:47.348975 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be3e31-8289-4300-9485-719d3bbb80b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:47.349445 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be3e31-8289-4300-9485-719d3bbb80b0 admin admin] PATH_INFO: `/v3/projects/7433253cf90e4a33aa955d036254a526` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:47.351837 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be3e31-8289-4300-9485-719d3bbb80b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7433253cf90e4a33aa955d036254a526)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:47.354370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be3e31-8289-4300-9485-719d3bbb80b0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:47.361681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60436752-06c6-4bc8-a664-3870cdb3e759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:47.362865 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60436752-06c6-4bc8-a664-3870cdb3e759 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:47.363254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60436752-06c6-4bc8-a664-3870cdb3e759 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:47.363650 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60436752-06c6-4bc8-a664-3870cdb3e759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:47.366751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-60436752-06c6-4bc8-a664-3870cdb3e759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:47.395522 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60436752-06c6-4bc8-a664-3870cdb3e759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:47.397244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60436752-06c6-4bc8-a664-3870cdb3e759 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:47.419669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 908/1821] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:47:47.421256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60436752-06c6-4bc8-a664-3870cdb3e759 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:47.423064 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-60436752-06c6-4bc8-a664-3870cdb3e759 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:47.446100 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60436752-06c6-4bc8-a664-3870cdb3e759 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:47.452439 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e6c35-de0c-45ac-93f4-f1439bddd01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:47.454288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e6c35-de0c-45ac-93f4-f1439bddd01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:47.457143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e6c35-de0c-45ac-93f4-f1439bddd01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:47.457681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e6c35-de0c-45ac-93f4-f1439bddd01c admin admin] PATH_INFO: `/v3/users/cdcabffb61684252a23f495015d76377` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:47.481677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e6c35-de0c-45ac-93f4-f1439bddd01c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdcabffb61684252a23f495015d76377)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:47.497534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d8be3e31-8289-4300-9485-719d3bbb80b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7433253cf90e4a33aa955d036254a526', 'request_id': 'req-d8be3e31-8289-4300-9485-719d3bbb80b0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.498421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e6c35-de0c-45ac-93f4-f1439bddd01c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:47.582000 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d8be3e31-8289-4300-9485-719d3bbb80b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7433253cf90e4a33aa955d036254a526', 'request_id': 'req-d8be3e31-8289-4300-9485-719d3bbb80b0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.595875 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d8be3e31-8289-4300-9485-719d3bbb80b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7433253cf90e4a33aa955d036254a526', 'request_id': 'req-d8be3e31-8289-4300-9485-719d3bbb80b0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.615642 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d8be3e31-8289-4300-9485-719d3bbb80b0 admin admin] The token cache is being invalidate because project 7433253cf90e4a33aa955d036254a526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:47.616025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d8be3e31-8289-4300-9485-719d3bbb80b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.616715 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d8be3e31-8289-4300-9485-719d3bbb80b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.619305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 914/1822] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:47 2022] DELETE /identity/v3/projects/7433253cf90e4a33aa955d036254a526 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:47.624206 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7601c-1cfd-4098-9f55-5f2c7cf36c7e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:47.624499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7601c-1cfd-4098-9f55-5f2c7cf36c7e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:47.624780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7601c-1cfd-4098-9f55-5f2c7cf36c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:47.643574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-3ee7601c-1cfd-4098-9f55-5f2c7cf36c7e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:47.644781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3ee7601c-1cfd-4098-9f55-5f2c7cf36c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:47.740495 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 915/1823] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:47.747137 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8ae67-d949-4542-b7ec-316d71fe554d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:47.750419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8ae67-d949-4542-b7ec-316d71fe554d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:47.750419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8ae67-d949-4542-b7ec-316d71fe554d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:47.773897 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3c8e6c35-de0c-45ac-93f4-f1439bddd01c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdcabffb61684252a23f495015d76377'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.775391 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3c8e6c35-de0c-45ac-93f4-f1439bddd01c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdcabffb61684252a23f495015d76377'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.776990 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3c8e6c35-de0c-45ac-93f4-f1439bddd01c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdcabffb61684252a23f495015d76377'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.779576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d2b8ae67-d949-4542-b7ec-316d71fe554d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:47.782165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d2b8ae67-d949-4542-b7ec-316d71fe554d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:47.794724 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 916/1824] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:47.806275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8ae67-d949-4542-b7ec-316d71fe554d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:47.810988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3c8e6c35-de0c-45ac-93f4-f1439bddd01c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdcabffb61684252a23f495015d76377'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.816124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8ae67-d949-4542-b7ec-316d71fe554d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:47.819168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3c8e6c35-de0c-45ac-93f4-f1439bddd01c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdcabffb61684252a23f495015d76377'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:47.821538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c83241-84a2-4077-afda-d45d89bb7ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:47.822254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c83241-84a2-4077-afda-d45d89bb7ecd admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:47.822542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c83241-84a2-4077-afda-d45d89bb7ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:47.822964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c83241-84a2-4077-afda-d45d89bb7ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:47.823728 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c83241-84a2-4077-afda-d45d89bb7ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:47.824021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c83241-84a2-4077-afda-d45d89bb7ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:47.825715 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c83241-84a2-4077-afda-d45d89bb7ecd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:47.838820 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 917/1825] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:47.843332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c83241-84a2-4077-afda-d45d89bb7ecd admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:47.853834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c83241-84a2-4077-afda-d45d89bb7ecd admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:47.858775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b7b41-4862-4778-afe2-92325fd06e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:47.859528 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b7b41-4862-4778-afe2-92325fd06e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:47.860009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b7b41-4862-4778-afe2-92325fd06e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:47.860297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b7b41-4862-4778-afe2-92325fd06e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:47.861053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b7b41-4862-4778-afe2-92325fd06e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:47.862997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b7b41-4862-4778-afe2-92325fd06e9b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:47.901768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 909/1826] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:47 2022] DELETE /identity/v3/users/cdcabffb61684252a23f495015d76377 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:47.999873 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 918/1827] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:47 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:47:48.004883 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e6c35-de0c-45ac-93f4-f1439bddd01c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:48.032182 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b7b41-4862-4778-afe2-92325fd06e9b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:48.037713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ed0b7b41-4862-4778-afe2-92325fd06e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:48.123458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:48.199198 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e6c35-de0c-45ac-93f4-f1439bddd01c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:48.228936 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b7b41-4862-4778-afe2-92325fd06e9b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:48.234782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:48.235405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:48.235684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:48.236080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] PATH_INFO: `/v3/projects/6a429abe0e1f48ebbca8f3ae730fe0ac` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:48.238099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a429abe0e1f48ebbca8f3ae730fe0ac)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:48.240207 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:48.295778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37109d-c795-4808-9ea8-f1d96e22b393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:48.296460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37109d-c795-4808-9ea8-f1d96e22b393 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:48.296829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37109d-c795-4808-9ea8-f1d96e22b393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:48.297112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37109d-c795-4808-9ea8-f1d96e22b393 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:48.297847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37109d-c795-4808-9ea8-f1d96e22b393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:48.300653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37109d-c795-4808-9ea8-f1d96e22b393 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:48.349048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a429abe0e1f48ebbca8f3ae730fe0ac', 'request_id': 'req-179e0445-47c7-4104-ae86-cfffa762cd25'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:48.354452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:48.381494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 910/1828] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:48 2022] POST /identity/v3/users => generated 287 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:48.381494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37109d-c795-4808-9ea8-f1d96e22b393 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:48.381494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ba37109d-c795-4808-9ea8-f1d96e22b393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:48.438816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37109d-c795-4808-9ea8-f1d96e22b393 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:48.465457 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a429abe0e1f48ebbca8f3ae730fe0ac', 'request_id': 'req-179e0445-47c7-4104-ae86-cfffa762cd25'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:48.472344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a429abe0e1f48ebbca8f3ae730fe0ac', 'request_id': 'req-179e0445-47c7-4104-ae86-cfffa762cd25'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:48.485309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] The token cache is being invalidate because project 6a429abe0e1f48ebbca8f3ae730fe0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:48.485660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:48.487022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:48.492254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 919/1829] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:48 2022] DELETE /identity/v3/projects/6a429abe0e1f48ebbca8f3ae730fe0ac => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:47:48.492254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:48.492254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:48.492995 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2fcec-717d-4ed1-ba8e-fc6c4d5d099e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:48.493664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2fcec-717d-4ed1-ba8e-fc6c4d5d099e service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:48.493975 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2fcec-717d-4ed1-ba8e-fc6c4d5d099e service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:48.494273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2fcec-717d-4ed1-ba8e-fc6c4d5d099e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:48.496353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9af2fcec-717d-4ed1-ba8e-fc6c4d5d099e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:48.557325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e0445-47c7-4104-ae86-cfffa762cd25 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:48.560709 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2fcec-717d-4ed1-ba8e-fc6c4d5d099e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:48.562105 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:48.562246 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af2fcec-717d-4ed1-ba8e-fc6c4d5d099e service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:48.563066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:48.563460 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:48.563735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e admin admin] PATH_INFO: `/v3/projects/3aa668a0557349f78102560fa886ac37` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:48.565543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa668a0557349f78102560fa886ac37)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:48.567831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:48.572366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 911/1830] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:48 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:48.573172 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2fcec-717d-4ed1-ba8e-fc6c4d5d099e service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:48.575669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9af2fcec-717d-4ed1-ba8e-fc6c4d5d099e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:48.594095 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2fcec-717d-4ed1-ba8e-fc6c4d5d099e service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:48.600287 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530e20f-19a9-4cc0-9bcf-fea9b67db3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:48.601166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e20f-19a9-4cc0-9bcf-fea9b67db3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:48.601453 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e20f-19a9-4cc0-9bcf-fea9b67db3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:48.606826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e20f-19a9-4cc0-9bcf-fea9b67db3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:48.606826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530e20f-19a9-4cc0-9bcf-fea9b67db3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:48.606826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530e20f-19a9-4cc0-9bcf-fea9b67db3f0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:48.616024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 912/1831] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:48.617412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355246a2-fec7-43db-8b26-0bf35678e4f7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:48.617903 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355246a2-fec7-43db-8b26-0bf35678e4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:48.618390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355246a2-fec7-43db-8b26-0bf35678e4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:48.638302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-355246a2-fec7-43db-8b26-0bf35678e4f7 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:48.639629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-355246a2-fec7-43db-8b26-0bf35678e4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:48.648460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 913/1832] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:48.649108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355246a2-fec7-43db-8b26-0bf35678e4f7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:48.659698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355246a2-fec7-43db-8b26-0bf35678e4f7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:48.664309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1777658c-5fae-43e4-bb88-1c15faf5e4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:48.664976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777658c-5fae-43e4-bb88-1c15faf5e4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:48.665263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777658c-5fae-43e4-bb88-1c15faf5e4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:48.665544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1777658c-5fae-43e4-bb88-1c15faf5e4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:48.666338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777658c-5fae-43e4-bb88-1c15faf5e4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:48.667944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1777658c-5fae-43e4-bb88-1c15faf5e4ae admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:48.681777 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 914/1833] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:48.681777 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc03ff-b8fb-4a75-be7a-03a6d240e192 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:48.681777 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc03ff-b8fb-4a75-be7a-03a6d240e192 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:48.681777 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc03ff-b8fb-4a75-be7a-03a6d240e192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:48.700988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-cfdc03ff-b8fb-4a75-be7a-03a6d240e192 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:48.702153 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cfdc03ff-b8fb-4a75-be7a-03a6d240e192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:48.710938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 915/1834] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:48.719095 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc03ff-b8fb-4a75-be7a-03a6d240e192 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:48.722330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc03ff-b8fb-4a75-be7a-03a6d240e192 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:48.726977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d8199-c7dc-43c9-9993-01c4809d6e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:48.727866 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d8199-c7dc-43c9-9993-01c4809d6e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:48.728151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d8199-c7dc-43c9-9993-01c4809d6e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:48.728430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d8199-c7dc-43c9-9993-01c4809d6e5d admin admin] PATH_INFO: `/v3/projects/dca4798a51944a90a65783bf1fe0e704/users/702353e7e8ac492ba52985d6b2bcbd31/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:48.749029 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d8199-c7dc-43c9-9993-01c4809d6e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dca4798a51944a90a65783bf1fe0e704, user_id=702353e7e8ac492ba52985d6b2bcbd31, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:48.751257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d8199-c7dc-43c9-9993-01c4809d6e5d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:48.760737 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa668a0557349f78102560fa886ac37', 'request_id': 'req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:48.906228 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 916/1835] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:48 2022] PUT /identity/v3/projects/dca4798a51944a90a65783bf1fe0e704/users/702353e7e8ac492ba52985d6b2bcbd31/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:48.907597 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d8199-c7dc-43c9-9993-01c4809d6e5d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:48.934852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa668a0557349f78102560fa886ac37', 'request_id': 'req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:48.944250 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa668a0557349f78102560fa886ac37', 'request_id': 'req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:48.967966 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e admin admin] The token cache is being invalidate because project 3aa668a0557349f78102560fa886ac37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:48.969786 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:48.981498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-474a7ca4-3a3d-4f83-a87b-0c9f5303038e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:48.988562 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 920/1836] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:48 2022] DELETE /identity/v3/projects/3aa668a0557349f78102560fa886ac37 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:48.990694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3da032-6609-4e5b-b868-7d2a0abfe51e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:48.991096 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3da032-6609-4e5b-b868-7d2a0abfe51e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:48.991750 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3da032-6609-4e5b-b868-7d2a0abfe51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.021632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d8199-c7dc-43c9-9993-01c4809d6e5d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:49.028138 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdb059-b56b-4483-a8f7-d7efc698d542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:49.028907 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdb059-b56b-4483-a8f7-d7efc698d542 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.029846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdb059-b56b-4483-a8f7-d7efc698d542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.030184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdb059-b56b-4483-a8f7-d7efc698d542 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.030942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdb059-b56b-4483-a8f7-d7efc698d542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:49.031325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdb059-b56b-4483-a8f7-d7efc698d542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:49.033467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdb059-b56b-4483-a8f7-d7efc698d542 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:49.045812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-db3da032-6609-4e5b-b868-7d2a0abfe51e None None] MFA Rules not processed for user `702353e7e8ac492ba52985d6b2bcbd31`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:49.047114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-db3da032-6609-4e5b-b868-7d2a0abfe51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:49.051290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 917/1837] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:49.052753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ee4db-1961-4247-beb3-b218bd703910 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.053047 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ee4db-1961-4247-beb3-b218bd703910 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.053859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ee4db-1961-4247-beb3-b218bd703910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.077628 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f64ee4db-1961-4247-beb3-b218bd703910 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:49.078988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f64ee4db-1961-4247-beb3-b218bd703910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:49.091288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 918/1838] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:49.092277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ee4db-1961-4247-beb3-b218bd703910 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:49.098309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f64ee4db-1961-4247-beb3-b218bd703910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:49.113588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ee4db-1961-4247-beb3-b218bd703910 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:49.118472 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85defb69-b4a3-40c1-ba0f-1fcf2c94b4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:49.119145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85defb69-b4a3-40c1-ba0f-1fcf2c94b4ac admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.119433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85defb69-b4a3-40c1-ba0f-1fcf2c94b4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.119711 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85defb69-b4a3-40c1-ba0f-1fcf2c94b4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.120413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85defb69-b4a3-40c1-ba0f-1fcf2c94b4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:49.122374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85defb69-b4a3-40c1-ba0f-1fcf2c94b4ac admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:49.144996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 921/1839] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:49.149776 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c3823-3c97-4153-86ea-e64216edfe31 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.150172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c3823-3c97-4153-86ea-e64216edfe31 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.150549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c3823-3c97-4153-86ea-e64216edfe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.172789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-927c3823-3c97-4153-86ea-e64216edfe31 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:49.172789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-927c3823-3c97-4153-86ea-e64216edfe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:49.179237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 922/1840] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:49.180015 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c3823-3c97-4153-86ea-e64216edfe31 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:49.181274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-927c3823-3c97-4153-86ea-e64216edfe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:49.193981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c3823-3c97-4153-86ea-e64216edfe31 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:49.198586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d9732-8ff3-4977-8fba-ad1248280079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:49.201426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d9732-8ff3-4977-8fba-ad1248280079 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.201426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d9732-8ff3-4977-8fba-ad1248280079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.201426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d9732-8ff3-4977-8fba-ad1248280079 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.201426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d9732-8ff3-4977-8fba-ad1248280079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:49.202578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d9732-8ff3-4977-8fba-ad1248280079 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:49.233818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 919/1841] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:49 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:49.233818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85defb69-b4a3-40c1-ba0f-1fcf2c94b4ac admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:49.289593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 923/1842] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:49 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:49.289593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d9732-8ff3-4977-8fba-ad1248280079 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:49.298189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85defb69-b4a3-40c1-ba0f-1fcf2c94b4ac admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:49.351407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d9732-8ff3-4977-8fba-ad1248280079 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:49.355852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075c34e-a8b4-42ba-a86e-52fa452d659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:49.356638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c34e-a8b4-42ba-a86e-52fa452d659b admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.356918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c34e-a8b4-42ba-a86e-52fa452d659b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.357195 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c34e-a8b4-42ba-a86e-52fa452d659b admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.357915 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075c34e-a8b4-42ba-a86e-52fa452d659b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:49.358242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c4558-7d10-44ca-8e9e-da11d31e821c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:49.358910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c4558-7d10-44ca-8e9e-da11d31e821c admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.359192 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c4558-7d10-44ca-8e9e-da11d31e821c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.359466 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c4558-7d10-44ca-8e9e-da11d31e821c admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.359852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075c34e-a8b4-42ba-a86e-52fa452d659b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:49.360186 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c4558-7d10-44ca-8e9e-da11d31e821c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:49.360498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c4558-7d10-44ca-8e9e-da11d31e821c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:49.362729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c4558-7d10-44ca-8e9e-da11d31e821c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:49.374178 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 920/1843] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:49.375129 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c4558-7d10-44ca-8e9e-da11d31e821c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:49.385601 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c4558-7d10-44ca-8e9e-da11d31e821c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:49.390519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686ad11-53af-4c69-8d52-320be3678acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:49.391188 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686ad11-53af-4c69-8d52-320be3678acb admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.391497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686ad11-53af-4c69-8d52-320be3678acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.391745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686ad11-53af-4c69-8d52-320be3678acb admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.393385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686ad11-53af-4c69-8d52-320be3678acb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:49.395062 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686ad11-53af-4c69-8d52-320be3678acb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:49.462587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 924/1844] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:49 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:49.463543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075c34e-a8b4-42ba-a86e-52fa452d659b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:49.474370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075c34e-a8b4-42ba-a86e-52fa452d659b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:49.479186 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813fbce-71e6-40a2-aae0-1ac5306a014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:49.479848 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813fbce-71e6-40a2-aae0-1ac5306a014b admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.480124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813fbce-71e6-40a2-aae0-1ac5306a014b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.480401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813fbce-71e6-40a2-aae0-1ac5306a014b admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.481093 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813fbce-71e6-40a2-aae0-1ac5306a014b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:49.485465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:49.487136 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813fbce-71e6-40a2-aae0-1ac5306a014b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:49.493632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 921/1845] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:49 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:49.494870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686ad11-53af-4c69-8d52-320be3678acb admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:49.505381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686ad11-53af-4c69-8d52-320be3678acb admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:49.510691 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73b042-3ef0-4887-bc61-2287d037a8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:49.511652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73b042-3ef0-4887-bc61-2287d037a8b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.511652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73b042-3ef0-4887-bc61-2287d037a8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.511909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73b042-3ef0-4887-bc61-2287d037a8b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.512847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73b042-3ef0-4887-bc61-2287d037a8b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:49.514512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73b042-3ef0-4887-bc61-2287d037a8b4 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:49.529506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 922/1846] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:49.529506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73b042-3ef0-4887-bc61-2287d037a8b4 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:49.530278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:49.540979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73b042-3ef0-4887-bc61-2287d037a8b4 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:49.545809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab95bc-26fd-4e6f-9845-f3835f9876ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:49.546638 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab95bc-26fd-4e6f-9845-f3835f9876ec admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.546938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab95bc-26fd-4e6f-9845-f3835f9876ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.547217 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ab95bc-26fd-4e6f-9845-f3835f9876ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.547971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab95bc-26fd-4e6f-9845-f3835f9876ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:49.549612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ab95bc-26fd-4e6f-9845-f3835f9876ec admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:49.566032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 923/1847] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:49.566451 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 925/1848] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:49 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:49.566535 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab95bc-26fd-4e6f-9845-f3835f9876ec admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:49.567969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813fbce-71e6-40a2-aae0-1ac5306a014b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:49.571048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ab95bc-26fd-4e6f-9845-f3835f9876ec admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:49.629425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25079b7e-b37a-458c-a1e2-601cd2f16af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:49.630207 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25079b7e-b37a-458c-a1e2-601cd2f16af7 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.630498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25079b7e-b37a-458c-a1e2-601cd2f16af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.630779 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25079b7e-b37a-458c-a1e2-601cd2f16af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.631801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25079b7e-b37a-458c-a1e2-601cd2f16af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:49.633537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25079b7e-b37a-458c-a1e2-601cd2f16af7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:49.637715 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813fbce-71e6-40a2-aae0-1ac5306a014b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:49.643012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496de60-96bb-4f43-9fbc-cc2a9bf5dffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:49.643686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496de60-96bb-4f43-9fbc-cc2a9bf5dffe admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.643971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496de60-96bb-4f43-9fbc-cc2a9bf5dffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.644096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 924/1849] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:49.644285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7496de60-96bb-4f43-9fbc-cc2a9bf5dffe admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.644809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25079b7e-b37a-458c-a1e2-601cd2f16af7 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:49.645019 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496de60-96bb-4f43-9fbc-cc2a9bf5dffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:49.647358 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7496de60-96bb-4f43-9fbc-cc2a9bf5dffe admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:49.655948 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25079b7e-b37a-458c-a1e2-601cd2f16af7 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:49.662266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c66b7-737a-40f0-817b-4203992b649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:49.692128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c66b7-737a-40f0-817b-4203992b649a admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.692128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c66b7-737a-40f0-817b-4203992b649a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.692128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c66b7-737a-40f0-817b-4203992b649a admin admin] PATH_INFO: `/v3/projects/45a52122ca3943c88c209892a5767b23/users/7e7e1b61c0764dc9a25b31ec8cb3cac8/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.692128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c66b7-737a-40f0-817b-4203992b649a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a52122ca3943c88c209892a5767b23, user_id=7e7e1b61c0764dc9a25b31ec8cb3cac8, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:49.692128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c66b7-737a-40f0-817b-4203992b649a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:49.957286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 926/1850] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:49 2022] POST /identity/v3/users => generated 294 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:49.957286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496de60-96bb-4f43-9fbc-cc2a9bf5dffe admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:49.966687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7496de60-96bb-4f43-9fbc-cc2a9bf5dffe admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:49.973571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43c6be-5abb-4774-9716-d9134c5afdfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:49.974714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43c6be-5abb-4774-9716-d9134c5afdfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:49.975138 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43c6be-5abb-4774-9716-d9134c5afdfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:49.975435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43c6be-5abb-4774-9716-d9134c5afdfc admin admin] PATH_INFO: `/v3/projects/cbf9584ac99c45738da158e6d2233645/users/e314e067ae4b47db9e8a5eb26606ff13/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:49.977459 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 925/1851] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:49 2022] PUT /identity/v3/projects/45a52122ca3943c88c209892a5767b23/users/7e7e1b61c0764dc9a25b31ec8cb3cac8/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:49.978417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c66b7-737a-40f0-817b-4203992b649a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:49.993691 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43c6be-5abb-4774-9716-d9134c5afdfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf9584ac99c45738da158e6d2233645, user_id=e314e067ae4b47db9e8a5eb26606ff13, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:49.996681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43c6be-5abb-4774-9716-d9134c5afdfc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:50.046318 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c66b7-737a-40f0-817b-4203992b649a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:50.051280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e6e0f-6304-455f-8487-b752e2ffaea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:50.052267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e6e0f-6304-455f-8487-b752e2ffaea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:50.052548 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e6e0f-6304-455f-8487-b752e2ffaea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:50.052820 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e6e0f-6304-455f-8487-b752e2ffaea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:50.053553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e6e0f-6304-455f-8487-b752e2ffaea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:50.055176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e6e0f-6304-455f-8487-b752e2ffaea3 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:50.065404 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 926/1852] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:50.066655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e6e0f-6304-455f-8487-b752e2ffaea3 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:50.077540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e6e0f-6304-455f-8487-b752e2ffaea3 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:50.082997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eecf35-edb0-418e-a323-0fbbce60f925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:50.083661 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eecf35-edb0-418e-a323-0fbbce60f925 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:50.084075 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eecf35-edb0-418e-a323-0fbbce60f925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:50.084198 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eecf35-edb0-418e-a323-0fbbce60f925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:50.084914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eecf35-edb0-418e-a323-0fbbce60f925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:50.086518 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eecf35-edb0-418e-a323-0fbbce60f925 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:50.097161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 927/1853] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:50.098533 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eecf35-edb0-418e-a323-0fbbce60f925 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:50.107713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eecf35-edb0-418e-a323-0fbbce60f925 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:50.112462 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a96a-8108-4e91-bb83-9da2a88176cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:50.113083 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a96a-8108-4e91-bb83-9da2a88176cc admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:50.113363 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a96a-8108-4e91-bb83-9da2a88176cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:50.113636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a96a-8108-4e91-bb83-9da2a88176cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:50.114427 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894a96a-8108-4e91-bb83-9da2a88176cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:50.115970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f894a96a-8108-4e91-bb83-9da2a88176cc admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:50.126045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 928/1854] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:50.127491 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a96a-8108-4e91-bb83-9da2a88176cc admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:50.136531 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a96a-8108-4e91-bb83-9da2a88176cc admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:50.141021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7586e-78af-4304-b43e-34e15ee06cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:50.141871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7586e-78af-4304-b43e-34e15ee06cca admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:50.142710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7586e-78af-4304-b43e-34e15ee06cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:50.142968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7586e-78af-4304-b43e-34e15ee06cca admin admin] PATH_INFO: `/v3/projects/45a52122ca3943c88c209892a5767b23/users/7e7e1b61c0764dc9a25b31ec8cb3cac8/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:50.144910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7586e-78af-4304-b43e-34e15ee06cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a52122ca3943c88c209892a5767b23, user_id=7e7e1b61c0764dc9a25b31ec8cb3cac8, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:50.147588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7586e-78af-4304-b43e-34e15ee06cca admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:50.153253 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 927/1855] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:49 2022] PUT /identity/v3/projects/cbf9584ac99c45738da158e6d2233645/users/e314e067ae4b47db9e8a5eb26606ff13/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:50.154198 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43c6be-5abb-4774-9716-d9134c5afdfc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:50.167926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 929/1856] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:50 2022] PUT /identity/v3/projects/45a52122ca3943c88c209892a5767b23/users/7e7e1b61c0764dc9a25b31ec8cb3cac8/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:50.169225 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b74111-d5ea-4f0d-b330-a795ab3ce3f9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:50.169511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b74111-d5ea-4f0d-b330-a795ab3ce3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:50.169822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b74111-d5ea-4f0d-b330-a795ab3ce3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:50.198831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-77b74111-d5ea-4f0d-b330-a795ab3ce3f9 None None] MFA Rules not processed for user `e314e067ae4b47db9e8a5eb26606ff13`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:50.200545 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-77b74111-d5ea-4f0d-b330-a795ab3ce3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:50.221187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43c6be-5abb-4774-9716-d9134c5afdfc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:50.277883 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 930/1857] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:50.279320 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfff8f-f052-45eb-b689-cb3445712b48 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:50.279616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfff8f-f052-45eb-b689-cb3445712b48 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:50.279993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfff8f-f052-45eb-b689-cb3445712b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:50.285349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a450658-cedc-4a13-9276-fed2b3ba0bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:50.286566 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a450658-cedc-4a13-9276-fed2b3ba0bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:50.286870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a450658-cedc-4a13-9276-fed2b3ba0bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:50.287155 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a450658-cedc-4a13-9276-fed2b3ba0bc7 admin admin] PATH_INFO: `/v3/projects/1f66e5ce5a01451fa75efef67794ee89/users/5c7a5932caf34f8087e047f46346c197/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:50.302642 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a450658-cedc-4a13-9276-fed2b3ba0bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f66e5ce5a01451fa75efef67794ee89, user_id=5c7a5932caf34f8087e047f46346c197, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:50.306838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a450658-cedc-4a13-9276-fed2b3ba0bc7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:50.309328 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-babfff8f-f052-45eb-b689-cb3445712b48 None None] MFA Rules not processed for user `7e7e1b61c0764dc9a25b31ec8cb3cac8`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:50.310301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-babfff8f-f052-45eb-b689-cb3445712b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:50.365914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 928/1858] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:50 2022] PUT /identity/v3/projects/1f66e5ce5a01451fa75efef67794ee89/users/5c7a5932caf34f8087e047f46346c197/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:50.366107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a450658-cedc-4a13-9276-fed2b3ba0bc7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:50.367566 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6a450658-cedc-4a13-9276-fed2b3ba0bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:50.385092 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 931/1859] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:50.386776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c1344-ff18-4494-9ea8-56e1d13103d3 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:50.387058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c1344-ff18-4494-9ea8-56e1d13103d3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:50.387334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c1344-ff18-4494-9ea8-56e1d13103d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:50.415049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-359c1344-ff18-4494-9ea8-56e1d13103d3 None None] MFA Rules not processed for user `5c7a5932caf34f8087e047f46346c197`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:50.416299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-359c1344-ff18-4494-9ea8-56e1d13103d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:50.429241 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a450658-cedc-4a13-9276-fed2b3ba0bc7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:50.433018 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70bece-7a18-4d69-b9fd-4c13e13eb896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:50.433777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70bece-7a18-4d69-b9fd-4c13e13eb896 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:50.434062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70bece-7a18-4d69-b9fd-4c13e13eb896 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:50.434335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d70bece-7a18-4d69-b9fd-4c13e13eb896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:50.483401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 932/1860] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:50.484351 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c1344-ff18-4494-9ea8-56e1d13103d3 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:50.485644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-359c1344-ff18-4494-9ea8-56e1d13103d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:50.492657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70bece-7a18-4d69-b9fd-4c13e13eb896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:50.494436 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d70bece-7a18-4d69-b9fd-4c13e13eb896 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:50.497381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c1344-ff18-4494-9ea8-56e1d13103d3 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:50.501092 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00efde7-5296-4f78-8a26-2f00a78221cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:50.503402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00efde7-5296-4f78-8a26-2f00a78221cc service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:50.503402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00efde7-5296-4f78-8a26-2f00a78221cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:50.503402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00efde7-5296-4f78-8a26-2f00a78221cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:50.504839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 929/1861] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:50.505922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70bece-7a18-4d69-b9fd-4c13e13eb896 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:50.569959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00efde7-5296-4f78-8a26-2f00a78221cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:50.571417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00efde7-5296-4f78-8a26-2f00a78221cc service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:50.572826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d70bece-7a18-4d69-b9fd-4c13e13eb896 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:50.581237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118443c0-07c9-4416-8bcf-78d98ec30217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:50.582360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118443c0-07c9-4416-8bcf-78d98ec30217 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:50.582895 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118443c0-07c9-4416-8bcf-78d98ec30217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:50.583232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118443c0-07c9-4416-8bcf-78d98ec30217 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:50.584317 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118443c0-07c9-4416-8bcf-78d98ec30217 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:50.587031 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118443c0-07c9-4416-8bcf-78d98ec30217 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:50.594344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 933/1862] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:50.830711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 930/1863] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:50 2022] POST /identity/v3/projects => generated 385 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:50.832345 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00efde7-5296-4f78-8a26-2f00a78221cc service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:50.842918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00efde7-5296-4f78-8a26-2f00a78221cc service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:50.901851 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdeb5e-5f4e-45e7-8a9e-e08cec26a769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:50.902456 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdeb5e-5f4e-45e7-8a9e-e08cec26a769 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:50.902740 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdeb5e-5f4e-45e7-8a9e-e08cec26a769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:50.903014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdeb5e-5f4e-45e7-8a9e-e08cec26a769 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:50.903706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdeb5e-5f4e-45e7-8a9e-e08cec26a769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:50.905620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afdeb5e-5f4e-45e7-8a9e-e08cec26a769 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:51.015751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 934/1864] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:50 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:47:51.020204 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118443c0-07c9-4416-8bcf-78d98ec30217 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:51.031118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118443c0-07c9-4416-8bcf-78d98ec30217 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:51.036438 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d58ca-430d-43df-9e39-97bf467f09a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:51.037202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d58ca-430d-43df-9e39-97bf467f09a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:51.037493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d58ca-430d-43df-9e39-97bf467f09a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:51.037806 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d58ca-430d-43df-9e39-97bf467f09a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:51.038553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d58ca-430d-43df-9e39-97bf467f09a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:51.040165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d58ca-430d-43df-9e39-97bf467f09a3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:51.051558 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 931/1865] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:51.066868 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdeb5e-5f4e-45e7-8a9e-e08cec26a769 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:51.066868 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afdeb5e-5f4e-45e7-8a9e-e08cec26a769 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:51.074290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac68a1c-b950-43fd-9969-81f82451d673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:51.075300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac68a1c-b950-43fd-9969-81f82451d673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:51.081903 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac68a1c-b950-43fd-9969-81f82451d673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:51.081903 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac68a1c-b950-43fd-9969-81f82451d673 admin admin] PATH_INFO: `/v3/projects/791cc0633a274e0abffc140c5c6a2701/users/f41ae388232c44ffa3740e346d66d57a/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:51.096463 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac68a1c-b950-43fd-9969-81f82451d673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=791cc0633a274e0abffc140c5c6a2701, user_id=f41ae388232c44ffa3740e346d66d57a, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:51.099454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac68a1c-b950-43fd-9969-81f82451d673 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:51.159762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:51.170205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 935/1866] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:51 2022] PUT /identity/v3/projects/791cc0633a274e0abffc140c5c6a2701/users/f41ae388232c44ffa3740e346d66d57a/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:51.175074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d58ca-430d-43df-9e39-97bf467f09a3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:51.194254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d58ca-430d-43df-9e39-97bf467f09a3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:51.270406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fdef22-062f-4bfd-ab22-84522051edcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:51.271102 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdef22-062f-4bfd-ab22-84522051edcc admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:51.271623 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdef22-062f-4bfd-ab22-84522051edcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:51.271914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fdef22-062f-4bfd-ab22-84522051edcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:51.272878 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdef22-062f-4bfd-ab22-84522051edcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:51.274738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fdef22-062f-4bfd-ab22-84522051edcc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:51.291158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 932/1867] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:51 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:51.291482 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac68a1c-b950-43fd-9969-81f82451d673 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:51.305768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac68a1c-b950-43fd-9969-81f82451d673 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:51.309055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb7b0-51df-49f9-ad03-a59d76e40cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:51.310191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb7b0-51df-49f9-ad03-a59d76e40cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:51.310561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb7b0-51df-49f9-ad03-a59d76e40cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:51.310925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503fb7b0-51df-49f9-ad03-a59d76e40cf4 admin admin] PATH_INFO: `/v3/projects/791cc0633a274e0abffc140c5c6a2701/users/f41ae388232c44ffa3740e346d66d57a/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:51.313031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fb7b0-51df-49f9-ad03-a59d76e40cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=791cc0633a274e0abffc140c5c6a2701, user_id=f41ae388232c44ffa3740e346d66d57a, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:51.316511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503fb7b0-51df-49f9-ad03-a59d76e40cf4 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:51.329543 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 936/1868] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:51 2022] PUT /identity/v3/projects/791cc0633a274e0abffc140c5c6a2701/users/f41ae388232c44ffa3740e346d66d57a/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:47:51.341238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4aeeb-46fc-4d95-b427-d66fdb305fe3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:51.341521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4aeeb-46fc-4d95-b427-d66fdb305fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:51.341836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4aeeb-46fc-4d95-b427-d66fdb305fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:51.374910 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-91c4aeeb-46fc-4d95-b427-d66fdb305fe3 None None] MFA Rules not processed for user `f41ae388232c44ffa3740e346d66d57a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:51.376136 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-91c4aeeb-46fc-4d95-b427-d66fdb305fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:51.457140 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 933/1869] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:51.638104 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb7b0-51df-49f9-ad03-a59d76e40cf4 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:51.695794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503fb7b0-51df-49f9-ad03-a59d76e40cf4 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:51.700005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb43c3-cacb-43b1-8c5a-ab460e239f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:51.700668 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb43c3-cacb-43b1-8c5a-ab460e239f6e service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:51.703699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb43c3-cacb-43b1-8c5a-ab460e239f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:51.703699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb43c3-cacb-43b1-8c5a-ab460e239f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:51.711696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb43c3-cacb-43b1-8c5a-ab460e239f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:51.713130 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb43c3-cacb-43b1-8c5a-ab460e239f6e service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:51.724149 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 937/1870] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:51.829314 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4aeeb-46fc-4d95-b427-d66fdb305fe3 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:51.834368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:51.915066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4aeeb-46fc-4d95-b427-d66fdb305fe3 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:51.920775 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5feac42-a1e8-4926-a833-cb1659c20bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:51.921837 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feac42-a1e8-4926-a833-cb1659c20bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:51.923076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feac42-a1e8-4926-a833-cb1659c20bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:51.923613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5feac42-a1e8-4926-a833-cb1659c20bd3 admin admin] PATH_INFO: `/v3/users/5c7a5932caf34f8087e047f46346c197` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:51.927499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5feac42-a1e8-4926-a833-cb1659c20bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7a5932caf34f8087e047f46346c197)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:51.935423 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5feac42-a1e8-4926-a833-cb1659c20bd3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:52.130115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a5feac42-a1e8-4926-a833-cb1659c20bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7a5932caf34f8087e047f46346c197'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:52.215694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a5feac42-a1e8-4926-a833-cb1659c20bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7a5932caf34f8087e047f46346c197'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:52.216331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a5feac42-a1e8-4926-a833-cb1659c20bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7a5932caf34f8087e047f46346c197'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:52.224415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a5feac42-a1e8-4926-a833-cb1659c20bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7a5932caf34f8087e047f46346c197'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:52.225193 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-a5feac42-a1e8-4926-a833-cb1659c20bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7a5932caf34f8087e047f46346c197'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:52.243555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 934/1871] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:51 2022] DELETE /identity/v3/users/5c7a5932caf34f8087e047f46346c197 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:52.249602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6151a4-fd6c-4020-88b2-426dc052bfce None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:52.250078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6151a4-fd6c-4020-88b2-426dc052bfce None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:52.274335 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6151a4-fd6c-4020-88b2-426dc052bfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:52.274335 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7e6151a4-fd6c-4020-88b2-426dc052bfce None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:52.274335 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7e6151a4-fd6c-4020-88b2-426dc052bfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:52.338907 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 938/1872] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:52.346276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:52.350189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5feac42-a1e8-4926-a833-cb1659c20bd3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:52.354665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a5feac42-a1e8-4926-a833-cb1659c20bd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:52.408134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5feac42-a1e8-4926-a833-cb1659c20bd3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:52.409079 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6151a4-fd6c-4020-88b2-426dc052bfce None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:52.411250 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7e6151a4-fd6c-4020-88b2-426dc052bfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:52.413031 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a16f9-a5ad-47dd-ac45-f4e16bead7fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:52.413690 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a16f9-a5ad-47dd-ac45-f4e16bead7fd service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:52.414015 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a16f9-a5ad-47dd-ac45-f4e16bead7fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:52.414267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a16f9-a5ad-47dd-ac45-f4e16bead7fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:52.423283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6151a4-fd6c-4020-88b2-426dc052bfce None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:52.423418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a16f9-a5ad-47dd-ac45-f4e16bead7fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:52.424748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a16f9-a5ad-47dd-ac45-f4e16bead7fd service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:52.428061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4f509-b897-4efa-afc2-a2f08944ff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:52.428937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f509-b897-4efa-afc2-a2f08944ff64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:52.429220 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f509-b897-4efa-afc2-a2f08944ff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:52.429499 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4f509-b897-4efa-afc2-a2f08944ff64 admin admin] PATH_INFO: `/v3/users/702353e7e8ac492ba52985d6b2bcbd31` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:52.430751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4f509-b897-4efa-afc2-a2f08944ff64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=702353e7e8ac492ba52985d6b2bcbd31)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:52.432676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4f509-b897-4efa-afc2-a2f08944ff64 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:52.435477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 935/1873] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:52.645123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-99b4f509-b897-4efa-afc2-a2f08944ff64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702353e7e8ac492ba52985d6b2bcbd31'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:52.645928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-99b4f509-b897-4efa-afc2-a2f08944ff64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702353e7e8ac492ba52985d6b2bcbd31'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:52.647503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-99b4f509-b897-4efa-afc2-a2f08944ff64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702353e7e8ac492ba52985d6b2bcbd31'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:52.692645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-99b4f509-b897-4efa-afc2-a2f08944ff64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702353e7e8ac492ba52985d6b2bcbd31'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:52.709927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-99b4f509-b897-4efa-afc2-a2f08944ff64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702353e7e8ac492ba52985d6b2bcbd31'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:52.866698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 939/1874] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:52 2022] DELETE /identity/v3/users/702353e7e8ac492ba52985d6b2bcbd31 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:47:52.872340 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83a8fc-c77b-432d-870a-a20de1f30eb4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:52.872798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83a8fc-c77b-432d-870a-a20de1f30eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:52.873078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83a8fc-c77b-432d-870a-a20de1f30eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:52.892716 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-df83a8fc-c77b-432d-870a-a20de1f30eb4 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:52.894340 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-df83a8fc-c77b-432d-870a-a20de1f30eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:52.955221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 936/1875] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:52.969647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83a8fc-c77b-432d-870a-a20de1f30eb4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:52.969803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4f509-b897-4efa-afc2-a2f08944ff64 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:52.971473 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-99b4f509-b897-4efa-afc2-a2f08944ff64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:52.974454 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-df83a8fc-c77b-432d-870a-a20de1f30eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:52.993619 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83a8fc-c77b-432d-870a-a20de1f30eb4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:53.000444 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:53.002054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:53.002342 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:53.002626 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] PATH_INFO: `/v3/projects/1f66e5ce5a01451fa75efef67794ee89` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:53.004281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f66e5ce5a01451fa75efef67794ee89)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:53.006971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:53.037374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4f509-b897-4efa-afc2-a2f08944ff64 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:53.042553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa86da-3f49-4e14-895a-02028873fac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:53.048787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa86da-3f49-4e14-895a-02028873fac6 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:53.048787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa86da-3f49-4e14-895a-02028873fac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:53.048787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa86da-3f49-4e14-895a-02028873fac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:53.058638 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa86da-3f49-4e14-895a-02028873fac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:53.061316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa86da-3f49-4e14-895a-02028873fac6 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:53.073800 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 940/1876] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:53.114088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:53.195435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f66e5ce5a01451fa75efef67794ee89', 'request_id': 'req-9c0592d1-53ac-4ca6-9a73-b195ba4920db'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:53.259911 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f66e5ce5a01451fa75efef67794ee89', 'request_id': 'req-9c0592d1-53ac-4ca6-9a73-b195ba4920db'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:53.273539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f66e5ce5a01451fa75efef67794ee89', 'request_id': 'req-9c0592d1-53ac-4ca6-9a73-b195ba4920db'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:53.294527 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] The token cache is being invalidate because project 1f66e5ce5a01451fa75efef67794ee89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:53.295844 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:53.305901 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:53.305901 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 937/1877] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:52 2022] DELETE /identity/v3/projects/1f66e5ce5a01451fa75efef67794ee89 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:53.318432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa86da-3f49-4e14-895a-02028873fac6 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:53.335624 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa86da-3f49-4e14-895a-02028873fac6 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:53.466850 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60f83d-8d15-41d5-86fb-010984964cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:53.468018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60f83d-8d15-41d5-86fb-010984964cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:53.468448 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60f83d-8d15-41d5-86fb-010984964cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:53.468900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60f83d-8d15-41d5-86fb-010984964cfc admin admin] PATH_INFO: `/v3/users/f41ae388232c44ffa3740e346d66d57a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:53.470184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60f83d-8d15-41d5-86fb-010984964cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f41ae388232c44ffa3740e346d66d57a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:53.473045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60f83d-8d15-41d5-86fb-010984964cfc admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:53.618381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:53.619472 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:53.635349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0592d1-53ac-4ca6-9a73-b195ba4920db admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:53.641549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:53.647140 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:53.647140 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:53.647140 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] PATH_INFO: `/v3/projects/dca4798a51944a90a65783bf1fe0e704` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:53.647140 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dca4798a51944a90a65783bf1fe0e704)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:53.647140 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:53.732646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2a60f83d-8d15-41d5-86fb-010984964cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f41ae388232c44ffa3740e346d66d57a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:53.733217 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2a60f83d-8d15-41d5-86fb-010984964cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f41ae388232c44ffa3740e346d66d57a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:53.733893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2a60f83d-8d15-41d5-86fb-010984964cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f41ae388232c44ffa3740e346d66d57a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:53.745544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2a60f83d-8d15-41d5-86fb-010984964cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f41ae388232c44ffa3740e346d66d57a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:53.752155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2a60f83d-8d15-41d5-86fb-010984964cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f41ae388232c44ffa3740e346d66d57a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:53.822765 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dca4798a51944a90a65783bf1fe0e704', 'request_id': 'req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:53.895847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 941/1878] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:53 2022] DELETE /identity/v3/users/f41ae388232c44ffa3740e346d66d57a => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:53.981577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dca4798a51944a90a65783bf1fe0e704', 'request_id': 'req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:53.989698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dca4798a51944a90a65783bf1fe0e704', 'request_id': 'req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:54.001711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] The token cache is being invalidate because project dca4798a51944a90a65783bf1fe0e704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:54.002085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:54.002985 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:54.005169 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 938/1879] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:53 2022] DELETE /identity/v3/projects/dca4798a51944a90a65783bf1fe0e704 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:47:54.010153 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60f83d-8d15-41d5-86fb-010984964cfc admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:54.011561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2a60f83d-8d15-41d5-86fb-010984964cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:54.080175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60f83d-8d15-41d5-86fb-010984964cfc admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:54.086086 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4054b-22d5-47e3-81c4-7da4c80330bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:54.086977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4054b-22d5-47e3-81c4-7da4c80330bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:54.087260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4054b-22d5-47e3-81c4-7da4c80330bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:54.087537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4054b-22d5-47e3-81c4-7da4c80330bb admin admin] PATH_INFO: `/v3/users/7e7e1b61c0764dc9a25b31ec8cb3cac8` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:54.088865 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4054b-22d5-47e3-81c4-7da4c80330bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7e1b61c0764dc9a25b31ec8cb3cac8)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:54.092235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4054b-22d5-47e3-81c4-7da4c80330bb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:54.294459 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-41a4054b-22d5-47e3-81c4-7da4c80330bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7e1b61c0764dc9a25b31ec8cb3cac8'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:54.295134 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-41a4054b-22d5-47e3-81c4-7da4c80330bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7e1b61c0764dc9a25b31ec8cb3cac8'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:54.295783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-41a4054b-22d5-47e3-81c4-7da4c80330bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7e1b61c0764dc9a25b31ec8cb3cac8'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:54.310468 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-41a4054b-22d5-47e3-81c4-7da4c80330bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7e1b61c0764dc9a25b31ec8cb3cac8'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:54.324149 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-41a4054b-22d5-47e3-81c4-7da4c80330bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7e1b61c0764dc9a25b31ec8cb3cac8'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:54.363003 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:54.364703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:54.448490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 942/1880] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:47:54 2022] DELETE /identity/v3/users/7e7e1b61c0764dc9a25b31ec8cb3cac8 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:54.467658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:54.490106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe6bb3-3b1d-417d-a12c-3bd1d7dbeb56 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:54.567027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04655a74-b2c7-4d21-b9c6-da88c358b363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:54.568051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655a74-b2c7-4d21-b9c6-da88c358b363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:54.568617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655a74-b2c7-4d21-b9c6-da88c358b363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:54.568963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04655a74-b2c7-4d21-b9c6-da88c358b363 admin admin] PATH_INFO: `/v3/projects/791cc0633a274e0abffc140c5c6a2701` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:54.570376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04655a74-b2c7-4d21-b9c6-da88c358b363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=791cc0633a274e0abffc140c5c6a2701)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:54.572476 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04655a74-b2c7-4d21-b9c6-da88c358b363 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:54.587933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:54.735671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-04655a74-b2c7-4d21-b9c6-da88c358b363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '791cc0633a274e0abffc140c5c6a2701', 'request_id': 'req-04655a74-b2c7-4d21-b9c6-da88c358b363'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:54.851346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-04655a74-b2c7-4d21-b9c6-da88c358b363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '791cc0633a274e0abffc140c5c6a2701', 'request_id': 'req-04655a74-b2c7-4d21-b9c6-da88c358b363'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:54.860654 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-04655a74-b2c7-4d21-b9c6-da88c358b363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '791cc0633a274e0abffc140c5c6a2701', 'request_id': 'req-04655a74-b2c7-4d21-b9c6-da88c358b363'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:54.886450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-04655a74-b2c7-4d21-b9c6-da88c358b363 admin admin] The token cache is being invalidate because project 791cc0633a274e0abffc140c5c6a2701 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:54.887846 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-04655a74-b2c7-4d21-b9c6-da88c358b363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:54.889923 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-04655a74-b2c7-4d21-b9c6-da88c358b363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:54.894760 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 939/1881] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:54 2022] DELETE /identity/v3/projects/791cc0633a274e0abffc140c5c6a2701 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:54.900493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc84e6-5b51-466b-80a8-9e94443cd6b3 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:54.900789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc84e6-5b51-466b-80a8-9e94443cd6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:54.901072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc84e6-5b51-466b-80a8-9e94443cd6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:54.931421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7efc84e6-5b51-466b-80a8-9e94443cd6b3 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:54.931421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7efc84e6-5b51-466b-80a8-9e94443cd6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:55.036099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 943/1882] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:55.037988 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544628b3-f80f-4f08-8506-4f4e8edc70ac None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:55.038285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544628b3-f80f-4f08-8506-4f4e8edc70ac None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:55.038596 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544628b3-f80f-4f08-8506-4f4e8edc70ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:55.064007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-544628b3-f80f-4f08-8506-4f4e8edc70ac None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:55.065246 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-544628b3-f80f-4f08-8506-4f4e8edc70ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:55.083772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc84e6-5b51-466b-80a8-9e94443cd6b3 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:55.085234 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7efc84e6-5b51-466b-80a8-9e94443cd6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:55.103621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc84e6-5b51-466b-80a8-9e94443cd6b3 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:55.116314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dc318-3827-4a3f-8230-70d5bd1b6830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:55.116944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dc318-3827-4a3f-8230-70d5bd1b6830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:55.117332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dc318-3827-4a3f-8230-70d5bd1b6830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:55.117705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dc318-3827-4a3f-8230-70d5bd1b6830 admin admin] PATH_INFO: `/v3/projects/45a52122ca3943c88c209892a5767b23` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:55.119439 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dc318-3827-4a3f-8230-70d5bd1b6830 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a52122ca3943c88c209892a5767b23)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:55.125484 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860dc318-3827-4a3f-8230-70d5bd1b6830 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:55.133467 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 940/1883] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:55.165143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544628b3-f80f-4f08-8506-4f4e8edc70ac None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:55.179153 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544628b3-f80f-4f08-8506-4f4e8edc70ac None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:55.184362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dab908-59ab-4533-98a0-98347d99ab14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:55.185058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab908-59ab-4533-98a0-98347d99ab14 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:55.185342 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab908-59ab-4533-98a0-98347d99ab14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:55.185619 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dab908-59ab-4533-98a0-98347d99ab14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:55.186401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dab908-59ab-4533-98a0-98347d99ab14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:55.186716 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dab908-59ab-4533-98a0-98347d99ab14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:55.188571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dab908-59ab-4533-98a0-98347d99ab14 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:55.211110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 941/1884] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:47:55.220056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dab908-59ab-4533-98a0-98347d99ab14 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:55.232381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dab908-59ab-4533-98a0-98347d99ab14 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:55.236920 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec853f-2cab-4670-b66f-d25c32ea3975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:55.237776 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec853f-2cab-4670-b66f-d25c32ea3975 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:55.238030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec853f-2cab-4670-b66f-d25c32ea3975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:55.238309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec853f-2cab-4670-b66f-d25c32ea3975 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:55.239008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec853f-2cab-4670-b66f-d25c32ea3975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:55.240951 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec853f-2cab-4670-b66f-d25c32ea3975 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:56.165964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 942/1885] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:55 2022] POST /identity/v3/projects => generated 389 bytes in 946 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:56.169972 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec853f-2cab-4670-b66f-d25c32ea3975 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:56.177122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-860dc318-3827-4a3f-8230-70d5bd1b6830 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a52122ca3943c88c209892a5767b23', 'request_id': 'req-860dc318-3827-4a3f-8230-70d5bd1b6830'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:56.259397 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec853f-2cab-4670-b66f-d25c32ea3975 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:56.265484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bc3c3-e1fa-4274-b93e-3f4a60f1ea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:56.266212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bc3c3-e1fa-4274-b93e-3f4a60f1ea2c admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.266496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bc3c3-e1fa-4274-b93e-3f4a60f1ea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.266800 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712bc3c3-e1fa-4274-b93e-3f4a60f1ea2c admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.267504 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bc3c3-e1fa-4274-b93e-3f4a60f1ea2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:56.273567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712bc3c3-e1fa-4274-b93e-3f4a60f1ea2c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:56.340946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-860dc318-3827-4a3f-8230-70d5bd1b6830 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a52122ca3943c88c209892a5767b23', 'request_id': 'req-860dc318-3827-4a3f-8230-70d5bd1b6830'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:56.349027 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-860dc318-3827-4a3f-8230-70d5bd1b6830 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a52122ca3943c88c209892a5767b23', 'request_id': 'req-860dc318-3827-4a3f-8230-70d5bd1b6830'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:56.366352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-860dc318-3827-4a3f-8230-70d5bd1b6830 admin admin] The token cache is being invalidate because project 45a52122ca3943c88c209892a5767b23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:47:56.367013 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-860dc318-3827-4a3f-8230-70d5bd1b6830 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:56.369618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-860dc318-3827-4a3f-8230-70d5bd1b6830 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:47:56.372822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 944/1886] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:47:55 2022] DELETE /identity/v3/projects/45a52122ca3943c88c209892a5767b23 => generated 0 bytes in 1296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:56.380181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15453ddc-646d-4512-bca3-b38ba37c026f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.380481 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15453ddc-646d-4512-bca3-b38ba37c026f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.380773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15453ddc-646d-4512-bca3-b38ba37c026f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.400251 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-15453ddc-646d-4512-bca3-b38ba37c026f None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:56.401557 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-15453ddc-646d-4512-bca3-b38ba37c026f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:56.404437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 943/1887] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:56 2022] POST /identity/v3/users => generated 295 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:47:56.410349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 945/1888] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:56.410634 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bc3c3-e1fa-4274-b93e-3f4a60f1ea2c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:56.412284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-712bc3c3-e1fa-4274-b93e-3f4a60f1ea2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:56.417448 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0d173-6438-4759-bb72-c22f238b20d8 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.417761 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0d173-6438-4759-bb72-c22f238b20d8 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.418052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0d173-6438-4759-bb72-c22f238b20d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.426409 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712bc3c3-e1fa-4274-b93e-3f4a60f1ea2c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:56.431424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd3214-8948-426f-b21c-0aa2f6eb5217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:56.432035 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd3214-8948-426f-b21c-0aa2f6eb5217 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.432323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd3214-8948-426f-b21c-0aa2f6eb5217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.432603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fd3214-8948-426f-b21c-0aa2f6eb5217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.433476 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd3214-8948-426f-b21c-0aa2f6eb5217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:56.435309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fd3214-8948-426f-b21c-0aa2f6eb5217 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:56.436834 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-33c0d173-6438-4759-bb72-c22f238b20d8 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:56.438043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-33c0d173-6438-4759-bb72-c22f238b20d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:56.445663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 944/1889] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:56.446206 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 946/1890] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:47:56.451349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd3214-8948-426f-b21c-0aa2f6eb5217 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:56.452718 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0d173-6438-4759-bb72-c22f238b20d8 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:56.461677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fd3214-8948-426f-b21c-0aa2f6eb5217 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:56.463522 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0d173-6438-4759-bb72-c22f238b20d8 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:56.467202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6466f1-d3e8-4705-979b-156fee5b95c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:56.467885 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6466f1-d3e8-4705-979b-156fee5b95c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.468174 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6466f1-d3e8-4705-979b-156fee5b95c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.468453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6466f1-d3e8-4705-979b-156fee5b95c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.469243 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6466f1-d3e8-4705-979b-156fee5b95c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:56.469462 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1de0c-d801-4bea-9e3e-6b5bee5c635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:56.470204 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1de0c-d801-4bea-9e3e-6b5bee5c635c admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.470494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1de0c-d801-4bea-9e3e-6b5bee5c635c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.470945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6466f1-d3e8-4705-979b-156fee5b95c3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:56.472343 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba1de0c-d801-4bea-9e3e-6b5bee5c635c admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.473254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1de0c-d801-4bea-9e3e-6b5bee5c635c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:47:56.473598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1de0c-d801-4bea-9e3e-6b5bee5c635c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:56.475264 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba1de0c-d801-4bea-9e3e-6b5bee5c635c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:56.482613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 945/1891] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:47:56.486704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6466f1-d3e8-4705-979b-156fee5b95c3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:56.491383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 947/1892] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:47:56.492333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1de0c-d801-4bea-9e3e-6b5bee5c635c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:56.498581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6466f1-d3e8-4705-979b-156fee5b95c3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:56.502290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba1de0c-d801-4bea-9e3e-6b5bee5c635c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:56.503515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22981f-4ed8-403d-af2d-0a0fa3af1cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:56.507532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22981f-4ed8-403d-af2d-0a0fa3af1cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.507532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22981f-4ed8-403d-af2d-0a0fa3af1cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.507532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22981f-4ed8-403d-af2d-0a0fa3af1cbd admin admin] PATH_INFO: `/v3/projects/4cc46c8e04db43ffbcd7e0618ac09773/users/c87773534569433b9da1c0369aba2d53/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.507858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1d695-252d-4362-a069-7a27c986b707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:56.508516 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1d695-252d-4362-a069-7a27c986b707 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.508803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1d695-252d-4362-a069-7a27c986b707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.509082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1d695-252d-4362-a069-7a27c986b707 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.509933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1d695-252d-4362-a069-7a27c986b707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:56.512138 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1d695-252d-4362-a069-7a27c986b707 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:56.520098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22981f-4ed8-403d-af2d-0a0fa3af1cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc46c8e04db43ffbcd7e0618ac09773, user_id=c87773534569433b9da1c0369aba2d53, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:56.522991 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22981f-4ed8-403d-af2d-0a0fa3af1cbd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:56.599092 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 946/1893] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:56 2022] PUT /identity/v3/projects/4cc46c8e04db43ffbcd7e0618ac09773/users/c87773534569433b9da1c0369aba2d53/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:47:56.610959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4dce4-d17c-434e-ac79-b106f86aacb2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.611256 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4dce4-d17c-434e-ac79-b106f86aacb2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.611542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4dce4-d17c-434e-ac79-b106f86aacb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.620653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 948/1894] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:56 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:47:56.623620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1d695-252d-4362-a069-7a27c986b707 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:56.643780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-33e4dce4-d17c-434e-ac79-b106f86aacb2 None None] MFA Rules not processed for user `c87773534569433b9da1c0369aba2d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:56.645154 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-33e4dce4-d17c-434e-ac79-b106f86aacb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:56.690834 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1d695-252d-4362-a069-7a27c986b707 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:56.695760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef54118-00d9-4864-8b0f-2afadf60efef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:56.696451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54118-00d9-4864-8b0f-2afadf60efef admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.696737 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54118-00d9-4864-8b0f-2afadf60efef admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.697046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54118-00d9-4864-8b0f-2afadf60efef admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.698298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef54118-00d9-4864-8b0f-2afadf60efef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:56.699805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef54118-00d9-4864-8b0f-2afadf60efef admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:56.719312 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 947/1895] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:56.724643 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4dce4-d17c-434e-ac79-b106f86aacb2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:56.737692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4dce4-d17c-434e-ac79-b106f86aacb2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:56.742322 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe43eb1-f1af-478d-a5d0-5beb78a6a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:56.747682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43eb1-f1af-478d-a5d0-5beb78a6a246 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.747682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43eb1-f1af-478d-a5d0-5beb78a6a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.747682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe43eb1-f1af-478d-a5d0-5beb78a6a246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.747682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe43eb1-f1af-478d-a5d0-5beb78a6a246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:56.747682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe43eb1-f1af-478d-a5d0-5beb78a6a246 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:56.799073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 949/1896] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:56 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:47:56.803002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef54118-00d9-4864-8b0f-2afadf60efef admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:56.812506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef54118-00d9-4864-8b0f-2afadf60efef admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:56.817199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a823f3-2bea-4eda-9473-f971c3742083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:56.817882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a823f3-2bea-4eda-9473-f971c3742083 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.818193 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a823f3-2bea-4eda-9473-f971c3742083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.818445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a823f3-2bea-4eda-9473-f971c3742083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.819172 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a823f3-2bea-4eda-9473-f971c3742083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:56.820790 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a823f3-2bea-4eda-9473-f971c3742083 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:56.830420 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 950/1897] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:47:56.834560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a823f3-2bea-4eda-9473-f971c3742083 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:56.844280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a823f3-2bea-4eda-9473-f971c3742083 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:56.850000 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e7075-489e-4ab4-bbb2-83c4df8fed29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:56.850637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e7075-489e-4ab4-bbb2-83c4df8fed29 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.850956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e7075-489e-4ab4-bbb2-83c4df8fed29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.851239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e7075-489e-4ab4-bbb2-83c4df8fed29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.851959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e7075-489e-4ab4-bbb2-83c4df8fed29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:56.853598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e7075-489e-4ab4-bbb2-83c4df8fed29 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:56.859096 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 948/1898] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:56 2022] POST /identity/v3/projects => generated 393 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:47:56.860057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe43eb1-f1af-478d-a5d0-5beb78a6a246 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:56.869050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 951/1899] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:47:56.870033 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e7075-489e-4ab4-bbb2-83c4df8fed29 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:56.880081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e7075-489e-4ab4-bbb2-83c4df8fed29 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:56.924073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe43eb1-f1af-478d-a5d0-5beb78a6a246 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:56.928996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7128-79b3-4e12-a8e1-6545fe1437ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:56.929674 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7128-79b3-4e12-a8e1-6545fe1437ff admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.929994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7128-79b3-4e12-a8e1-6545fe1437ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.930273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7128-79b3-4e12-a8e1-6545fe1437ff admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.930965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d7128-79b3-4e12-a8e1-6545fe1437ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:56.932993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d7128-79b3-4e12-a8e1-6545fe1437ff admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:56.935691 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cb595-3cb3-4578-b3d6-f743f203a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:56.936590 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cb595-3cb3-4578-b3d6-f743f203a154 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:56.936868 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cb595-3cb3-4578-b3d6-f743f203a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:56.937143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cb595-3cb3-4578-b3d6-f743f203a154 admin admin] PATH_INFO: `/v3/projects/52c6fc1ec30a4d73bcd544c7e148b4a2/users/edbbb27c6283400184605c5ed00f82e1/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:56.960688 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cb595-3cb3-4578-b3d6-f743f203a154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c6fc1ec30a4d73bcd544c7e148b4a2, user_id=edbbb27c6283400184605c5ed00f82e1, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:56.963397 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cb595-3cb3-4578-b3d6-f743f203a154 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:56.974649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:57.044434 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 949/1900] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:56 2022] POST /identity/v3/users => generated 303 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:47:57.048304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7128-79b3-4e12-a8e1-6545fe1437ff admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:57.057627 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7128-79b3-4e12-a8e1-6545fe1437ff admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:57.062239 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac85f6-bc2c-4225-97c8-9fad6bfef96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:57.062874 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac85f6-bc2c-4225-97c8-9fad6bfef96f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:57.063159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac85f6-bc2c-4225-97c8-9fad6bfef96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:57.063489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac85f6-bc2c-4225-97c8-9fad6bfef96f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:57.064265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac85f6-bc2c-4225-97c8-9fad6bfef96f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:57.066506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac85f6-bc2c-4225-97c8-9fad6bfef96f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:57.082734 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 952/1901] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:56 2022] PUT /identity/v3/projects/52c6fc1ec30a4d73bcd544c7e148b4a2/users/edbbb27c6283400184605c5ed00f82e1/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:57.086638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 950/1902] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:47:57.090441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d95577-7e49-4f09-93b8-3409e2e39df9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:57.090826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d95577-7e49-4f09-93b8-3409e2e39df9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:57.091005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d95577-7e49-4f09-93b8-3409e2e39df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:57.092690 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac85f6-bc2c-4225-97c8-9fad6bfef96f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:57.103332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac85f6-bc2c-4225-97c8-9fad6bfef96f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:57.157858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-78d95577-7e49-4f09-93b8-3409e2e39df9 None None] MFA Rules not processed for user `edbbb27c6283400184605c5ed00f82e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:57.159473 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-78d95577-7e49-4f09-93b8-3409e2e39df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:57.175081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92204c2e-b9c7-4084-9a5b-b7a8a901a108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:57.176142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92204c2e-b9c7-4084-9a5b-b7a8a901a108 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:57.177033 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92204c2e-b9c7-4084-9a5b-b7a8a901a108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:57.177332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92204c2e-b9c7-4084-9a5b-b7a8a901a108 admin admin] PATH_INFO: `/v3/projects/9dd25fc358aa488cb56c318cb7b038ac/users/a0c2b2fa9f8a447fb654cc119da531f8/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:57.200538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92204c2e-b9c7-4084-9a5b-b7a8a901a108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd25fc358aa488cb56c318cb7b038ac, user_id=a0c2b2fa9f8a447fb654cc119da531f8, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:57.204952 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92204c2e-b9c7-4084-9a5b-b7a8a901a108 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:57.261379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 953/1903] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:57.275566 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c5e21-5b01-4516-8fb2-12c30930f321 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:57.276025 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c5e21-5b01-4516-8fb2-12c30930f321 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:57.276406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c5e21-5b01-4516-8fb2-12c30930f321 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:57.278011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 954/1904] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 20 22:47:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:47:57.278753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c5e21-5b01-4516-8fb2-12c30930f321 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:57.292027 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c5e21-5b01-4516-8fb2-12c30930f321 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:57.296631 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e8c46-12d8-4b01-8a8d-2875a53159b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:57.297277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e8c46-12d8-4b01-8a8d-2875a53159b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:57.297564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e8c46-12d8-4b01-8a8d-2875a53159b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:57.297889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e8c46-12d8-4b01-8a8d-2875a53159b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:57.298655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e8c46-12d8-4b01-8a8d-2875a53159b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:57.300839 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e8c46-12d8-4b01-8a8d-2875a53159b0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:57.306710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 951/1905] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:57 2022] PUT /identity/v3/projects/9dd25fc358aa488cb56c318cb7b038ac/users/a0c2b2fa9f8a447fb654cc119da531f8/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:47:57.308173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1763ab3-2fe5-4da7-a4fb-df0574b03456 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:57.308539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1763ab3-2fe5-4da7-a4fb-df0574b03456 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:57.309274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1763ab3-2fe5-4da7-a4fb-df0574b03456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:57.327762 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a1763ab3-2fe5-4da7-a4fb-df0574b03456 None None] MFA Rules not processed for user `67c92c8d2b9d41e489e4c03ae4e71fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:57.332735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a1763ab3-2fe5-4da7-a4fb-df0574b03456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:57.405406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 955/1906] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:57 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:57.405406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e8c46-12d8-4b01-8a8d-2875a53159b0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:57.405901 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 952/1907] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 20 22:47:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:57.406485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1763ab3-2fe5-4da7-a4fb-df0574b03456 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:57.525531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1763ab3-2fe5-4da7-a4fb-df0574b03456 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:57.536782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3e37e-5aae-44ee-aabc-f8129ffc6de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:57.537934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3e37e-5aae-44ee-aabc-f8129ffc6de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:57.538497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3e37e-5aae-44ee-aabc-f8129ffc6de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:57.538939 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f3e37e-5aae-44ee-aabc-f8129ffc6de9 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:57.539060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e8c46-12d8-4b01-8a8d-2875a53159b0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:57.539997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3e37e-5aae-44ee-aabc-f8129ffc6de9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:57.542614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f3e37e-5aae-44ee-aabc-f8129ffc6de9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:57.544606 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6d3fc-c69c-4461-93ea-0915511764a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:57.545658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6d3fc-c69c-4461-93ea-0915511764a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:57.546068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6d3fc-c69c-4461-93ea-0915511764a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:57.546347 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc6d3fc-c69c-4461-93ea-0915511764a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:57.547091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6d3fc-c69c-4461-93ea-0915511764a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:57.548717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc6d3fc-c69c-4461-93ea-0915511764a8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:57.563099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 956/1908] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:57.563970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6d3fc-c69c-4461-93ea-0915511764a8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:57.567822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ecc6d3fc-c69c-4461-93ea-0915511764a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:57.654618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 953/1909] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:57 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:57.656490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3e37e-5aae-44ee-aabc-f8129ffc6de9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:57.669934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f3e37e-5aae-44ee-aabc-f8129ffc6de9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:57.674600 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc6d3fc-c69c-4461-93ea-0915511764a8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:57.677184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e206949-40fd-4011-ade6-d8edef80a124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:57.677184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e206949-40fd-4011-ade6-d8edef80a124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:57.677184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e206949-40fd-4011-ade6-d8edef80a124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:57.677184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e206949-40fd-4011-ade6-d8edef80a124 admin admin] PATH_INFO: `/v3/projects/9dd25fc358aa488cb56c318cb7b038ac/users/a0c2b2fa9f8a447fb654cc119da531f8/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:57.679210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e206949-40fd-4011-ade6-d8edef80a124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd25fc358aa488cb56c318cb7b038ac, user_id=a0c2b2fa9f8a447fb654cc119da531f8, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:57.680335 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1095c5-83ea-40d2-9842-c7b7ab546a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:57.680989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1095c5-83ea-40d2-9842-c7b7ab546a9d service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:57.681274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1095c5-83ea-40d2-9842-c7b7ab546a9d service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:57.681554 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1095c5-83ea-40d2-9842-c7b7ab546a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:57.681912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e206949-40fd-4011-ade6-d8edef80a124 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:57.690773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1095c5-83ea-40d2-9842-c7b7ab546a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:57.692283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1095c5-83ea-40d2-9842-c7b7ab546a9d service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:57.692663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 954/1910] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:57 2022] PUT /identity/v3/projects/9dd25fc358aa488cb56c318cb7b038ac/users/a0c2b2fa9f8a447fb654cc119da531f8/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:57.693437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e206949-40fd-4011-ade6-d8edef80a124 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:57.705299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 957/1911] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:47:57.707787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bb953-b8fb-47c3-ab1f-f7ea68e5e1d7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:57.708144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bb953-b8fb-47c3-ab1f-f7ea68e5e1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:57.708488 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55bb953-b8fb-47c3-ab1f-f7ea68e5e1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:57.752024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a55bb953-b8fb-47c3-ab1f-f7ea68e5e1d7 None None] MFA Rules not processed for user `a0c2b2fa9f8a447fb654cc119da531f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:57.752715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a55bb953-b8fb-47c3-ab1f-f7ea68e5e1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:57.816696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e206949-40fd-4011-ade6-d8edef80a124 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:57.825395 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd79b07-c44e-4f87-a7da-59816fd1676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:57.832364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79b07-c44e-4f87-a7da-59816fd1676c admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:57.832364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79b07-c44e-4f87-a7da-59816fd1676c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:57.832364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79b07-c44e-4f87-a7da-59816fd1676c admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:57.832364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd79b07-c44e-4f87-a7da-59816fd1676c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:57.832364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd79b07-c44e-4f87-a7da-59816fd1676c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:57.859246 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 955/1912] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:57.861077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd79b07-c44e-4f87-a7da-59816fd1676c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:57.881948 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd79b07-c44e-4f87-a7da-59816fd1676c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:57.896587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 958/1913] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:57.902198 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bb953-b8fb-47c3-ab1f-f7ea68e5e1d7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:57.904914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b370e-b9ad-4ee7-baae-8c07dc10eb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:57.905352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a55bb953-b8fb-47c3-ab1f-f7ea68e5e1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:57.906041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b370e-b9ad-4ee7-baae-8c07dc10eb48 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:57.906239 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b370e-b9ad-4ee7-baae-8c07dc10eb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:57.906590 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b370e-b9ad-4ee7-baae-8c07dc10eb48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:57.907578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b370e-b9ad-4ee7-baae-8c07dc10eb48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:57.909873 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b370e-b9ad-4ee7-baae-8c07dc10eb48 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:57.927223 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 956/1914] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:57.928435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b370e-b9ad-4ee7-baae-8c07dc10eb48 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:57.938759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b370e-b9ad-4ee7-baae-8c07dc10eb48 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:57.947425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:57.963458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd40c6-af29-4ade-aa11-8ccd98259dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:57.966005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd40c6-af29-4ade-aa11-8ccd98259dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:57.966319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd40c6-af29-4ade-aa11-8ccd98259dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:57.968714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd40c6-af29-4ade-aa11-8ccd98259dbb admin admin] PATH_INFO: `/v3/projects/734322d5d3674930893f31b94f0445bc/users/c20ede9baf724b6f91bc1fb403e1e6f7/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:57.992326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd40c6-af29-4ade-aa11-8ccd98259dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=734322d5d3674930893f31b94f0445bc, user_id=c20ede9baf724b6f91bc1fb403e1e6f7, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:57.995263 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd40c6-af29-4ade-aa11-8ccd98259dbb admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:58.022943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55bb953-b8fb-47c3-ab1f-f7ea68e5e1d7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:58.027006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07edc7c6-499c-489a-b26d-c5c502bc8629 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:58.027851 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edc7c6-499c-489a-b26d-c5c502bc8629 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:58.028182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edc7c6-499c-489a-b26d-c5c502bc8629 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:58.028538 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07edc7c6-499c-489a-b26d-c5c502bc8629 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:58.048951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edc7c6-499c-489a-b26d-c5c502bc8629 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:58.048951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07edc7c6-499c-489a-b26d-c5c502bc8629 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:58.054860 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 959/1915] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:47:58.087385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 957/1916] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:57 2022] PUT /identity/v3/projects/734322d5d3674930893f31b94f0445bc/users/c20ede9baf724b6f91bc1fb403e1e6f7/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:47:58.088582 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f97ed2-0be4-4472-95ee-8f75eea376e9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:58.088948 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f97ed2-0be4-4472-95ee-8f75eea376e9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:58.089181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f97ed2-0be4-4472-95ee-8f75eea376e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:58.127137 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd40c6-af29-4ade-aa11-8ccd98259dbb admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:58.127404 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c4f97ed2-0be4-4472-95ee-8f75eea376e9 None None] MFA Rules not processed for user `c20ede9baf724b6f91bc1fb403e1e6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:58.129358 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c4f97ed2-0be4-4472-95ee-8f75eea376e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:58.129470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-68bd40c6-af29-4ade-aa11-8ccd98259dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:58.204607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 960/1917] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:58.208218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f97ed2-0be4-4472-95ee-8f75eea376e9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:58.209747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd40c6-af29-4ade-aa11-8ccd98259dbb admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:58.213794 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f485ad1-a648-45eb-9335-23c957c5a4a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:58.214575 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485ad1-a648-45eb-9335-23c957c5a4a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:58.214939 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485ad1-a648-45eb-9335-23c957c5a4a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:58.215294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f485ad1-a648-45eb-9335-23c957c5a4a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:58.311803 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f485ad1-a648-45eb-9335-23c957c5a4a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:58.313265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f485ad1-a648-45eb-9335-23c957c5a4a8 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:58.325167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f97ed2-0be4-4472-95ee-8f75eea376e9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:58.334613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 958/1918] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:47:58.336035 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370723b3-6669-42f6-81c8-dd2f29a0e7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:58.344490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370723b3-6669-42f6-81c8-dd2f29a0e7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:58.344490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370723b3-6669-42f6-81c8-dd2f29a0e7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:58.344490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370723b3-6669-42f6-81c8-dd2f29a0e7f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:58.344490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370723b3-6669-42f6-81c8-dd2f29a0e7f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:58.344490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370723b3-6669-42f6-81c8-dd2f29a0e7f5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:58.469792 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 961/1919] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:47:58 2022] POST /identity/v3/projects => generated 385 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:58.476001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f485ad1-a648-45eb-9335-23c957c5a4a8 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:58.486761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f485ad1-a648-45eb-9335-23c957c5a4a8 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:58.573514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5ad1f-e41a-4a14-8e11-0bfbe1a4a00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:58.574250 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5ad1f-e41a-4a14-8e11-0bfbe1a4a00c admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:58.574536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5ad1f-e41a-4a14-8e11-0bfbe1a4a00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:58.574813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5ad1f-e41a-4a14-8e11-0bfbe1a4a00c admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:58.575504 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5ad1f-e41a-4a14-8e11-0bfbe1a4a00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:58.577425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5ad1f-e41a-4a14-8e11-0bfbe1a4a00c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:58.665793 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 959/1920] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:47:58 2022] POST /identity/v3/users => generated 299 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:47:58.669867 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370723b3-6669-42f6-81c8-dd2f29a0e7f5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:58.682583 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370723b3-6669-42f6-81c8-dd2f29a0e7f5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:58.688306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8583b-f820-4efb-98f9-77166a600164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:58.689074 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8583b-f820-4efb-98f9-77166a600164 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:58.689295 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8583b-f820-4efb-98f9-77166a600164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:58.691044 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8583b-f820-4efb-98f9-77166a600164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:58.691044 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8583b-f820-4efb-98f9-77166a600164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:58.692958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8583b-f820-4efb-98f9-77166a600164 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:58.700069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:47:58.709565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 962/1921] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:58.714020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5ad1f-e41a-4a14-8e11-0bfbe1a4a00c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:58.729150 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5ad1f-e41a-4a14-8e11-0bfbe1a4a00c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:58.734951 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6dca3-14a8-456a-a381-0a08366af8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:58.736344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6dca3-14a8-456a-a381-0a08366af8e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:58.737670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6dca3-14a8-456a-a381-0a08366af8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:58.743020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6dca3-14a8-456a-a381-0a08366af8e9 admin admin] PATH_INFO: `/v3/projects/314edd9a37ba4fef9dc8fb281baed802/users/61c8a7540c25404ba1d6a3a5784a8837/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:58.756366 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6dca3-14a8-456a-a381-0a08366af8e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=314edd9a37ba4fef9dc8fb281baed802, user_id=61c8a7540c25404ba1d6a3a5784a8837, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:58.760261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6dca3-14a8-456a-a381-0a08366af8e9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:58.891770 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 960/1922] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:58 2022] PUT /identity/v3/projects/314edd9a37ba4fef9dc8fb281baed802/users/61c8a7540c25404ba1d6a3a5784a8837/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:58.896145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8583b-f820-4efb-98f9-77166a600164 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:58.906041 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8583b-f820-4efb-98f9-77166a600164 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:58.968816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757b5ca-098f-4383-99f5-02c5b0f14f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:58.969421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757b5ca-098f-4383-99f5-02c5b0f14f5a admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:58.969850 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757b5ca-098f-4383-99f5-02c5b0f14f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:58.970013 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757b5ca-098f-4383-99f5-02c5b0f14f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:58.970753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757b5ca-098f-4383-99f5-02c5b0f14f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:58.973944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757b5ca-098f-4383-99f5-02c5b0f14f5a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:58.984258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 963/1923] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:47:58.988901 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6dca3-14a8-456a-a381-0a08366af8e9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:59.000362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6dca3-14a8-456a-a381-0a08366af8e9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:59.005424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362551d-e4ae-4284-a254-fe6ef964e462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:59.009478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362551d-e4ae-4284-a254-fe6ef964e462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:59.009478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362551d-e4ae-4284-a254-fe6ef964e462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:59.009478 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362551d-e4ae-4284-a254-fe6ef964e462 admin admin] PATH_INFO: `/v3/projects/314edd9a37ba4fef9dc8fb281baed802/users/61c8a7540c25404ba1d6a3a5784a8837/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:59.009788 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362551d-e4ae-4284-a254-fe6ef964e462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=314edd9a37ba4fef9dc8fb281baed802, user_id=61c8a7540c25404ba1d6a3a5784a8837, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:59.012278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362551d-e4ae-4284-a254-fe6ef964e462 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:59.036095 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 961/1924] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:47:58 2022] PUT /identity/v3/projects/314edd9a37ba4fef9dc8fb281baed802/users/61c8a7540c25404ba1d6a3a5784a8837/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:47:59.046563 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e971-7d07-4301-bd7e-3d1c52af710e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:59.046843 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e971-7d07-4301-bd7e-3d1c52af710e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:59.047127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25e971-7d07-4301-bd7e-3d1c52af710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:59.086146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-dd25e971-7d07-4301-bd7e-3d1c52af710e None None] MFA Rules not processed for user `61c8a7540c25404ba1d6a3a5784a8837`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:47:59.086949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dd25e971-7d07-4301-bd7e-3d1c52af710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:47:59.200844 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 964/1925] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:47:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:47:59.327275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362551d-e4ae-4284-a254-fe6ef964e462 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:47:59.385473 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362551d-e4ae-4284-a254-fe6ef964e462 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:47:59.389136 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a1ab8-6a7e-47bd-a126-216ea22a133b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:47:59.390435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a1ab8-6a7e-47bd-a126-216ea22a133b service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:47:59.390435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a1ab8-6a7e-47bd-a126-216ea22a133b service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:47:59.390435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a1ab8-6a7e-47bd-a126-216ea22a133b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:47:59.399524 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a1ab8-6a7e-47bd-a126-216ea22a133b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:47:59.401035 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a1ab8-6a7e-47bd-a126-216ea22a133b service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:47:59.411643 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 962/1926] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:47:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:48:00.669031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25e971-7d07-4301-bd7e-3d1c52af710e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:00.694718 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25e971-7d07-4301-bd7e-3d1c52af710e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:00.698853 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fc6c3-f866-4472-97f8-73f7684b7be3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:00.699799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fc6c3-f866-4472-97f8-73f7684b7be3 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:00.701330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fc6c3-f866-4472-97f8-73f7684b7be3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:00.701782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fc6c3-f866-4472-97f8-73f7684b7be3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:00.708946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:00.778474 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fc6c3-f866-4472-97f8-73f7684b7be3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:00.780287 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fc6c3-f866-4472-97f8-73f7684b7be3 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:00.791740 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 965/1927] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:01.558508 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:03.032523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:03.226929 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:04.158509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:04.232850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:04.566687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a1ab8-6a7e-47bd-a126-216ea22a133b service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:04.687759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a1ab8-6a7e-47bd-a126-216ea22a133b service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:04.703348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ca015-7cab-4d26-81f8-a37b9eb70e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:04.705026 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ca015-7cab-4d26-81f8-a37b9eb70e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:04.705466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ca015-7cab-4d26-81f8-a37b9eb70e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:04.707501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ca015-7cab-4d26-81f8-a37b9eb70e75 admin admin] PATH_INFO: `/v3/users/c87773534569433b9da1c0369aba2d53` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:04.709234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ca015-7cab-4d26-81f8-a37b9eb70e75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c87773534569433b9da1c0369aba2d53)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:04.713018 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ca015-7cab-4d26-81f8-a37b9eb70e75 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:04.960520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-583ca015-7cab-4d26-81f8-a37b9eb70e75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c87773534569433b9da1c0369aba2d53'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:05.020483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:05.026900 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-583ca015-7cab-4d26-81f8-a37b9eb70e75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c87773534569433b9da1c0369aba2d53'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:05.028526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-583ca015-7cab-4d26-81f8-a37b9eb70e75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c87773534569433b9da1c0369aba2d53'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:05.056364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-583ca015-7cab-4d26-81f8-a37b9eb70e75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c87773534569433b9da1c0369aba2d53'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:05.056825 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-583ca015-7cab-4d26-81f8-a37b9eb70e75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c87773534569433b9da1c0369aba2d53'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:05.077638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 963/1928] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:04 2022] DELETE /identity/v3/users/c87773534569433b9da1c0369aba2d53 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:48:05.091538 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9c732-5539-4d67-ad19-3f8724b7d258 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:05.091912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9c732-5539-4d67-ad19-3f8724b7d258 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:05.092266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9c732-5539-4d67-ad19-3f8724b7d258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:05.116522 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-26b9c732-5539-4d67-ad19-3f8724b7d258 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:05.118143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-26b9c732-5539-4d67-ad19-3f8724b7d258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:05.212665 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 966/1929] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:05.223090 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ca015-7cab-4d26-81f8-a37b9eb70e75 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:05.224526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-583ca015-7cab-4d26-81f8-a37b9eb70e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:05.297707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ca015-7cab-4d26-81f8-a37b9eb70e75 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:05.301933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af6402-4997-4fd1-82d0-25edb9dee9cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:05.302800 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af6402-4997-4fd1-82d0-25edb9dee9cc service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:05.303111 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af6402-4997-4fd1-82d0-25edb9dee9cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:05.303492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af6402-4997-4fd1-82d0-25edb9dee9cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:05.321453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af6402-4997-4fd1-82d0-25edb9dee9cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:05.323290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af6402-4997-4fd1-82d0-25edb9dee9cc service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:05.338890 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 964/1930] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:05.759454 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:06.086988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9c732-5539-4d67-ad19-3f8724b7d258 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:06.088572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-26b9c732-5539-4d67-ad19-3f8724b7d258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:06.110082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9c732-5539-4d67-ad19-3f8724b7d258 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:06.156034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:06.157307 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:06.160599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:06.160599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] PATH_INFO: `/v3/projects/4cc46c8e04db43ffbcd7e0618ac09773` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:06.161590 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc46c8e04db43ffbcd7e0618ac09773)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:06.163643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:06.239408 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:06.341143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc46c8e04db43ffbcd7e0618ac09773', 'request_id': 'req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:06.437910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc46c8e04db43ffbcd7e0618ac09773', 'request_id': 'req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:06.453475 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc46c8e04db43ffbcd7e0618ac09773', 'request_id': 'req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:06.467976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] The token cache is being invalidate because project 4cc46c8e04db43ffbcd7e0618ac09773 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:06.468272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:06.468982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:06.471165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 967/1931] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:06 2022] DELETE /identity/v3/projects/4cc46c8e04db43ffbcd7e0618ac09773 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:06.475896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af6402-4997-4fd1-82d0-25edb9dee9cc service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:06.487498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af6402-4997-4fd1-82d0-25edb9dee9cc service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:06.617545 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bbe7a-c7a6-435f-bd0c-7bd819efed2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:06.618704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bbe7a-c7a6-435f-bd0c-7bd819efed2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:06.619001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bbe7a-c7a6-435f-bd0c-7bd819efed2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:06.619278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bbe7a-c7a6-435f-bd0c-7bd819efed2e admin admin] PATH_INFO: `/v3/users/a0c2b2fa9f8a447fb654cc119da531f8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:06.622735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bbe7a-c7a6-435f-bd0c-7bd819efed2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0c2b2fa9f8a447fb654cc119da531f8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:06.639816 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bbe7a-c7a6-435f-bd0c-7bd819efed2e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:06.793027 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:06.982260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e49bbe7a-c7a6-435f-bd0c-7bd819efed2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0c2b2fa9f8a447fb654cc119da531f8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:07.017653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:07.019818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:07.038809 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:07.046628 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e49bbe7a-c7a6-435f-bd0c-7bd819efed2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0c2b2fa9f8a447fb654cc119da531f8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:07.047297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e49bbe7a-c7a6-435f-bd0c-7bd819efed2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0c2b2fa9f8a447fb654cc119da531f8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:07.062054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e49bbe7a-c7a6-435f-bd0c-7bd819efed2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0c2b2fa9f8a447fb654cc119da531f8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:07.065934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e49bbe7a-c7a6-435f-bd0c-7bd819efed2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0c2b2fa9f8a447fb654cc119da531f8'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:07.103913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 965/1932] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:06 2022] DELETE /identity/v3/users/a0c2b2fa9f8a447fb654cc119da531f8 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:07.124355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45a7abd-cb0a-4bcb-9f52-e823dc7a8911 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:07.195837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d6c66-72f9-4b49-902a-e7586a5998c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:07.196522 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d6c66-72f9-4b49-902a-e7586a5998c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:07.197527 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d6c66-72f9-4b49-902a-e7586a5998c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:07.198041 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d6c66-72f9-4b49-902a-e7586a5998c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:07.200177 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b14d6c66-72f9-4b49-902a-e7586a5998c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:07.273362 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d6c66-72f9-4b49-902a-e7586a5998c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:07.275395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d6c66-72f9-4b49-902a-e7586a5998c4 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:07.291598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 968/1933] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:48:07.623398 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bbe7a-c7a6-435f-bd0c-7bd819efed2e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:07.625556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e49bbe7a-c7a6-435f-bd0c-7bd819efed2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:07.733348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bbe7a-c7a6-435f-bd0c-7bd819efed2e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:07.744291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518be825-154b-45db-bd85-8e325a506e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:07.745300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518be825-154b-45db-bd85-8e325a506e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:07.745652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518be825-154b-45db-bd85-8e325a506e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:07.746199 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518be825-154b-45db-bd85-8e325a506e92 admin admin] PATH_INFO: `/v3/projects/9dd25fc358aa488cb56c318cb7b038ac` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:07.747712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518be825-154b-45db-bd85-8e325a506e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd25fc358aa488cb56c318cb7b038ac)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:07.749698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518be825-154b-45db-bd85-8e325a506e92 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:07.754120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:07.906986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-518be825-154b-45db-bd85-8e325a506e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd25fc358aa488cb56c318cb7b038ac', 'request_id': 'req-518be825-154b-45db-bd85-8e325a506e92'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:08.003534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-518be825-154b-45db-bd85-8e325a506e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd25fc358aa488cb56c318cb7b038ac', 'request_id': 'req-518be825-154b-45db-bd85-8e325a506e92'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:08.011064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-518be825-154b-45db-bd85-8e325a506e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd25fc358aa488cb56c318cb7b038ac', 'request_id': 'req-518be825-154b-45db-bd85-8e325a506e92'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:08.013831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:08.025170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-518be825-154b-45db-bd85-8e325a506e92 admin admin] The token cache is being invalidate because project 9dd25fc358aa488cb56c318cb7b038ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:08.025466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-518be825-154b-45db-bd85-8e325a506e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:08.026152 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-518be825-154b-45db-bd85-8e325a506e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:08.027840 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 966/1934] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:07 2022] DELETE /identity/v3/projects/9dd25fc358aa488cb56c318cb7b038ac => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:08.033364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78129f3-7486-4c3a-8e28-ee20dcceb975 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:08.033825 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78129f3-7486-4c3a-8e28-ee20dcceb975 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:08.034135 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78129f3-7486-4c3a-8e28-ee20dcceb975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:08.052657 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a78129f3-7486-4c3a-8e28-ee20dcceb975 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:08.053899 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a78129f3-7486-4c3a-8e28-ee20dcceb975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:08.113196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 969/1935] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:08.120961 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c62c0-bef6-4c9b-ad36-fc71e6a6cbc5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:08.121257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c62c0-bef6-4c9b-ad36-fc71e6a6cbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:08.121543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c62c0-bef6-4c9b-ad36-fc71e6a6cbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:08.144333 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b59c62c0-bef6-4c9b-ad36-fc71e6a6cbc5 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:08.145758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b59c62c0-bef6-4c9b-ad36-fc71e6a6cbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:08.154442 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 967/1936] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:08.158770 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78129f3-7486-4c3a-8e28-ee20dcceb975 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:08.170786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78129f3-7486-4c3a-8e28-ee20dcceb975 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:08.176370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfbe93-74f4-4ee3-b87b-6693182c2360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:08.177127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfbe93-74f4-4ee3-b87b-6693182c2360 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:08.177419 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfbe93-74f4-4ee3-b87b-6693182c2360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:08.177701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfbe93-74f4-4ee3-b87b-6693182c2360 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:08.178469 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfbe93-74f4-4ee3-b87b-6693182c2360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:08.180247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfbe93-74f4-4ee3-b87b-6693182c2360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:08.180480 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cfbe93-74f4-4ee3-b87b-6693182c2360 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:08.197020 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 970/1937] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:08.198210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c62c0-bef6-4c9b-ad36-fc71e6a6cbc5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:08.207905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c62c0-bef6-4c9b-ad36-fc71e6a6cbc5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:08.214112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21e1b1-7e1f-4b50-aa7d-4316d1f6cfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:08.216986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21e1b1-7e1f-4b50-aa7d-4316d1f6cfdb admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:08.216986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21e1b1-7e1f-4b50-aa7d-4316d1f6cfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:08.216986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21e1b1-7e1f-4b50-aa7d-4316d1f6cfdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:08.216986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21e1b1-7e1f-4b50-aa7d-4316d1f6cfdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:08.218133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21e1b1-7e1f-4b50-aa7d-4316d1f6cfdb admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:08.312489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 968/1938] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:08 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:48:08.316613 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfbe93-74f4-4ee3-b87b-6693182c2360 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:08.326725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfbe93-74f4-4ee3-b87b-6693182c2360 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:08.386272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226a019-7611-42bc-8873-195a54957cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:08.386948 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a019-7611-42bc-8873-195a54957cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:08.387233 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a019-7611-42bc-8873-195a54957cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:08.387516 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1226a019-7611-42bc-8873-195a54957cfb admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:08.388203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226a019-7611-42bc-8873-195a54957cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:08.390534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1226a019-7611-42bc-8873-195a54957cfb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:08.464845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 971/1939] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:08 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:08.466044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21e1b1-7e1f-4b50-aa7d-4316d1f6cfdb admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:08.478787 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21e1b1-7e1f-4b50-aa7d-4316d1f6cfdb admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:08.483630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb489414-5b71-4d3d-bb01-540eb3f329be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:08.484306 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb489414-5b71-4d3d-bb01-540eb3f329be admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:08.484593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb489414-5b71-4d3d-bb01-540eb3f329be admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:08.484881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb489414-5b71-4d3d-bb01-540eb3f329be admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:08.485679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb489414-5b71-4d3d-bb01-540eb3f329be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:08.488095 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb489414-5b71-4d3d-bb01-540eb3f329be admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:08.502297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 969/1940] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:08.503904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226a019-7611-42bc-8873-195a54957cfb admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:08.514170 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1226a019-7611-42bc-8873-195a54957cfb admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:08.518968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501637c6-93a8-4285-bff6-41993bc0b2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:08.519667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501637c6-93a8-4285-bff6-41993bc0b2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:08.519953 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501637c6-93a8-4285-bff6-41993bc0b2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:08.520234 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501637c6-93a8-4285-bff6-41993bc0b2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:08.520968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501637c6-93a8-4285-bff6-41993bc0b2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:08.522609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501637c6-93a8-4285-bff6-41993bc0b2cd admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:08.532456 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 972/1941] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:08.537661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb489414-5b71-4d3d-bb01-540eb3f329be admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:08.548049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb489414-5b71-4d3d-bb01-540eb3f329be admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:08.554144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4c7de-4b93-415e-a922-32c51c56925e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:08.555070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4c7de-4b93-415e-a922-32c51c56925e admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:08.555336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4c7de-4b93-415e-a922-32c51c56925e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:08.555618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4c7de-4b93-415e-a922-32c51c56925e admin admin] PATH_INFO: `/v3/projects/d195a100e3e746a39ea2305e7d833604/users/6a2bf8fadf3d47b380c5b66e869b2275/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:08.570750 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4c7de-4b93-415e-a922-32c51c56925e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d195a100e3e746a39ea2305e7d833604, user_id=6a2bf8fadf3d47b380c5b66e869b2275, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:08.573443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4c7de-4b93-415e-a922-32c51c56925e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:08.694283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 970/1942] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:08 2022] PUT /identity/v3/projects/d195a100e3e746a39ea2305e7d833604/users/6a2bf8fadf3d47b380c5b66e869b2275/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:08.705298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034c4cc-bd7f-4f8a-9550-fea0c31ab42e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:08.706791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034c4cc-bd7f-4f8a-9550-fea0c31ab42e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:08.707081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3034c4cc-bd7f-4f8a-9550-fea0c31ab42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:08.734049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3034c4cc-bd7f-4f8a-9550-fea0c31ab42e None None] MFA Rules not processed for user `6a2bf8fadf3d47b380c5b66e869b2275`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:08.735176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3034c4cc-bd7f-4f8a-9550-fea0c31ab42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:08.804777 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 973/1943] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:48:08.809319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4c7de-4b93-415e-a922-32c51c56925e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:08.872855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:08.877163 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4c7de-4b93-415e-a922-32c51c56925e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:08.882223 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371d468-4a19-48e0-a04c-7abbcc99c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:08.882913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371d468-4a19-48e0-a04c-7abbcc99c8ff admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:08.883214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371d468-4a19-48e0-a04c-7abbcc99c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:08.883479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371d468-4a19-48e0-a04c-7abbcc99c8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:08.884187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371d468-4a19-48e0-a04c-7abbcc99c8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:08.886127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371d468-4a19-48e0-a04c-7abbcc99c8ff admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:09.021787 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 971/1944] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:08 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:09.022358 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034c4cc-bd7f-4f8a-9550-fea0c31ab42e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:09.022825 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371d468-4a19-48e0-a04c-7abbcc99c8ff admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:09.023938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3034c4cc-bd7f-4f8a-9550-fea0c31ab42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:09.040348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3034c4cc-bd7f-4f8a-9550-fea0c31ab42e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:09.097385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:09.104605 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371d468-4a19-48e0-a04c-7abbcc99c8ff admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:09.109667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da8149-c0e2-4886-a975-700f5989c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:09.110374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da8149-c0e2-4886-a975-700f5989c932 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:09.110657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da8149-c0e2-4886-a975-700f5989c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:09.111160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da8149-c0e2-4886-a975-700f5989c932 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:09.111861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da8149-c0e2-4886-a975-700f5989c932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:09.114059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70da8149-c0e2-4886-a975-700f5989c932 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:09.144393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e03128-4f2a-46b3-a0db-a954cf2b412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:09.145037 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03128-4f2a-46b3-a0db-a954cf2b412a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:09.145327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03128-4f2a-46b3-a0db-a954cf2b412a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:09.145609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e03128-4f2a-46b3-a0db-a954cf2b412a admin admin] PATH_INFO: `/v3/users/6319d6181e174f01808bc5fd90a90307` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:09.146914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e03128-4f2a-46b3-a0db-a954cf2b412a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6319d6181e174f01808bc5fd90a90307)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:09.148998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e03128-4f2a-46b3-a0db-a954cf2b412a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:09.193485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 972/1945] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:09 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:09.197241 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da8149-c0e2-4886-a975-700f5989c932 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:09.208294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da8149-c0e2-4886-a975-700f5989c932 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:09.212860 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af53c40-07cb-4e36-84d9-afd8b78a19b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:09.213559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53c40-07cb-4e36-84d9-afd8b78a19b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:09.213854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53c40-07cb-4e36-84d9-afd8b78a19b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:09.214133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af53c40-07cb-4e36-84d9-afd8b78a19b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:09.214887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af53c40-07cb-4e36-84d9-afd8b78a19b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:09.216473 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af53c40-07cb-4e36-84d9-afd8b78a19b7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:09.226391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 973/1946] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:48:09.230640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af53c40-07cb-4e36-84d9-afd8b78a19b7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:09.239750 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af53c40-07cb-4e36-84d9-afd8b78a19b7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:09.244335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc0b2c-1590-4d31-8d59-d828c91de302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:09.245129 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc0b2c-1590-4d31-8d59-d828c91de302 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:09.245412 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc0b2c-1590-4d31-8d59-d828c91de302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:09.245682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc0b2c-1590-4d31-8d59-d828c91de302 admin admin] PATH_INFO: `/v3/projects/71d5310e06854c9f907a5ccd159a720c/users/26489bcc1ce94784acc83f3a3e003112/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:09.260723 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc0b2c-1590-4d31-8d59-d828c91de302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d5310e06854c9f907a5ccd159a720c, user_id=26489bcc1ce94784acc83f3a3e003112, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:09.263391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc0b2c-1590-4d31-8d59-d828c91de302 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:09.303070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f4e03128-4f2a-46b3-a0db-a954cf2b412a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6319d6181e174f01808bc5fd90a90307'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:09.303754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f4e03128-4f2a-46b3-a0db-a954cf2b412a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6319d6181e174f01808bc5fd90a90307'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:09.304367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f4e03128-4f2a-46b3-a0db-a954cf2b412a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6319d6181e174f01808bc5fd90a90307'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:09.317010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f4e03128-4f2a-46b3-a0db-a954cf2b412a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6319d6181e174f01808bc5fd90a90307'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:09.323811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f4e03128-4f2a-46b3-a0db-a954cf2b412a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6319d6181e174f01808bc5fd90a90307'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:09.360464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 974/1947] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:09 2022] PUT /identity/v3/projects/71d5310e06854c9f907a5ccd159a720c/users/26489bcc1ce94784acc83f3a3e003112/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:48:09.365315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc0b2c-1590-4d31-8d59-d828c91de302 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:09.369500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3ffc0b2c-1590-4d31-8d59-d828c91de302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:09.418079 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 974/1948] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:09 2022] DELETE /identity/v3/users/6319d6181e174f01808bc5fd90a90307 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:09.422824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b6180-d459-4970-9c99-d99d71fee039 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:09.423316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b6180-d459-4970-9c99-d99d71fee039 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:09.423664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5b6180-d459-4970-9c99-d99d71fee039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:09.442550 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-dc5b6180-d459-4970-9c99-d99d71fee039 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:09.443756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dc5b6180-d459-4970-9c99-d99d71fee039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:09.446162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc0b2c-1590-4d31-8d59-d828c91de302 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:09.507374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd811019-b568-4c94-b7db-577ca7e3fb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:09.508020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd811019-b568-4c94-b7db-577ca7e3fb5b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:09.508302 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd811019-b568-4c94-b7db-577ca7e3fb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:09.508623 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd811019-b568-4c94-b7db-577ca7e3fb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:09.509360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd811019-b568-4c94-b7db-577ca7e3fb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:09.511014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd811019-b568-4c94-b7db-577ca7e3fb5b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:09.516226 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 975/1949] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:09.525600 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 975/1950] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:09.526866 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b6180-d459-4970-9c99-d99d71fee039 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:09.526978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd811019-b568-4c94-b7db-577ca7e3fb5b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:09.528843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dd811019-b568-4c94-b7db-577ca7e3fb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:09.538388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5b6180-d459-4970-9c99-d99d71fee039 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:09.546005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c1ce9-7db7-4f2e-86b2-391d2b9c5b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:09.546005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c1ce9-7db7-4f2e-86b2-391d2b9c5b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:09.546005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c1ce9-7db7-4f2e-86b2-391d2b9c5b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:09.546005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c1ce9-7db7-4f2e-86b2-391d2b9c5b35 admin admin] PATH_INFO: `/v3/projects/71d5310e06854c9f907a5ccd159a720c/users/26489bcc1ce94784acc83f3a3e003112/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:09.552748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c1ce9-7db7-4f2e-86b2-391d2b9c5b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d5310e06854c9f907a5ccd159a720c, user_id=26489bcc1ce94784acc83f3a3e003112, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:09.555632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c1ce9-7db7-4f2e-86b2-391d2b9c5b35 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:09.567327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 976/1951] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:09 2022] PUT /identity/v3/projects/71d5310e06854c9f907a5ccd159a720c/users/26489bcc1ce94784acc83f3a3e003112/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:48:09.577870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874fe8-8cf3-42a8-b6b2-68d0c82b088f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:09.578175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874fe8-8cf3-42a8-b6b2-68d0c82b088f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:09.578478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b874fe8-8cf3-42a8-b6b2-68d0c82b088f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:09.589299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd811019-b568-4c94-b7db-577ca7e3fb5b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:09.607467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-5b874fe8-8cf3-42a8-b6b2-68d0c82b088f None None] MFA Rules not processed for user `26489bcc1ce94784acc83f3a3e003112`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:09.608852 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5b874fe8-8cf3-42a8-b6b2-68d0c82b088f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:09.636601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:09.645658 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc5ffb-91d8-4ddd-bc92-ff03c9057a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:09.646346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc5ffb-91d8-4ddd-bc92-ff03c9057a3f service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:09.646631 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc5ffb-91d8-4ddd-bc92-ff03c9057a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:09.647526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc5ffb-91d8-4ddd-bc92-ff03c9057a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:09.694007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 977/1952] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:48:09.706222 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b874fe8-8cf3-42a8-b6b2-68d0c82b088f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:09.707721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5b874fe8-8cf3-42a8-b6b2-68d0c82b088f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:09.714439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc5ffb-91d8-4ddd-bc92-ff03c9057a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:09.716056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc5ffb-91d8-4ddd-bc92-ff03c9057a3f service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:09.729045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 976/1953] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:48:09.738351 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:09.780146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b874fe8-8cf3-42a8-b6b2-68d0c82b088f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:09.780146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc3b27-5f60-4d1e-ac1a-4ede66339e2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:09.780146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc3b27-5f60-4d1e-ac1a-4ede66339e2b service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:09.780666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc3b27-5f60-4d1e-ac1a-4ede66339e2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:09.780666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc3b27-5f60-4d1e-ac1a-4ede66339e2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:09.782292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-30cc3b27-5f60-4d1e-ac1a-4ede66339e2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:09.850082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc3b27-5f60-4d1e-ac1a-4ede66339e2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:09.851526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc3b27-5f60-4d1e-ac1a-4ede66339e2b service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:09.861045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 978/1954] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:10.325922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc5ffb-91d8-4ddd-bc92-ff03c9057a3f service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:10.327499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ddbc5ffb-91d8-4ddd-bc92-ff03c9057a3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:10.350005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc5ffb-91d8-4ddd-bc92-ff03c9057a3f service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:10.354812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:10.355847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:10.356136 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:10.359588 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] PATH_INFO: `/v3/projects/21d33326e5fd4e9680b8f970858a0e91` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:10.359588 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d33326e5fd4e9680b8f970858a0e91)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:10.360498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:10.468700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:10.489190 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d33326e5fd4e9680b8f970858a0e91', 'request_id': 'req-ed30188b-9b27-4b52-8d3b-9a676ac60de1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:10.585439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d33326e5fd4e9680b8f970858a0e91', 'request_id': 'req-ed30188b-9b27-4b52-8d3b-9a676ac60de1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:10.592652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d33326e5fd4e9680b8f970858a0e91', 'request_id': 'req-ed30188b-9b27-4b52-8d3b-9a676ac60de1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:10.621597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] The token cache is being invalidate because project 21d33326e5fd4e9680b8f970858a0e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:10.621954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:10.622584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:10.624203 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 977/1955] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:10 2022] DELETE /identity/v3/projects/21d33326e5fd4e9680b8f970858a0e91 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:10.628199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc3b27-5f60-4d1e-ac1a-4ede66339e2b service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:10.640331 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc3b27-5f60-4d1e-ac1a-4ede66339e2b service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:10.726182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b644409-6636-49b2-87f1-b4e0ff9aad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:10.726859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b644409-6636-49b2-87f1-b4e0ff9aad11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:10.727241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b644409-6636-49b2-87f1-b4e0ff9aad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:10.727459 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b644409-6636-49b2-87f1-b4e0ff9aad11 admin admin] PATH_INFO: `/v3/users/3cba37fca5ec4f56a10da1428d0bbbff` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:10.728748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b644409-6636-49b2-87f1-b4e0ff9aad11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cba37fca5ec4f56a10da1428d0bbbff)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:10.730766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b644409-6636-49b2-87f1-b4e0ff9aad11 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:10.887206 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:10.904028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1b644409-6636-49b2-87f1-b4e0ff9aad11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cba37fca5ec4f56a10da1428d0bbbff'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:10.906354 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1b644409-6636-49b2-87f1-b4e0ff9aad11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cba37fca5ec4f56a10da1428d0bbbff'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:10.906354 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1b644409-6636-49b2-87f1-b4e0ff9aad11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cba37fca5ec4f56a10da1428d0bbbff'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:10.921133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1b644409-6636-49b2-87f1-b4e0ff9aad11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cba37fca5ec4f56a10da1428d0bbbff'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:10.936923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1b644409-6636-49b2-87f1-b4e0ff9aad11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cba37fca5ec4f56a10da1428d0bbbff'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:11.011751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 979/1956] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:10 2022] DELETE /identity/v3/users/3cba37fca5ec4f56a10da1428d0bbbff => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:11.462772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:11.464938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:11.481125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30188b-9b27-4b52-8d3b-9a676ac60de1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:11.545680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6a196-6082-4990-b44b-f7e23eae7414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:11.546787 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6a196-6082-4990-b44b-f7e23eae7414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:11.547259 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6a196-6082-4990-b44b-f7e23eae7414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:11.547541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6a196-6082-4990-b44b-f7e23eae7414 admin admin] PATH_INFO: `/v3/projects/7981bce36b8b43f2a4dc18ac530165b2` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:11.548937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6a196-6082-4990-b44b-f7e23eae7414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7981bce36b8b43f2a4dc18ac530165b2)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:11.551657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6a196-6082-4990-b44b-f7e23eae7414 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:11.679776 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e7a6a196-6082-4990-b44b-f7e23eae7414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7981bce36b8b43f2a4dc18ac530165b2', 'request_id': 'req-e7a6a196-6082-4990-b44b-f7e23eae7414'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:11.695187 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:11.763512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e7a6a196-6082-4990-b44b-f7e23eae7414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7981bce36b8b43f2a4dc18ac530165b2', 'request_id': 'req-e7a6a196-6082-4990-b44b-f7e23eae7414'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:11.771488 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e7a6a196-6082-4990-b44b-f7e23eae7414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7981bce36b8b43f2a4dc18ac530165b2', 'request_id': 'req-e7a6a196-6082-4990-b44b-f7e23eae7414'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:11.800962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e7a6a196-6082-4990-b44b-f7e23eae7414 admin admin] The token cache is being invalidate because project 7981bce36b8b43f2a4dc18ac530165b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:11.801269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e7a6a196-6082-4990-b44b-f7e23eae7414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:11.802390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e7a6a196-6082-4990-b44b-f7e23eae7414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:11.804360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 978/1957] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:11 2022] DELETE /identity/v3/projects/7981bce36b8b43f2a4dc18ac530165b2 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:11.809347 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563056-ec32-45c9-9b47-189af3e99294 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:11.809825 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563056-ec32-45c9-9b47-189af3e99294 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:11.810126 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563056-ec32-45c9-9b47-189af3e99294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:11.840857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a1563056-ec32-45c9-9b47-189af3e99294 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:11.842122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a1563056-ec32-45c9-9b47-189af3e99294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:11.912003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 980/1958] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:11.912224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:11.913810 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8af3eb-b32f-4ef9-97f8-3b56e528b43d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:11.914111 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8af3eb-b32f-4ef9-97f8-3b56e528b43d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:11.914444 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8af3eb-b32f-4ef9-97f8-3b56e528b43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:11.933612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ed8af3eb-b32f-4ef9-97f8-3b56e528b43d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:11.934896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ed8af3eb-b32f-4ef9-97f8-3b56e528b43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:11.943248 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 979/1959] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:48:11.947525 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1563056-ec32-45c9-9b47-189af3e99294 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:11.958715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1563056-ec32-45c9-9b47-189af3e99294 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:11.964945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20966167-0c55-491a-8ac2-10b8636b640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:11.965615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966167-0c55-491a-8ac2-10b8636b640e admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:11.965957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966167-0c55-491a-8ac2-10b8636b640e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:11.966236 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966167-0c55-491a-8ac2-10b8636b640e admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:11.967003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20966167-0c55-491a-8ac2-10b8636b640e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:11.967317 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20966167-0c55-491a-8ac2-10b8636b640e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:11.968973 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20966167-0c55-491a-8ac2-10b8636b640e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:11.982429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 981/1960] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:11.986655 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8af3eb-b32f-4ef9-97f8-3b56e528b43d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:11.996589 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8af3eb-b32f-4ef9-97f8-3b56e528b43d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:12.004591 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b1343-5cef-4a0c-9955-83d9b06f1464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:12.005350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b1343-5cef-4a0c-9955-83d9b06f1464 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:12.005782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b1343-5cef-4a0c-9955-83d9b06f1464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:12.006487 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b1343-5cef-4a0c-9955-83d9b06f1464 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:12.007570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b1343-5cef-4a0c-9955-83d9b06f1464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:12.009690 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b1343-5cef-4a0c-9955-83d9b06f1464 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:12.101618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:12.110228 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 980/1961] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:11 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:12.114270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20966167-0c55-491a-8ac2-10b8636b640e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:12.124011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20966167-0c55-491a-8ac2-10b8636b640e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:12.181276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a504d22-ec54-4c5d-b270-3b81f0c6a0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:12.181981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a504d22-ec54-4c5d-b270-3b81f0c6a0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:12.182264 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a504d22-ec54-4c5d-b270-3b81f0c6a0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:12.184415 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a504d22-ec54-4c5d-b270-3b81f0c6a0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:12.185227 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a504d22-ec54-4c5d-b270-3b81f0c6a0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:12.187191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a504d22-ec54-4c5d-b270-3b81f0c6a0a1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:12.278447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 982/1962] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:12 2022] POST /identity/v3/users => generated 285 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:12.284711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b1343-5cef-4a0c-9955-83d9b06f1464 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:12.287118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a504d22-ec54-4c5d-b270-3b81f0c6a0a1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:12.288858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5a504d22-ec54-4c5d-b270-3b81f0c6a0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:12.295464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b1343-5cef-4a0c-9955-83d9b06f1464 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:12.300510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ece8-0306-4a68-b178-def303bc5295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:12.301200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ece8-0306-4a68-b178-def303bc5295 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:12.301479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ece8-0306-4a68-b178-def303bc5295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:12.301788 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4ece8-0306-4a68-b178-def303bc5295 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:12.302002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a504d22-ec54-4c5d-b270-3b81f0c6a0a1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:12.302530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4ece8-0306-4a68-b178-def303bc5295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:12.304144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4ece8-0306-4a68-b178-def303bc5295 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:12.306935 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e939d-2d8c-412e-9655-e716401b3233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:12.310124 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e939d-2d8c-412e-9655-e716401b3233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:12.310124 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e939d-2d8c-412e-9655-e716401b3233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:12.310124 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e939d-2d8c-412e-9655-e716401b3233 admin admin] PATH_INFO: `/v3/users/edbbb27c6283400184605c5ed00f82e1` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:12.310124 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e939d-2d8c-412e-9655-e716401b3233 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edbbb27c6283400184605c5ed00f82e1)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:12.311618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482e939d-2d8c-412e-9655-e716401b3233 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:12.316047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 981/1963] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:12.319902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ece8-0306-4a68-b178-def303bc5295 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:12.329568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4ece8-0306-4a68-b178-def303bc5295 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:12.335015 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac0adf-7845-4c84-b96c-f50107b9f21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:12.338870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac0adf-7845-4c84-b96c-f50107b9f21b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:12.338870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac0adf-7845-4c84-b96c-f50107b9f21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:12.338870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ac0adf-7845-4c84-b96c-f50107b9f21b admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:12.338870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac0adf-7845-4c84-b96c-f50107b9f21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:12.338870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ac0adf-7845-4c84-b96c-f50107b9f21b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:12.348984 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 982/1964] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:48:12.352789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac0adf-7845-4c84-b96c-f50107b9f21b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:12.362803 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ac0adf-7845-4c84-b96c-f50107b9f21b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:12.367466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e08ce-ce61-480c-91f0-c3e794dc3404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:12.368386 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e08ce-ce61-480c-91f0-c3e794dc3404 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:12.368673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e08ce-ce61-480c-91f0-c3e794dc3404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:12.368953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e08ce-ce61-480c-91f0-c3e794dc3404 admin admin] PATH_INFO: `/v3/projects/08e25d4ea6234ada90145a47feb652b1/users/8864c90bac654a728feaaf8c7ab4d267/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:12.384603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e08ce-ce61-480c-91f0-c3e794dc3404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e25d4ea6234ada90145a47feb652b1, user_id=8864c90bac654a728feaaf8c7ab4d267, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:12.387282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e08ce-ce61-480c-91f0-c3e794dc3404 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:12.495167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 983/1965] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:12 2022] PUT /identity/v3/projects/08e25d4ea6234ada90145a47feb652b1/users/8864c90bac654a728feaaf8c7ab4d267/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:48:12.507417 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9838be-c8d8-42a3-9b0d-a3b1aa4f6369 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:12.507709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9838be-c8d8-42a3-9b0d-a3b1aa4f6369 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:12.507990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9838be-c8d8-42a3-9b0d-a3b1aa4f6369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:12.533882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-5a9838be-c8d8-42a3-9b0d-a3b1aa4f6369 None None] MFA Rules not processed for user `8864c90bac654a728feaaf8c7ab4d267`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:12.535154 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5a9838be-c8d8-42a3-9b0d-a3b1aa4f6369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:12.588620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-482e939d-2d8c-412e-9655-e716401b3233 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edbbb27c6283400184605c5ed00f82e1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:12.589275 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-482e939d-2d8c-412e-9655-e716401b3233 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edbbb27c6283400184605c5ed00f82e1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:12.589922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-482e939d-2d8c-412e-9655-e716401b3233 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edbbb27c6283400184605c5ed00f82e1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:12.600729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 984/1966] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:48:12.602091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-482e939d-2d8c-412e-9655-e716401b3233 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edbbb27c6283400184605c5ed00f82e1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:12.605166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9838be-c8d8-42a3-9b0d-a3b1aa4f6369 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:12.610692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-482e939d-2d8c-412e-9655-e716401b3233 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edbbb27c6283400184605c5ed00f82e1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:12.668212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9838be-c8d8-42a3-9b0d-a3b1aa4f6369 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:12.672962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48548bd9-a4af-49d2-bf15-9756aeb03ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:12.673628 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48548bd9-a4af-49d2-bf15-9756aeb03ddf admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:12.674464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48548bd9-a4af-49d2-bf15-9756aeb03ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:12.674926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48548bd9-a4af-49d2-bf15-9756aeb03ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:12.675623 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48548bd9-a4af-49d2-bf15-9756aeb03ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:12.677647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48548bd9-a4af-49d2-bf15-9756aeb03ddf admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:12.687144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:12.712457 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 983/1967] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:12 2022] DELETE /identity/v3/users/edbbb27c6283400184605c5ed00f82e1 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:48:12.716857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800e25-ce12-44b5-83b0-5da7be714808 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:12.717154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800e25-ce12-44b5-83b0-5da7be714808 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:12.717438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc800e25-ce12-44b5-83b0-5da7be714808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:12.735399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-dc800e25-ce12-44b5-83b0-5da7be714808 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:12.737240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dc800e25-ce12-44b5-83b0-5da7be714808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:12.797900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 984/1968] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:48:12.804281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 985/1969] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:12 2022] POST /identity/v3/projects => generated 369 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:48:12.808409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc800e25-ce12-44b5-83b0-5da7be714808 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:12.808658 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48548bd9-a4af-49d2-bf15-9756aeb03ddf admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:12.810349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-48548bd9-a4af-49d2-bf15-9756aeb03ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:12.811421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dc800e25-ce12-44b5-83b0-5da7be714808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:12.823163 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc800e25-ce12-44b5-83b0-5da7be714808 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:12.876292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48548bd9-a4af-49d2-bf15-9756aeb03ddf admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:12.881758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbad64-1e1f-43d6-b20f-d55fb3f7f216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:12.882562 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbad64-1e1f-43d6-b20f-d55fb3f7f216 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:12.882939 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbad64-1e1f-43d6-b20f-d55fb3f7f216 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:12.883346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbad64-1e1f-43d6-b20f-d55fb3f7f216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:12.890390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3eb82b-58fe-42a0-9e19-e1a85c8712d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:12.891081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3eb82b-58fe-42a0-9e19-e1a85c8712d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:12.891363 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3eb82b-58fe-42a0-9e19-e1a85c8712d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:12.891641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3eb82b-58fe-42a0-9e19-e1a85c8712d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:12.892343 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3eb82b-58fe-42a0-9e19-e1a85c8712d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:12.894906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3eb82b-58fe-42a0-9e19-e1a85c8712d4 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:12.917696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:12.951284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbad64-1e1f-43d6-b20f-d55fb3f7f216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:12.952727 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbad64-1e1f-43d6-b20f-d55fb3f7f216 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:12.963974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 986/1970] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:48:12.995473 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 985/1971] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:12 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:48:12.998253 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbad64-1e1f-43d6-b20f-d55fb3f7f216 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:13.016046 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbad64-1e1f-43d6-b20f-d55fb3f7f216 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:13.024772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8c4cd-7135-4fa7-b194-d29a892f8d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:13.025666 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8c4cd-7135-4fa7-b194-d29a892f8d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:13.026038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8c4cd-7135-4fa7-b194-d29a892f8d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:13.026384 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8c4cd-7135-4fa7-b194-d29a892f8d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:13.027806 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8c4cd-7135-4fa7-b194-d29a892f8d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:13.029645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8c4cd-7135-4fa7-b194-d29a892f8d1d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:13.048870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3eb82b-58fe-42a0-9e19-e1a85c8712d4 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:13.050731 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 987/1972] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:13.064017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3eb82b-58fe-42a0-9e19-e1a85c8712d4 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:13.085980 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4c635-8e9a-4168-a0df-0f2e2d7f13cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:13.087237 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4c635-8e9a-4168-a0df-0f2e2d7f13cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:13.087832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4c635-8e9a-4168-a0df-0f2e2d7f13cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:13.088289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d4c635-8e9a-4168-a0df-0f2e2d7f13cc admin admin] PATH_INFO: `/v3/projects/cd7a32121e3b4209a53ce2a07dd1ce1c/users/a1fea23268e44b1f9c1aa4b6bf62cdb7/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:13.117177 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4c635-8e9a-4168-a0df-0f2e2d7f13cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7a32121e3b4209a53ce2a07dd1ce1c, user_id=a1fea23268e44b1f9c1aa4b6bf62cdb7, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:13.120939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d4c635-8e9a-4168-a0df-0f2e2d7f13cc admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:13.218943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 986/1973] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:13 2022] PUT /identity/v3/projects/cd7a32121e3b4209a53ce2a07dd1ce1c/users/a1fea23268e44b1f9c1aa4b6bf62cdb7/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:13.222196 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8c4cd-7135-4fa7-b194-d29a892f8d1d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:13.233211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8c4cd-7135-4fa7-b194-d29a892f8d1d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:13.297458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e0ab9-c101-471c-a444-cd26578a3aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:13.298174 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e0ab9-c101-471c-a444-cd26578a3aca admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:13.298456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e0ab9-c101-471c-a444-cd26578a3aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:13.298728 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e0ab9-c101-471c-a444-cd26578a3aca admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:13.300948 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e0ab9-c101-471c-a444-cd26578a3aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:13.302586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761e0ab9-c101-471c-a444-cd26578a3aca admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:13.312501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 988/1974] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:13.316643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4c635-8e9a-4168-a0df-0f2e2d7f13cc admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:13.326698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d4c635-8e9a-4168-a0df-0f2e2d7f13cc admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:13.332920 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7caff6-6db4-482c-9723-a9269a78b57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:13.339283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7caff6-6db4-482c-9723-a9269a78b57e admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:13.339283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7caff6-6db4-482c-9723-a9269a78b57e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:13.339283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7caff6-6db4-482c-9723-a9269a78b57e admin admin] PATH_INFO: `/v3/projects/cd7a32121e3b4209a53ce2a07dd1ce1c/users/a1fea23268e44b1f9c1aa4b6bf62cdb7/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:13.339283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7caff6-6db4-482c-9723-a9269a78b57e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7a32121e3b4209a53ce2a07dd1ce1c, user_id=a1fea23268e44b1f9c1aa4b6bf62cdb7, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:13.339283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7caff6-6db4-482c-9723-a9269a78b57e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:13.365185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:13.365406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f98eb7-2bde-484a-9f24-bb37f43fd350 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:13.365800 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 987/1975] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:13 2022] PUT /identity/v3/projects/cd7a32121e3b4209a53ce2a07dd1ce1c/users/a1fea23268e44b1f9c1aa4b6bf62cdb7/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:48:13.365925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f98eb7-2bde-484a-9f24-bb37f43fd350 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:13.366004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f98eb7-2bde-484a-9f24-bb37f43fd350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:13.422329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-78f98eb7-2bde-484a-9f24-bb37f43fd350 None None] MFA Rules not processed for user `a1fea23268e44b1f9c1aa4b6bf62cdb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:13.424761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-78f98eb7-2bde-484a-9f24-bb37f43fd350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:13.427229 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:13.506757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 989/1976] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:13 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:13.640949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7caff6-6db4-482c-9723-a9269a78b57e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:13.641968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fe7caff6-6db4-482c-9723-a9269a78b57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:13.682559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f98eb7-2bde-484a-9f24-bb37f43fd350 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:13.684025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-78f98eb7-2bde-484a-9f24-bb37f43fd350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:13.748999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f98eb7-2bde-484a-9f24-bb37f43fd350 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:13.756463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1887bc7-b413-4248-b8ad-2f80ab6b4133 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:13.757153 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1887bc7-b413-4248-b8ad-2f80ab6b4133 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:13.761420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1887bc7-b413-4248-b8ad-2f80ab6b4133 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:13.761420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1887bc7-b413-4248-b8ad-2f80ab6b4133 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:13.762484 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7caff6-6db4-482c-9723-a9269a78b57e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:13.779644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:13.781598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:13.781837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:13.782120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] PATH_INFO: `/v3/projects/52c6fc1ec30a4d73bcd544c7e148b4a2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:13.785167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1887bc7-b413-4248-b8ad-2f80ab6b4133 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:13.786718 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c6fc1ec30a4d73bcd544c7e148b4a2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:13.786882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1887bc7-b413-4248-b8ad-2f80ab6b4133 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:13.789752 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:13.798926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 990/1977] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:13 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:13.984512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1887bc7-b413-4248-b8ad-2f80ab6b4133 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:13.986281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f1887bc7-b413-4248-b8ad-2f80ab6b4133 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:13.990663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c6fc1ec30a4d73bcd544c7e148b4a2', 'request_id': 'req-9bbce0ed-216f-4482-87ab-a981c630e89c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.005455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1887bc7-b413-4248-b8ad-2f80ab6b4133 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:14.072355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c6fc1ec30a4d73bcd544c7e148b4a2', 'request_id': 'req-9bbce0ed-216f-4482-87ab-a981c630e89c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.079176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c6fc1ec30a4d73bcd544c7e148b4a2', 'request_id': 'req-9bbce0ed-216f-4482-87ab-a981c630e89c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.090914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d07858-f6b3-4dc2-8cce-a67ff8602df7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:14.092397 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d07858-f6b3-4dc2-8cce-a67ff8602df7 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:14.092706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d07858-f6b3-4dc2-8cce-a67ff8602df7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:14.092992 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d07858-f6b3-4dc2-8cce-a67ff8602df7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:14.095054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-31d07858-f6b3-4dc2-8cce-a67ff8602df7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:14.096088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] The token cache is being invalidate because project 52c6fc1ec30a4d73bcd544c7e148b4a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:14.096454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.097138 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.098971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 988/1978] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:13 2022] DELETE /identity/v3/projects/52c6fc1ec30a4d73bcd544c7e148b4a2 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:14.100037 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:14.101414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:14.172777 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d07858-f6b3-4dc2-8cce-a67ff8602df7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:14.173367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbce0ed-216f-4482-87ab-a981c630e89c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:14.174667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d07858-f6b3-4dc2-8cce-a67ff8602df7 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:14.178277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fa7db-84b2-4b49-ae38-331d6871b8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:14.179164 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fa7db-84b2-4b49-ae38-331d6871b8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:14.179445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fa7db-84b2-4b49-ae38-331d6871b8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:14.179721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fa7db-84b2-4b49-ae38-331d6871b8ba admin admin] PATH_INFO: `/v3/users/e314e067ae4b47db9e8a5eb26606ff13` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:14.180932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fa7db-84b2-4b49-ae38-331d6871b8ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=e314e067ae4b47db9e8a5eb26606ff13)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:14.182898 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fa7db-84b2-4b49-ae38-331d6871b8ba admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:14.183836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 991/1979] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:14.184501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d07858-f6b3-4dc2-8cce-a67ff8602df7 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:14.200378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d07858-f6b3-4dc2-8cce-a67ff8602df7 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:14.207171 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd5e63-9f49-4875-89bf-c6ebbae5cbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:14.209016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd5e63-9f49-4875-89bf-c6ebbae5cbf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:14.209016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd5e63-9f49-4875-89bf-c6ebbae5cbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:14.209016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd5e63-9f49-4875-89bf-c6ebbae5cbf1 admin admin] PATH_INFO: `/v3/users/c20ede9baf724b6f91bc1fb403e1e6f7` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:14.210266 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd5e63-9f49-4875-89bf-c6ebbae5cbf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c20ede9baf724b6f91bc1fb403e1e6f7)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:14.212332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd5e63-9f49-4875-89bf-c6ebbae5cbf1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:14.243081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:14.378570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ec2fa7db-84b2-4b49-ae38-331d6871b8ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e314e067ae4b47db9e8a5eb26606ff13'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.378897 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ec2fa7db-84b2-4b49-ae38-331d6871b8ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e314e067ae4b47db9e8a5eb26606ff13'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.379578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ec2fa7db-84b2-4b49-ae38-331d6871b8ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e314e067ae4b47db9e8a5eb26606ff13'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.392513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ec2fa7db-84b2-4b49-ae38-331d6871b8ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e314e067ae4b47db9e8a5eb26606ff13'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.402156 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ec2fa7db-84b2-4b49-ae38-331d6871b8ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e314e067ae4b47db9e8a5eb26606ff13'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.473541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cbcd5e63-9f49-4875-89bf-c6ebbae5cbf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c20ede9baf724b6f91bc1fb403e1e6f7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.523256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 989/1980] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:14 2022] DELETE /identity/v3/users/e314e067ae4b47db9e8a5eb26606ff13 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:14.527599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a383358-802b-420d-b97e-2c8222dd5a6f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:14.527869 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a383358-802b-420d-b97e-2c8222dd5a6f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:14.528154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a383358-802b-420d-b97e-2c8222dd5a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:14.548302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-2a383358-802b-420d-b97e-2c8222dd5a6f None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:14.553142 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2a383358-802b-420d-b97e-2c8222dd5a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:14.603071 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cbcd5e63-9f49-4875-89bf-c6ebbae5cbf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c20ede9baf724b6f91bc1fb403e1e6f7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.604130 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cbcd5e63-9f49-4875-89bf-c6ebbae5cbf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c20ede9baf724b6f91bc1fb403e1e6f7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.609772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 990/1981] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:48:14.615734 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cbcd5e63-9f49-4875-89bf-c6ebbae5cbf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c20ede9baf724b6f91bc1fb403e1e6f7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.616497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cbcd5e63-9f49-4875-89bf-c6ebbae5cbf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c20ede9baf724b6f91bc1fb403e1e6f7'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:14.619957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a383358-802b-420d-b97e-2c8222dd5a6f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:14.621523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2a383358-802b-420d-b97e-2c8222dd5a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:14.646064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 992/1982] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:14 2022] DELETE /identity/v3/users/c20ede9baf724b6f91bc1fb403e1e6f7 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:14.691070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a383358-802b-420d-b97e-2c8222dd5a6f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:14.694107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:14.745404 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e6eb7-a0b8-48c4-849a-c55a8f404d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:14.746118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e6eb7-a0b8-48c4-849a-c55a8f404d0e service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:14.746405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e6eb7-a0b8-48c4-849a-c55a8f404d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:14.746675 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e6eb7-a0b8-48c4-849a-c55a8f404d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:14.748543 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-070e6eb7-a0b8-48c4-849a-c55a8f404d0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:14.815865 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e6eb7-a0b8-48c4-849a-c55a8f404d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:14.817250 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e6eb7-a0b8-48c4-849a-c55a8f404d0e service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:14.827770 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 991/1983] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:48:15.181327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:15.388516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd5e63-9f49-4875-89bf-c6ebbae5cbf1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:15.390027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cbcd5e63-9f49-4875-89bf-c6ebbae5cbf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:15.391381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e6eb7-a0b8-48c4-849a-c55a8f404d0e service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:15.393567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-070e6eb7-a0b8-48c4-849a-c55a8f404d0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:15.406945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e6eb7-a0b8-48c4-849a-c55a8f404d0e service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:15.421819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd5e63-9f49-4875-89bf-c6ebbae5cbf1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:15.424344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:15.425696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:15.425874 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:15.426251 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] PATH_INFO: `/v3/projects/734322d5d3674930893f31b94f0445bc` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:15.427709 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=734322d5d3674930893f31b94f0445bc)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:15.428706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd3184-52df-482c-a624-1d49b210fa8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:15.429587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd3184-52df-482c-a624-1d49b210fa8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:15.429933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd3184-52df-482c-a624-1d49b210fa8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:15.430038 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:15.430194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd3184-52df-482c-a624-1d49b210fa8a admin admin] PATH_INFO: `/v3/projects/cbf9584ac99c45738da158e6d2233645` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:15.431649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd3184-52df-482c-a624-1d49b210fa8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf9584ac99c45738da158e6d2233645)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:15.434389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd3184-52df-482c-a624-1d49b210fa8a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:15.601964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-56fd3184-52df-482c-a624-1d49b210fa8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf9584ac99c45738da158e6d2233645', 'request_id': 'req-56fd3184-52df-482c-a624-1d49b210fa8a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:15.605028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734322d5d3674930893f31b94f0445bc', 'request_id': 'req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:15.666571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:15.695200 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-56fd3184-52df-482c-a624-1d49b210fa8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf9584ac99c45738da158e6d2233645', 'request_id': 'req-56fd3184-52df-482c-a624-1d49b210fa8a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:15.704747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-56fd3184-52df-482c-a624-1d49b210fa8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf9584ac99c45738da158e6d2233645', 'request_id': 'req-56fd3184-52df-482c-a624-1d49b210fa8a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:15.720656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-56fd3184-52df-482c-a624-1d49b210fa8a admin admin] The token cache is being invalidate because project cbf9584ac99c45738da158e6d2233645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:15.721049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-56fd3184-52df-482c-a624-1d49b210fa8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:15.722795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-56fd3184-52df-482c-a624-1d49b210fa8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:15.726603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 993/1984] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:15 2022] DELETE /identity/v3/projects/cbf9584ac99c45738da158e6d2233645 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:15.733109 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614f0e-0e51-49f3-90e5-7781a30bcbdd None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:15.733469 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614f0e-0e51-49f3-90e5-7781a30bcbdd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:15.733660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d614f0e-0e51-49f3-90e5-7781a30bcbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:15.754225 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1d614f0e-0e51-49f3-90e5-7781a30bcbdd None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:15.755423 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1d614f0e-0e51-49f3-90e5-7781a30bcbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:15.809211 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734322d5d3674930893f31b94f0445bc', 'request_id': 'req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:15.819666 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 994/1985] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:15.822736 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734322d5d3674930893f31b94f0445bc', 'request_id': 'req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:15.828944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48f5e7-a75f-41e9-95dd-6cf6ba99ff63 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:15.829201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48f5e7-a75f-41e9-95dd-6cf6ba99ff63 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:15.829488 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48f5e7-a75f-41e9-95dd-6cf6ba99ff63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:15.839793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] The token cache is being invalidate because project 734322d5d3674930893f31b94f0445bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:15.839793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:15.840439 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:15.842428 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 992/1986] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:15 2022] DELETE /identity/v3/projects/734322d5d3674930893f31b94f0445bc => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:48:15.847754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:15.850613 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:15.850872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2b48f5e7-a75f-41e9-95dd-6cf6ba99ff63 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:15.852050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2b48f5e7-a75f-41e9-95dd-6cf6ba99ff63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:15.864958 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 995/1987] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:48:15.866332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba71d0d-9637-4ecf-8b73-3f3f2fa06b3a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:15.871080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48f5e7-a75f-41e9-95dd-6cf6ba99ff63 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:15.871922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6328f-a763-4ebc-adfe-11950232a208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:15.872954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6328f-a763-4ebc-adfe-11950232a208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:15.873242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6328f-a763-4ebc-adfe-11950232a208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:15.873520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6328f-a763-4ebc-adfe-11950232a208 admin admin] PATH_INFO: `/v3/users/61c8a7540c25404ba1d6a3a5784a8837` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:15.874766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6328f-a763-4ebc-adfe-11950232a208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c8a7540c25404ba1d6a3a5784a8837)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:15.877086 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6328f-a763-4ebc-adfe-11950232a208 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:15.883119 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48f5e7-a75f-41e9-95dd-6cf6ba99ff63 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:15.888382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a8e6d-2abf-4bbe-a47c-09abdf69b0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:15.889567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a8e6d-2abf-4bbe-a47c-09abdf69b0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:15.889567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a8e6d-2abf-4bbe-a47c-09abdf69b0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:15.889781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a8e6d-2abf-4bbe-a47c-09abdf69b0e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:15.890466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a8e6d-2abf-4bbe-a47c-09abdf69b0e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:15.890780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a8e6d-2abf-4bbe-a47c-09abdf69b0e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:15.892404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a8e6d-2abf-4bbe-a47c-09abdf69b0e4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:15.905320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 996/1988] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:15.909965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a8e6d-2abf-4bbe-a47c-09abdf69b0e4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:15.920770 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a8e6d-2abf-4bbe-a47c-09abdf69b0e4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:15.925954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627a0a-7ddf-41a7-bc30-db37c6b71c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:15.926612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627a0a-7ddf-41a7-bc30-db37c6b71c11 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:15.926896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627a0a-7ddf-41a7-bc30-db37c6b71c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:15.927189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73627a0a-7ddf-41a7-bc30-db37c6b71c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:15.927878 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73627a0a-7ddf-41a7-bc30-db37c6b71c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:15.929853 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73627a0a-7ddf-41a7-bc30-db37c6b71c11 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:16.014386 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 997/1989] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:15 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:48:16.018583 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627a0a-7ddf-41a7-bc30-db37c6b71c11 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:16.035397 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e8a6328f-a763-4ebc-adfe-11950232a208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c8a7540c25404ba1d6a3a5784a8837'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:16.036299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e8a6328f-a763-4ebc-adfe-11950232a208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c8a7540c25404ba1d6a3a5784a8837'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:16.037014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e8a6328f-a763-4ebc-adfe-11950232a208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c8a7540c25404ba1d6a3a5784a8837'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:16.049665 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e8a6328f-a763-4ebc-adfe-11950232a208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c8a7540c25404ba1d6a3a5784a8837'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:16.056817 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e8a6328f-a763-4ebc-adfe-11950232a208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c8a7540c25404ba1d6a3a5784a8837'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:16.084261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73627a0a-7ddf-41a7-bc30-db37c6b71c11 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:16.088956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66bc1e-0e3d-402b-b149-b42e5e487c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:16.089739 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66bc1e-0e3d-402b-b149-b42e5e487c3e admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:16.090048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66bc1e-0e3d-402b-b149-b42e5e487c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:16.090308 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66bc1e-0e3d-402b-b149-b42e5e487c3e admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:16.091009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66bc1e-0e3d-402b-b149-b42e5e487c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:16.093012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66bc1e-0e3d-402b-b149-b42e5e487c3e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:16.130022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 993/1990] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:15 2022] DELETE /identity/v3/users/61c8a7540c25404ba1d6a3a5784a8837 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:16.204080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 998/1991] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:16 2022] POST /identity/v3/users => generated 287 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:16.208712 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6328f-a763-4ebc-adfe-11950232a208 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:16.210183 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e8a6328f-a763-4ebc-adfe-11950232a208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:16.277711 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6328f-a763-4ebc-adfe-11950232a208 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:16.282262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b61540-a782-4ad6-968c-c553f9752740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:16.282930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61540-a782-4ad6-968c-c553f9752740 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:16.283746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61540-a782-4ad6-968c-c553f9752740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:16.284205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b61540-a782-4ad6-968c-c553f9752740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:16.285009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b61540-a782-4ad6-968c-c553f9752740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:16.286704 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b61540-a782-4ad6-968c-c553f9752740 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:16.298259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 994/1992] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:16.303087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66bc1e-0e3d-402b-b149-b42e5e487c3e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:16.314821 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66bc1e-0e3d-402b-b149-b42e5e487c3e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:16.320606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168c737-5d13-4f3d-8328-e3357c404130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:16.321284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168c737-5d13-4f3d-8328-e3357c404130 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:16.321810 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168c737-5d13-4f3d-8328-e3357c404130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:16.322035 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168c737-5d13-4f3d-8328-e3357c404130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:16.322772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168c737-5d13-4f3d-8328-e3357c404130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:16.324352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168c737-5d13-4f3d-8328-e3357c404130 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:16.335557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 999/1993] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:48:16.340391 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b61540-a782-4ad6-968c-c553f9752740 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:16.356916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b61540-a782-4ad6-968c-c553f9752740 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:16.358868 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167718b-a779-47da-8fb2-c4a3475b2e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:16.359766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167718b-a779-47da-8fb2-c4a3475b2e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:16.360053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167718b-a779-47da-8fb2-c4a3475b2e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:16.360323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7167718b-a779-47da-8fb2-c4a3475b2e5e admin admin] PATH_INFO: `/v3/projects/7bd3d5b09a824139828e80d5f51eafb8/users/2ea1ada84a544d959a7a3954993fb6fb/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:16.376323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167718b-a779-47da-8fb2-c4a3475b2e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd3d5b09a824139828e80d5f51eafb8, user_id=2ea1ada84a544d959a7a3954993fb6fb, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:16.379936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7167718b-a779-47da-8fb2-c4a3475b2e5e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:16.474045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 995/1994] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:16 2022] PUT /identity/v3/projects/7bd3d5b09a824139828e80d5f51eafb8/users/2ea1ada84a544d959a7a3954993fb6fb/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:16.481710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb9261-f0fb-4a83-bd4e-3d5ab067f574 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:16.482021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb9261-f0fb-4a83-bd4e-3d5ab067f574 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:16.482300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb9261-f0fb-4a83-bd4e-3d5ab067f574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:16.500646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f0eb9261-f0fb-4a83-bd4e-3d5ab067f574 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:16.506520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f0eb9261-f0fb-4a83-bd4e-3d5ab067f574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:16.566444 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1000/1995] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:16.575430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167718b-a779-47da-8fb2-c4a3475b2e5e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:16.586891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7167718b-a779-47da-8fb2-c4a3475b2e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:16.587652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb9261-f0fb-4a83-bd4e-3d5ab067f574 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:16.589533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f0eb9261-f0fb-4a83-bd4e-3d5ab067f574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:16.593979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7167718b-a779-47da-8fb2-c4a3475b2e5e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:16.611415 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e0dab-d7fa-4dcd-874e-315cbedc13be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:16.612930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0dab-d7fa-4dcd-874e-315cbedc13be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:16.613769 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0dab-d7fa-4dcd-874e-315cbedc13be admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:16.614081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e0dab-d7fa-4dcd-874e-315cbedc13be admin admin] PATH_INFO: `/v3/projects/314edd9a37ba4fef9dc8fb281baed802` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:16.615661 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e0dab-d7fa-4dcd-874e-315cbedc13be admin admin] RBAC: Authorizing `identity:delete_project(project_id=314edd9a37ba4fef9dc8fb281baed802)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:16.617734 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e0dab-d7fa-4dcd-874e-315cbedc13be admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:16.655298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb9261-f0fb-4a83-bd4e-3d5ab067f574 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:16.660927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120bc758-835c-45be-b828-40f752ad0710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:16.661597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc758-835c-45be-b828-40f752ad0710 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:16.661924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc758-835c-45be-b828-40f752ad0710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:16.662206 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120bc758-835c-45be-b828-40f752ad0710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:16.672653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bc758-835c-45be-b828-40f752ad0710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:16.674377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120bc758-835c-45be-b828-40f752ad0710 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:16.698228 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1001/1996] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:16.770520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d42e0dab-d7fa-4dcd-874e-315cbedc13be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '314edd9a37ba4fef9dc8fb281baed802', 'request_id': 'req-d42e0dab-d7fa-4dcd-874e-315cbedc13be'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:16.941390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d42e0dab-d7fa-4dcd-874e-315cbedc13be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '314edd9a37ba4fef9dc8fb281baed802', 'request_id': 'req-d42e0dab-d7fa-4dcd-874e-315cbedc13be'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:16.947281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d42e0dab-d7fa-4dcd-874e-315cbedc13be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '314edd9a37ba4fef9dc8fb281baed802', 'request_id': 'req-d42e0dab-d7fa-4dcd-874e-315cbedc13be'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:16.959917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d42e0dab-d7fa-4dcd-874e-315cbedc13be admin admin] The token cache is being invalidate because project 314edd9a37ba4fef9dc8fb281baed802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:16.960221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d42e0dab-d7fa-4dcd-874e-315cbedc13be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:16.960881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d42e0dab-d7fa-4dcd-874e-315cbedc13be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:16.962828 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 996/1997] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:16 2022] DELETE /identity/v3/projects/314edd9a37ba4fef9dc8fb281baed802 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:16.968469 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a0d6-ef65-4617-8f55-4c70e92d3c57 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:16.968765 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a0d6-ef65-4617-8f55-4c70e92d3c57 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:16.969084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca28a0d6-ef65-4617-8f55-4c70e92d3c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:16.993347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ca28a0d6-ef65-4617-8f55-4c70e92d3c57 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:16.993347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ca28a0d6-ef65-4617-8f55-4c70e92d3c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:17.072522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1002/1998] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:17.082206 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5365f5-9cdf-46c0-8740-4066acb90501 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:17.082748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5365f5-9cdf-46c0-8740-4066acb90501 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:17.083309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5365f5-9cdf-46c0-8740-4066acb90501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:17.106517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:17.112565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4c5365f5-9cdf-46c0-8740-4066acb90501 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:17.114590 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4c5365f5-9cdf-46c0-8740-4066acb90501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:17.125867 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 997/1999] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:48:17.130665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28a0d6-ef65-4617-8f55-4c70e92d3c57 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:17.146834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca28a0d6-ef65-4617-8f55-4c70e92d3c57 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:17.153990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6271a-90a2-4350-8647-75cacf548025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:17.165852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6271a-90a2-4350-8647-75cacf548025 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:17.166636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6271a-90a2-4350-8647-75cacf548025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:17.166760 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6271a-90a2-4350-8647-75cacf548025 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:17.167625 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6271a-90a2-4350-8647-75cacf548025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:17.168074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6271a-90a2-4350-8647-75cacf548025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:17.170557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6271a-90a2-4350-8647-75cacf548025 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:17.177370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5365f5-9cdf-46c0-8740-4066acb90501 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:17.179331 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4c5365f5-9cdf-46c0-8740-4066acb90501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:17.191862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1003/2000] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:48:17.192738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6271a-90a2-4350-8647-75cacf548025 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:17.216311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6271a-90a2-4350-8647-75cacf548025 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:17.217968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76c72d-92cb-4b7d-989c-a1a7f3c26f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:17.218671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76c72d-92cb-4b7d-989c-a1a7f3c26f57 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:17.218956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76c72d-92cb-4b7d-989c-a1a7f3c26f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:17.219238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a76c72d-92cb-4b7d-989c-a1a7f3c26f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:17.220056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76c72d-92cb-4b7d-989c-a1a7f3c26f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:17.222239 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a76c72d-92cb-4b7d-989c-a1a7f3c26f57 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:17.249753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5365f5-9cdf-46c0-8740-4066acb90501 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:17.255192 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d28bf-2c1f-42a2-81fd-20552c817a49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:17.256367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d28bf-2c1f-42a2-81fd-20552c817a49 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:17.256677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d28bf-2c1f-42a2-81fd-20552c817a49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:17.256973 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d28bf-2c1f-42a2-81fd-20552c817a49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:17.259240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-399d28bf-2c1f-42a2-81fd-20552c817a49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:17.326574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1004/2001] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:17 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:17.330389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76c72d-92cb-4b7d-989c-a1a7f3c26f57 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:17.339976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d28bf-2c1f-42a2-81fd-20552c817a49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:17.342262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d28bf-2c1f-42a2-81fd-20552c817a49 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:17.357127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 998/2002] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:48:17.433968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a76c72d-92cb-4b7d-989c-a1a7f3c26f57 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:17.440003 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63663141-0c42-447e-91a7-d025f9bb768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:17.440789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63663141-0c42-447e-91a7-d025f9bb768f admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:17.447078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63663141-0c42-447e-91a7-d025f9bb768f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:17.447078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63663141-0c42-447e-91a7-d025f9bb768f admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:17.447078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63663141-0c42-447e-91a7-d025f9bb768f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:17.447078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63663141-0c42-447e-91a7-d025f9bb768f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:17.565394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1005/2003] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:17 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:48:17.569040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d28bf-2c1f-42a2-81fd-20552c817a49 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:17.579486 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d28bf-2c1f-42a2-81fd-20552c817a49 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:17.585626 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40a9cb-4859-481f-b3e3-92c866d18593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:17.589587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40a9cb-4859-481f-b3e3-92c866d18593 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:17.589899 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40a9cb-4859-481f-b3e3-92c866d18593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:17.593493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40a9cb-4859-481f-b3e3-92c866d18593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:17.594241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40a9cb-4859-481f-b3e3-92c866d18593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:17.598766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40a9cb-4859-481f-b3e3-92c866d18593 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:17.607487 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 999/2004] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:17.612812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63663141-0c42-447e-91a7-d025f9bb768f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:17.630863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63663141-0c42-447e-91a7-d025f9bb768f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:17.631921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd7772-c876-4121-8096-6bfebd9d90ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:17.632101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd7772-c876-4121-8096-6bfebd9d90ba admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:17.632543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd7772-c876-4121-8096-6bfebd9d90ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:17.633290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd7772-c876-4121-8096-6bfebd9d90ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:17.634031 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd7772-c876-4121-8096-6bfebd9d90ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:17.635657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd7772-c876-4121-8096-6bfebd9d90ba admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:17.653772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1006/2005] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:17.653900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40a9cb-4859-481f-b3e3-92c866d18593 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:17.663144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40a9cb-4859-481f-b3e3-92c866d18593 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:17.668707 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb102c7-0f06-43f6-ac4a-5b8a6a969cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:17.669679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb102c7-0f06-43f6-ac4a-5b8a6a969cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:17.670143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb102c7-0f06-43f6-ac4a-5b8a6a969cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:17.670399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb102c7-0f06-43f6-ac4a-5b8a6a969cd6 admin admin] PATH_INFO: `/v3/projects/8d1af0a1fab7499cb4298533fb306fad/users/e6554a0c8b044199a6568557d59c2012/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:17.687435 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb102c7-0f06-43f6-ac4a-5b8a6a969cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d1af0a1fab7499cb4298533fb306fad, user_id=e6554a0c8b044199a6568557d59c2012, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:17.692017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb102c7-0f06-43f6-ac4a-5b8a6a969cd6 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:17.724256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:17.786776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1000/2006] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:17 2022] PUT /identity/v3/projects/8d1af0a1fab7499cb4298533fb306fad/users/e6554a0c8b044199a6568557d59c2012/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:17.798043 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954d426-a1ca-43b0-8f7d-9c3faa8e714b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:17.798546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954d426-a1ca-43b0-8f7d-9c3faa8e714b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:17.798646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954d426-a1ca-43b0-8f7d-9c3faa8e714b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:17.826757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8954d426-a1ca-43b0-8f7d-9c3faa8e714b None None] MFA Rules not processed for user `e6554a0c8b044199a6568557d59c2012`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:17.828027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8954d426-a1ca-43b0-8f7d-9c3faa8e714b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:17.896068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1007/2007] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:17.900946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb102c7-0f06-43f6-ac4a-5b8a6a969cd6 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:17.965772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb102c7-0f06-43f6-ac4a-5b8a6a969cd6 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:17.971523 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c9d84-e450-45fd-a519-d682c70ed460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:17.972309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c9d84-e450-45fd-a519-d682c70ed460 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:17.972597 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c9d84-e450-45fd-a519-d682c70ed460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:17.972932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c9d84-e450-45fd-a519-d682c70ed460 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:17.973663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c9d84-e450-45fd-a519-d682c70ed460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:17.975681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c9d84-e450-45fd-a519-d682c70ed460 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:18.053754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1001/2008] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:17 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:48:18.055527 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954d426-a1ca-43b0-8f7d-9c3faa8e714b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:18.066883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954d426-a1ca-43b0-8f7d-9c3faa8e714b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:18.192561 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ed53f-7af8-4250-9e9b-b88b206735c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:18.195224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ed53f-7af8-4250-9e9b-b88b206735c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:18.195224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ed53f-7af8-4250-9e9b-b88b206735c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:18.195224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ed53f-7af8-4250-9e9b-b88b206735c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:18.195224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ed53f-7af8-4250-9e9b-b88b206735c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:18.197696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2ed53f-7af8-4250-9e9b-b88b206735c3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:18.240588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215e3bd-e856-43a0-820f-f7b351621d60 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:18.240588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215e3bd-e856-43a0-820f-f7b351621d60 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:18.240588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215e3bd-e856-43a0-820f-f7b351621d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:18.280920 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-2215e3bd-e856-43a0-820f-f7b351621d60 None None] MFA Rules not processed for user `2ea1ada84a544d959a7a3954993fb6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:18.282210 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2215e3bd-e856-43a0-820f-f7b351621d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:18.287528 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1008/2009] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:18 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:48:18.288781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ed53f-7af8-4250-9e9b-b88b206735c3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:18.306684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ed53f-7af8-4250-9e9b-b88b206735c3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:18.313993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d91cb9-650e-4889-9f09-c8337877e34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:18.315512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91cb9-650e-4889-9f09-c8337877e34f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:18.315946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91cb9-650e-4889-9f09-c8337877e34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:18.316349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d91cb9-650e-4889-9f09-c8337877e34f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:18.317233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d91cb9-650e-4889-9f09-c8337877e34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:18.319021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d91cb9-650e-4889-9f09-c8337877e34f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:18.347364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1009/2010] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:18.352125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d91cb9-650e-4889-9f09-c8337877e34f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:18.386533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d91cb9-650e-4889-9f09-c8337877e34f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:18.402949 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffbdd3-3745-4b44-84f8-06c1aabd4dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:18.404550 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffbdd3-3745-4b44-84f8-06c1aabd4dae admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:18.405028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffbdd3-3745-4b44-84f8-06c1aabd4dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:18.405658 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ffbdd3-3745-4b44-84f8-06c1aabd4dae admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:18.407705 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffbdd3-3745-4b44-84f8-06c1aabd4dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:18.410309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ffbdd3-3745-4b44-84f8-06c1aabd4dae admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:18.422680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1010/2011] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:18.428950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffbdd3-3745-4b44-84f8-06c1aabd4dae admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:18.433181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1002/2012] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:18.444275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ffbdd3-3745-4b44-84f8-06c1aabd4dae admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:18.449651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215e3bd-e856-43a0-820f-f7b351621d60 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:18.460063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c14eb1-86cd-4c02-9944-6566e5ac99a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:18.460063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c14eb1-86cd-4c02-9944-6566e5ac99a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:18.460063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c14eb1-86cd-4c02-9944-6566e5ac99a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:18.460063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c14eb1-86cd-4c02-9944-6566e5ac99a1 admin admin] PATH_INFO: `/v3/projects/604d13a6efc14d969d0d353cae03fed6/users/f7c6d06a159a40d492a298cc27cfe495/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:18.469579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c14eb1-86cd-4c02-9944-6566e5ac99a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604d13a6efc14d969d0d353cae03fed6, user_id=f7c6d06a159a40d492a298cc27cfe495, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:18.473570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c14eb1-86cd-4c02-9944-6566e5ac99a1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:18.511558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215e3bd-e856-43a0-820f-f7b351621d60 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:18.516778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ca500-df09-4f33-b5d7-f3d0db066ae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:18.517769 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca500-df09-4f33-b5d7-f3d0db066ae1 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:18.518713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca500-df09-4f33-b5d7-f3d0db066ae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:18.519280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca500-df09-4f33-b5d7-f3d0db066ae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:18.528239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ca500-df09-4f33-b5d7-f3d0db066ae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:18.530184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ca500-df09-4f33-b5d7-f3d0db066ae1 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:18.542498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1003/2013] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:48:18.592808 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1011/2014] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:18 2022] PUT /identity/v3/projects/604d13a6efc14d969d0d353cae03fed6/users/f7c6d06a159a40d492a298cc27cfe495/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:48:18.604272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34270e3-fcb8-411c-a552-7a4b37b79bbe None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:18.604651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34270e3-fcb8-411c-a552-7a4b37b79bbe None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:18.605003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34270e3-fcb8-411c-a552-7a4b37b79bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:18.637030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c34270e3-fcb8-411c-a552-7a4b37b79bbe None None] MFA Rules not processed for user `f7c6d06a159a40d492a298cc27cfe495`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:18.638389 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c34270e3-fcb8-411c-a552-7a4b37b79bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:18.714665 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1004/2015] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:18.719117 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c14eb1-86cd-4c02-9944-6566e5ac99a1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:18.785120 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c14eb1-86cd-4c02-9944-6566e5ac99a1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:18.789935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe11bf-a3fb-432c-94ba-851bfd0df30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:18.790686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe11bf-a3fb-432c-94ba-851bfd0df30f admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:18.790997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe11bf-a3fb-432c-94ba-851bfd0df30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:18.791356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe11bf-a3fb-432c-94ba-851bfd0df30f admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:18.792080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe11bf-a3fb-432c-94ba-851bfd0df30f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:18.794020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe11bf-a3fb-432c-94ba-851bfd0df30f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:18.916005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1012/2016] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:18 2022] POST /identity/v3/projects => generated 377 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:18.917127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34270e3-fcb8-411c-a552-7a4b37b79bbe None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:18.929009 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34270e3-fcb8-411c-a552-7a4b37b79bbe None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:18.991370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efba26-be1a-4e43-be37-d2f9228f91f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:18.992061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efba26-be1a-4e43-be37-d2f9228f91f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:18.992347 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efba26-be1a-4e43-be37-d2f9228f91f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:18.992628 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efba26-be1a-4e43-be37-d2f9228f91f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:18.993372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efba26-be1a-4e43-be37-d2f9228f91f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:18.995339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efba26-be1a-4e43-be37-d2f9228f91f9 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:19.085114 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1005/2017] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:18 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:48:19.090507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe11bf-a3fb-432c-94ba-851bfd0df30f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:19.101251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe11bf-a3fb-432c-94ba-851bfd0df30f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:19.106557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeb98d-b595-4230-91d1-2451a0acb8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:19.107383 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb98d-b595-4230-91d1-2451a0acb8ee admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:19.108018 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb98d-b595-4230-91d1-2451a0acb8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:19.108426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdeb98d-b595-4230-91d1-2451a0acb8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:19.109378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdeb98d-b595-4230-91d1-2451a0acb8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:19.111033 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdeb98d-b595-4230-91d1-2451a0acb8ee admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:19.123673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1013/2018] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:19.128798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efba26-be1a-4e43-be37-d2f9228f91f9 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:19.139770 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efba26-be1a-4e43-be37-d2f9228f91f9 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:19.145954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcf66b-7ea7-4799-a7e2-67a25a79a802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:19.147288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcf66b-7ea7-4799-a7e2-67a25a79a802 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:19.147722 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcf66b-7ea7-4799-a7e2-67a25a79a802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:19.148149 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcf66b-7ea7-4799-a7e2-67a25a79a802 admin admin] PATH_INFO: `/v3/projects/b6bb4991a596422a8567bec7d176e645/users/4a57b3a1c0094aa288d4057c0ca7a6e4/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:19.167377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcf66b-7ea7-4799-a7e2-67a25a79a802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bb4991a596422a8567bec7d176e645, user_id=4a57b3a1c0094aa288d4057c0ca7a6e4, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:19.170677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fcf66b-7ea7-4799-a7e2-67a25a79a802 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:19.268529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1006/2019] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:19 2022] PUT /identity/v3/projects/b6bb4991a596422a8567bec7d176e645/users/4a57b3a1c0094aa288d4057c0ca7a6e4/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:48:19.269789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeb98d-b595-4230-91d1-2451a0acb8ee admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:19.272200 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:19.292302 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdeb98d-b595-4230-91d1-2451a0acb8ee admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:19.353863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4314f92-b379-41af-b148-5d5d3b0afd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:19.354554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4314f92-b379-41af-b148-5d5d3b0afd34 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:19.354841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4314f92-b379-41af-b148-5d5d3b0afd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:19.355133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4314f92-b379-41af-b148-5d5d3b0afd34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:19.355857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4314f92-b379-41af-b148-5d5d3b0afd34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:19.357755 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4314f92-b379-41af-b148-5d5d3b0afd34 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:19.369774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1014/2020] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:19.371125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:19.373409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcf66b-7ea7-4799-a7e2-67a25a79a802 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:19.384591 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcf66b-7ea7-4799-a7e2-67a25a79a802 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:19.389556 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b98ec-3b4b-4b1b-a647-b914a5f57123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:19.391745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b98ec-3b4b-4b1b-a647-b914a5f57123 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:19.392033 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b98ec-3b4b-4b1b-a647-b914a5f57123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:19.392314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b98ec-3b4b-4b1b-a647-b914a5f57123 admin admin] PATH_INFO: `/v3/projects/b6bb4991a596422a8567bec7d176e645/users/4a57b3a1c0094aa288d4057c0ca7a6e4/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:19.394859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b98ec-3b4b-4b1b-a647-b914a5f57123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6bb4991a596422a8567bec7d176e645, user_id=4a57b3a1c0094aa288d4057c0ca7a6e4, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:19.397462 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b98ec-3b4b-4b1b-a647-b914a5f57123 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:19.421820 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1007/2021] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:19 2022] PUT /identity/v3/projects/b6bb4991a596422a8567bec7d176e645/users/4a57b3a1c0094aa288d4057c0ca7a6e4/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:19.426230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b0e8b-3ccd-4073-8186-664518c2f7dd None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:19.426502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b0e8b-3ccd-4073-8186-664518c2f7dd None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:19.426822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b0e8b-3ccd-4073-8186-664518c2f7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:19.467947 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-607b0e8b-3ccd-4073-8186-664518c2f7dd None None] MFA Rules not processed for user `4a57b3a1c0094aa288d4057c0ca7a6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:19.469456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-607b0e8b-3ccd-4073-8186-664518c2f7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:19.569273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1015/2022] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:19.847453 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b98ec-3b4b-4b1b-a647-b914a5f57123 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:19.913687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b98ec-3b4b-4b1b-a647-b914a5f57123 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:19.918889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e1d7d-a676-4df9-96bc-0e7d264beb5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:19.920486 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e1d7d-a676-4df9-96bc-0e7d264beb5b service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:19.921045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e1d7d-a676-4df9-96bc-0e7d264beb5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:19.921611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e1d7d-a676-4df9-96bc-0e7d264beb5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:19.933160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e1d7d-a676-4df9-96bc-0e7d264beb5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:19.934882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e1d7d-a676-4df9-96bc-0e7d264beb5b service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:19.947702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1008/2023] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:20.093153 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b0e8b-3ccd-4073-8186-664518c2f7dd None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:20.103387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b0e8b-3ccd-4073-8186-664518c2f7dd None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:20.106990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98177aa5-2e17-45b0-858e-bc51fdf6142b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:20.107644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98177aa5-2e17-45b0-858e-bc51fdf6142b service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:20.107997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98177aa5-2e17-45b0-858e-bc51fdf6142b service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:20.108278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98177aa5-2e17-45b0-858e-bc51fdf6142b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:20.167655 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98177aa5-2e17-45b0-858e-bc51fdf6142b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:20.169438 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98177aa5-2e17-45b0-858e-bc51fdf6142b service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:20.180694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1016/2024] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:20.332506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e1d7d-a676-4df9-96bc-0e7d264beb5b service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:20.336632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1e2e1d7d-a676-4df9-96bc-0e7d264beb5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:20.420931 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e1d7d-a676-4df9-96bc-0e7d264beb5b service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:20.428562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e223725-4108-4759-b9ff-66014b725889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:20.430219 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e223725-4108-4759-b9ff-66014b725889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:20.430693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e223725-4108-4759-b9ff-66014b725889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:20.431056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e223725-4108-4759-b9ff-66014b725889 admin admin] PATH_INFO: `/v3/users/8864c90bac654a728feaaf8c7ab4d267` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:20.433032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e223725-4108-4759-b9ff-66014b725889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8864c90bac654a728feaaf8c7ab4d267)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:20.435258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e223725-4108-4759-b9ff-66014b725889 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:20.617629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56e52a-1e52-423c-aefe-50c297d9f1b9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:20.617979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56e52a-1e52-423c-aefe-50c297d9f1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:20.618231 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56e52a-1e52-423c-aefe-50c297d9f1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:20.637770 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-7b56e52a-1e52-423c-aefe-50c297d9f1b9 None None] MFA Rules not processed for user `2ea1ada84a544d959a7a3954993fb6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:20.639165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7b56e52a-1e52-423c-aefe-50c297d9f1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:20.678591 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7e223725-4108-4759-b9ff-66014b725889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8864c90bac654a728feaaf8c7ab4d267'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:20.680476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7e223725-4108-4759-b9ff-66014b725889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8864c90bac654a728feaaf8c7ab4d267'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:20.682261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7e223725-4108-4759-b9ff-66014b725889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8864c90bac654a728feaaf8c7ab4d267'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:20.707433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7e223725-4108-4759-b9ff-66014b725889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8864c90bac654a728feaaf8c7ab4d267'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:20.718048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7e223725-4108-4759-b9ff-66014b725889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8864c90bac654a728feaaf8c7ab4d267'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:20.731533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1017/2025] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:48:20.806810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:20.847465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1009/2026] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:20 2022] DELETE /identity/v3/users/8864c90bac654a728feaaf8c7ab4d267 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:20.854864 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3364e5e-80a2-4f71-8e98-fb7be1508a00 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:20.855401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3364e5e-80a2-4f71-8e98-fb7be1508a00 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:20.855860 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3364e5e-80a2-4f71-8e98-fb7be1508a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:20.874404 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e223725-4108-4759-b9ff-66014b725889 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:20.876674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7e223725-4108-4759-b9ff-66014b725889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:20.885277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b3364e5e-80a2-4f71-8e98-fb7be1508a00 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:20.886663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b3364e5e-80a2-4f71-8e98-fb7be1508a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:20.976133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1018/2027] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:20.982365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3364e5e-80a2-4f71-8e98-fb7be1508a00 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:20.983839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b3364e5e-80a2-4f71-8e98-fb7be1508a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:21.014836 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e223725-4108-4759-b9ff-66014b725889 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:21.022536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac77f8e-c2cf-4e8d-a06f-4cfb42fdbf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:21.023522 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77f8e-c2cf-4e8d-a06f-4cfb42fdbf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:21.023817 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77f8e-c2cf-4e8d-a06f-4cfb42fdbf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:21.024241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77f8e-c2cf-4e8d-a06f-4cfb42fdbf28 admin admin] PATH_INFO: `/v3/users/5b457e6841124086a06fb9b7f609c9a0` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:21.026029 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac77f8e-c2cf-4e8d-a06f-4cfb42fdbf28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b457e6841124086a06fb9b7f609c9a0)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:21.027996 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac77f8e-c2cf-4e8d-a06f-4cfb42fdbf28 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:21.076543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:21.076543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3364e5e-80a2-4f71-8e98-fb7be1508a00 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:21.076543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a15aab-bca3-43b8-ac0f-83a34b48e3df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:21.076543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a15aab-bca3-43b8-ac0f-83a34b48e3df service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:21.077116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a15aab-bca3-43b8-ac0f-83a34b48e3df service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:21.077116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a15aab-bca3-43b8-ac0f-83a34b48e3df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:21.089683 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a15aab-bca3-43b8-ac0f-83a34b48e3df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:21.091678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a15aab-bca3-43b8-ac0f-83a34b48e3df service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:21.106259 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1019/2028] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:48:21.280933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2ac77f8e-c2cf-4e8d-a06f-4cfb42fdbf28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b457e6841124086a06fb9b7f609c9a0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:21.284083 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2ac77f8e-c2cf-4e8d-a06f-4cfb42fdbf28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b457e6841124086a06fb9b7f609c9a0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:21.284083 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2ac77f8e-c2cf-4e8d-a06f-4cfb42fdbf28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b457e6841124086a06fb9b7f609c9a0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:21.295945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2ac77f8e-c2cf-4e8d-a06f-4cfb42fdbf28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b457e6841124086a06fb9b7f609c9a0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:21.304260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2ac77f8e-c2cf-4e8d-a06f-4cfb42fdbf28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b457e6841124086a06fb9b7f609c9a0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:21.527054 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1010/2029] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:20 2022] DELETE /identity/v3/users/5b457e6841124086a06fb9b7f609c9a0 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:21.527872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144968-c778-4c3b-90a6-d69bbd9d3343 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:21.527872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144968-c778-4c3b-90a6-d69bbd9d3343 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:21.527872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144968-c778-4c3b-90a6-d69bbd9d3343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:21.527872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-11144968-c778-4c3b-90a6-d69bbd9d3343 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:21.527872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-11144968-c778-4c3b-90a6-d69bbd9d3343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:21.822819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1020/2030] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:21.824996 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac77f8e-c2cf-4e8d-a06f-4cfb42fdbf28 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:21.824996 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2ac77f8e-c2cf-4e8d-a06f-4cfb42fdbf28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:21.824996 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac77f8e-c2cf-4e8d-a06f-4cfb42fdbf28 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:21.827154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ddf96-07b7-43bf-94b0-aa3370c67a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:21.827154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ddf96-07b7-43bf-94b0-aa3370c67a7c service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:21.827154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ddf96-07b7-43bf-94b0-aa3370c67a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:21.827154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ddf96-07b7-43bf-94b0-aa3370c67a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:21.829369 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ddf96-07b7-43bf-94b0-aa3370c67a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:21.829369 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ddf96-07b7-43bf-94b0-aa3370c67a7c service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:21.829369 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1011/2031] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:21.945316 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11144968-c778-4c3b-90a6-d69bbd9d3343 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:21.946888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-11144968-c778-4c3b-90a6-d69bbd9d3343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:21.980963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11144968-c778-4c3b-90a6-d69bbd9d3343 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:21.996703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:21.997664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:21.998024 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:21.998308 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] PATH_INFO: `/v3/projects/08e25d4ea6234ada90145a47feb652b1` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:22.002684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e25d4ea6234ada90145a47feb652b1)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:22.004724 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:22.153626 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e25d4ea6234ada90145a47feb652b1', 'request_id': 'req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.225979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e25d4ea6234ada90145a47feb652b1', 'request_id': 'req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.232844 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e25d4ea6234ada90145a47feb652b1', 'request_id': 'req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.243765 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] The token cache is being invalidate because project 08e25d4ea6234ada90145a47feb652b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:22.244063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.245819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.247729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1021/2032] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:21 2022] DELETE /identity/v3/projects/08e25d4ea6234ada90145a47feb652b1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:22.251402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ddf96-07b7-43bf-94b0-aa3370c67a7c service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:22.262108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ddf96-07b7-43bf-94b0-aa3370c67a7c service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:22.321664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c65801-cb31-4798-8228-1f89063b8f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:22.325413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c65801-cb31-4798-8228-1f89063b8f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:22.325413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c65801-cb31-4798-8228-1f89063b8f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:22.325413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c65801-cb31-4798-8228-1f89063b8f51 admin admin] PATH_INFO: `/v3/users/a1fea23268e44b1f9c1aa4b6bf62cdb7` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:22.325413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c65801-cb31-4798-8228-1f89063b8f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1fea23268e44b1f9c1aa4b6bf62cdb7)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:22.327591 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c65801-cb31-4798-8228-1f89063b8f51 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:22.418122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:22.420687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:22.450651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6d2a06-61da-4f5e-b833-3005cd85e4b4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:22.460017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:22.461588 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:22.461850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:22.465418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] PATH_INFO: `/v3/projects/353c6335e8ce464ba8acba765089e717` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:22.469160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] RBAC: Authorizing `identity:delete_project(project_id=353c6335e8ce464ba8acba765089e717)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:22.473515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:22.611132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-30c65801-cb31-4798-8228-1f89063b8f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1fea23268e44b1f9c1aa4b6bf62cdb7'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.611752 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-30c65801-cb31-4798-8228-1f89063b8f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1fea23268e44b1f9c1aa4b6bf62cdb7'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.612361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-30c65801-cb31-4798-8228-1f89063b8f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1fea23268e44b1f9c1aa4b6bf62cdb7'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.624637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-30c65801-cb31-4798-8228-1f89063b8f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1fea23268e44b1f9c1aa4b6bf62cdb7'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.632426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-30c65801-cb31-4798-8228-1f89063b8f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1fea23268e44b1f9c1aa4b6bf62cdb7'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.672312 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '353c6335e8ce464ba8acba765089e717', 'request_id': 'req-fe8b7e6a-89ec-4246-bc73-93d7cd312add'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.752890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1012/2033] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:22 2022] DELETE /identity/v3/users/a1fea23268e44b1f9c1aa4b6bf62cdb7 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:22.865178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '353c6335e8ce464ba8acba765089e717', 'request_id': 'req-fe8b7e6a-89ec-4246-bc73-93d7cd312add'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.870530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '353c6335e8ce464ba8acba765089e717', 'request_id': 'req-fe8b7e6a-89ec-4246-bc73-93d7cd312add'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.899108 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] The token cache is being invalidate because project 353c6335e8ce464ba8acba765089e717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:22.899453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.900162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:22.902224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1022/2034] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:22 2022] DELETE /identity/v3/projects/353c6335e8ce464ba8acba765089e717 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:22.910968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c65801-cb31-4798-8228-1f89063b8f51 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:22.910968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-30c65801-cb31-4798-8228-1f89063b8f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:23.040984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c65801-cb31-4798-8228-1f89063b8f51 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:23.060544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd920e29-b09c-49b5-86f4-af185e627ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:23.061670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd920e29-b09c-49b5-86f4-af185e627ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:23.062128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd920e29-b09c-49b5-86f4-af185e627ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:23.062983 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd920e29-b09c-49b5-86f4-af185e627ba8 admin admin] PATH_INFO: `/v3/users/5236b5a8c180434d9cdd3c47a24d8ffb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:23.064893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd920e29-b09c-49b5-86f4-af185e627ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5236b5a8c180434d9cdd3c47a24d8ffb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:23.067086 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd920e29-b09c-49b5-86f4-af185e627ba8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:23.219335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:23.364078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cd920e29-b09c-49b5-86f4-af185e627ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5236b5a8c180434d9cdd3c47a24d8ffb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:23.365870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cd920e29-b09c-49b5-86f4-af185e627ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5236b5a8c180434d9cdd3c47a24d8ffb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:23.371403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cd920e29-b09c-49b5-86f4-af185e627ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5236b5a8c180434d9cdd3c47a24d8ffb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:23.384365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cd920e29-b09c-49b5-86f4-af185e627ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5236b5a8c180434d9cdd3c47a24d8ffb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:23.391770 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cd920e29-b09c-49b5-86f4-af185e627ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5236b5a8c180434d9cdd3c47a24d8ffb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:23.483726 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1013/2035] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:22 2022] DELETE /identity/v3/users/5236b5a8c180434d9cdd3c47a24d8ffb => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:23.521975 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:23.523424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:23.627299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b7e6a-89ec-4246-bc73-93d7cd312add admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:23.632983 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd920e29-b09c-49b5-86f4-af185e627ba8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:23.634453 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cd920e29-b09c-49b5-86f4-af185e627ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:23.672931 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:23.696772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:23.697654 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:23.697967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:23.698247 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] PATH_INFO: `/v3/projects/cd7a32121e3b4209a53ce2a07dd1ce1c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:23.699451 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7a32121e3b4209a53ce2a07dd1ce1c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:23.701361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:23.719958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd920e29-b09c-49b5-86f4-af185e627ba8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:23.723413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa458eaf-1993-48fb-8c08-43bc1cdd1805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:23.724517 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458eaf-1993-48fb-8c08-43bc1cdd1805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:23.724802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458eaf-1993-48fb-8c08-43bc1cdd1805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:23.725252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458eaf-1993-48fb-8c08-43bc1cdd1805 admin admin] PATH_INFO: `/v3/users/d3366521d2f54b5e925103a0a5c60d2a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:23.727220 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa458eaf-1993-48fb-8c08-43bc1cdd1805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3366521d2f54b5e925103a0a5c60d2a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:23.729375 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa458eaf-1993-48fb-8c08-43bc1cdd1805 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:23.919194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7a32121e3b4209a53ce2a07dd1ce1c', 'request_id': 'req-142cd58e-d822-41f8-891e-28b88b0f215a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.004035 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fa458eaf-1993-48fb-8c08-43bc1cdd1805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3366521d2f54b5e925103a0a5c60d2a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.004706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fa458eaf-1993-48fb-8c08-43bc1cdd1805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3366521d2f54b5e925103a0a5c60d2a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.005325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fa458eaf-1993-48fb-8c08-43bc1cdd1805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3366521d2f54b5e925103a0a5c60d2a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.017705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fa458eaf-1993-48fb-8c08-43bc1cdd1805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3366521d2f54b5e925103a0a5c60d2a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.024947 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fa458eaf-1993-48fb-8c08-43bc1cdd1805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3366521d2f54b5e925103a0a5c60d2a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.030997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7a32121e3b4209a53ce2a07dd1ce1c', 'request_id': 'req-142cd58e-d822-41f8-891e-28b88b0f215a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.047480 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7a32121e3b4209a53ce2a07dd1ce1c', 'request_id': 'req-142cd58e-d822-41f8-891e-28b88b0f215a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.062819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] The token cache is being invalidate because project cd7a32121e3b4209a53ce2a07dd1ce1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:24.063199 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.063952 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.070197 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1023/2036] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:23 2022] DELETE /identity/v3/projects/cd7a32121e3b4209a53ce2a07dd1ce1c => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:24.072152 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:24.073993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:24.144625 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cd58e-d822-41f8-891e-28b88b0f215a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:24.145288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1014/2037] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:23 2022] DELETE /identity/v3/users/d3366521d2f54b5e925103a0a5c60d2a => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:24.147117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e96af9-f96f-49ef-9acb-ef0fde4a53a7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:24.147592 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e96af9-f96f-49ef-9acb-ef0fde4a53a7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:24.148032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e96af9-f96f-49ef-9acb-ef0fde4a53a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:24.171731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d6e96af9-f96f-49ef-9acb-ef0fde4a53a7 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:24.173313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d6e96af9-f96f-49ef-9acb-ef0fde4a53a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:24.275727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1015/2038] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:24.276217 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:24.276675 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:24.276675 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:24.276847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] PATH_INFO: `/v3/projects/d112672847a044f4ba754efee9739717` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:24.287162 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d112672847a044f4ba754efee9739717)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:24.289702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:24.294665 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd69c06-5e43-4133-b7d0-93146c05a0b5 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:24.294964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd69c06-5e43-4133-b7d0-93146c05a0b5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:24.295249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd69c06-5e43-4133-b7d0-93146c05a0b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:24.319288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0bd69c06-5e43-4133-b7d0-93146c05a0b5 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:24.333261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0bd69c06-5e43-4133-b7d0-93146c05a0b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:24.343563 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1016/2039] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:24.348446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd69c06-5e43-4133-b7d0-93146c05a0b5 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:24.361053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd69c06-5e43-4133-b7d0-93146c05a0b5 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:24.366959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcdec4-f387-4d48-812c-04db512e08a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:24.367767 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcdec4-f387-4d48-812c-04db512e08a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:24.368143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcdec4-f387-4d48-812c-04db512e08a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:24.368551 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcdec4-f387-4d48-812c-04db512e08a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:24.369657 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcdec4-f387-4d48-812c-04db512e08a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:24.370202 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcdec4-f387-4d48-812c-04db512e08a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:24.373436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcdec4-f387-4d48-812c-04db512e08a6 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:24.393203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1017/2040] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:24.395286 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcdec4-f387-4d48-812c-04db512e08a6 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:24.398584 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-17bcdec4-f387-4d48-812c-04db512e08a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:24.414150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcdec4-f387-4d48-812c-04db512e08a6 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:24.421474 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c21d7-38ce-4d61-9de7-9b9bb5e4be6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:24.422498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c21d7-38ce-4d61-9de7-9b9bb5e4be6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:24.422837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c21d7-38ce-4d61-9de7-9b9bb5e4be6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:24.423196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c21d7-38ce-4d61-9de7-9b9bb5e4be6d admin admin] PATH_INFO: `/v3/users/6a2bf8fadf3d47b380c5b66e869b2275` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:24.424500 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c21d7-38ce-4d61-9de7-9b9bb5e4be6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2bf8fadf3d47b380c5b66e869b2275)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:24.426822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c21d7-38ce-4d61-9de7-9b9bb5e4be6d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:24.431412 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd112672847a044f4ba754efee9739717', 'request_id': 'req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.521798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd112672847a044f4ba754efee9739717', 'request_id': 'req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.528456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd112672847a044f4ba754efee9739717', 'request_id': 'req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.538819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] The token cache is being invalidate because project d112672847a044f4ba754efee9739717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:24.539108 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.539761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.541358 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1024/2041] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:24 2022] DELETE /identity/v3/projects/d112672847a044f4ba754efee9739717 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:24.542141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:24.543494 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:24.618224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165adc8-fb6f-4f22-b1cb-df74e092d7b1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:24.622890 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd6bdd8-ba31-46e3-a15c-9c78a5d0b314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:24.623618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6bdd8-ba31-46e3-a15c-9c78a5d0b314 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:24.623905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6bdd8-ba31-46e3-a15c-9c78a5d0b314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:24.624259 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd6bdd8-ba31-46e3-a15c-9c78a5d0b314 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:24.625021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6bdd8-ba31-46e3-a15c-9c78a5d0b314 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:24.626964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd6bdd8-ba31-46e3-a15c-9c78a5d0b314 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:24.673655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ed7c21d7-38ce-4d61-9de7-9b9bb5e4be6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2bf8fadf3d47b380c5b66e869b2275'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.674369 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ed7c21d7-38ce-4d61-9de7-9b9bb5e4be6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2bf8fadf3d47b380c5b66e869b2275'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.674997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ed7c21d7-38ce-4d61-9de7-9b9bb5e4be6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2bf8fadf3d47b380c5b66e869b2275'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.686688 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ed7c21d7-38ce-4d61-9de7-9b9bb5e4be6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2bf8fadf3d47b380c5b66e869b2275'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.693976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ed7c21d7-38ce-4d61-9de7-9b9bb5e4be6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2bf8fadf3d47b380c5b66e869b2275'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:24.768500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1025/2042] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:24 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:24.770616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b7e1f-1b93-44e6-a513-23137d92ee5b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:24.770801 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b7e1f-1b93-44e6-a513-23137d92ee5b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:24.771148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b7e1f-1b93-44e6-a513-23137d92ee5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:24.804709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-480b7e1f-1b93-44e6-a513-23137d92ee5b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:24.804814 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1018/2043] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:24 2022] DELETE /identity/v3/users/6a2bf8fadf3d47b380c5b66e869b2275 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:24.804913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-480b7e1f-1b93-44e6-a513-23137d92ee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:24.805007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c21d7-38ce-4d61-9de7-9b9bb5e4be6d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:24.805007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ed7c21d7-38ce-4d61-9de7-9b9bb5e4be6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:24.863962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1026/2044] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:24.864848 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c21d7-38ce-4d61-9de7-9b9bb5e4be6d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:24.869861 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a48d56-3731-4026-86a2-430ab5fa30c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:24.874406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a48d56-3731-4026-86a2-430ab5fa30c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:24.874535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b7e1f-1b93-44e6-a513-23137d92ee5b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:24.874647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a48d56-3731-4026-86a2-430ab5fa30c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:24.874647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a48d56-3731-4026-86a2-430ab5fa30c5 admin admin] PATH_INFO: `/v3/projects/356d78f2184241189afad7853708a8f2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:24.874817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-480b7e1f-1b93-44e6-a513-23137d92ee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:24.874906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a48d56-3731-4026-86a2-430ab5fa30c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=356d78f2184241189afad7853708a8f2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:24.874906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a48d56-3731-4026-86a2-430ab5fa30c5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:24.885099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b7e1f-1b93-44e6-a513-23137d92ee5b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:24.890031 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3009cd7-0317-4af2-99e2-10abdf0c2daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:24.890713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3009cd7-0317-4af2-99e2-10abdf0c2daf admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:24.890999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3009cd7-0317-4af2-99e2-10abdf0c2daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:24.891281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3009cd7-0317-4af2-99e2-10abdf0c2daf admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:24.892005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3009cd7-0317-4af2-99e2-10abdf0c2daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:24.894567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3009cd7-0317-4af2-99e2-10abdf0c2daf admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:25.007744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-10a48d56-3731-4026-86a2-430ab5fa30c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '356d78f2184241189afad7853708a8f2', 'request_id': 'req-10a48d56-3731-4026-86a2-430ab5fa30c5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:25.026647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1027/2045] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:24 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:25.028469 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277672b-5705-448c-a34c-d6e5c49657cf None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.028469 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277672b-5705-448c-a34c-d6e5c49657cf None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.028630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277672b-5705-448c-a34c-d6e5c49657cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.045807 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1277672b-5705-448c-a34c-d6e5c49657cf None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:25.047014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1277672b-5705-448c-a34c-d6e5c49657cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:25.076675 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-10a48d56-3731-4026-86a2-430ab5fa30c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '356d78f2184241189afad7853708a8f2', 'request_id': 'req-10a48d56-3731-4026-86a2-430ab5fa30c5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:25.086618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-10a48d56-3731-4026-86a2-430ab5fa30c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '356d78f2184241189afad7853708a8f2', 'request_id': 'req-10a48d56-3731-4026-86a2-430ab5fa30c5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:25.099636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-10a48d56-3731-4026-86a2-430ab5fa30c5 admin admin] The token cache is being invalidate because project 356d78f2184241189afad7853708a8f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:25.100563 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-10a48d56-3731-4026-86a2-430ab5fa30c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:25.100697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-10a48d56-3731-4026-86a2-430ab5fa30c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:25.109233 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1019/2046] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:24 2022] DELETE /identity/v3/projects/356d78f2184241189afad7853708a8f2 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:25.112660 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee364dbb-65c1-477d-94c5-313c11a8b745 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.113108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee364dbb-65c1-477d-94c5-313c11a8b745 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.115021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee364dbb-65c1-477d-94c5-313c11a8b745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.116737 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1028/2047] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:25.119863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277672b-5705-448c-a34c-d6e5c49657cf None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:25.120497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1277672b-5705-448c-a34c-d6e5c49657cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:25.134220 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ee364dbb-65c1-477d-94c5-313c11a8b745 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:25.134852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277672b-5705-448c-a34c-d6e5c49657cf None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:25.135441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ee364dbb-65c1-477d-94c5-313c11a8b745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:25.141846 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae9258-2ef4-4cee-9d29-69de4bc94be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:25.142525 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae9258-2ef4-4cee-9d29-69de4bc94be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.143350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae9258-2ef4-4cee-9d29-69de4bc94be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.143350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae9258-2ef4-4cee-9d29-69de4bc94be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.144405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae9258-2ef4-4cee-9d29-69de4bc94be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:25.144788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1020/2048] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:25.146781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae9258-2ef4-4cee-9d29-69de4bc94be4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:25.149275 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfffe1-ca37-4bf7-936c-4151cd10bcca None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.149577 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfffe1-ca37-4bf7-936c-4151cd10bcca None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.150013 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfffe1-ca37-4bf7-936c-4151cd10bcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.159581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1029/2049] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:25.161050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae9258-2ef4-4cee-9d29-69de4bc94be4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:25.163346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6aae9258-2ef4-4cee-9d29-69de4bc94be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:25.176247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-babfffe1-ca37-4bf7-936c-4151cd10bcca None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:25.177456 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-babfffe1-ca37-4bf7-936c-4151cd10bcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:25.187397 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1021/2050] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:25.195147 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfffe1-ca37-4bf7-936c-4151cd10bcca None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:25.207502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfffe1-ca37-4bf7-936c-4151cd10bcca None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:25.212982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c22220-07a1-4760-be59-baeae901fd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:25.213944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c22220-07a1-4760-be59-baeae901fd83 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.214236 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c22220-07a1-4760-be59-baeae901fd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.214518 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c22220-07a1-4760-be59-baeae901fd83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.215268 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c22220-07a1-4760-be59-baeae901fd83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:25.215581 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c22220-07a1-4760-be59-baeae901fd83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:25.217403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c22220-07a1-4760-be59-baeae901fd83 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:25.231601 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1022/2051] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:25.232567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c22220-07a1-4760-be59-baeae901fd83 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:25.241470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae9258-2ef4-4cee-9d29-69de4bc94be4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:25.245416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c22220-07a1-4760-be59-baeae901fd83 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:25.245539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd00fa-ae0c-4240-b299-df8ff56e7371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:25.246208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd00fa-ae0c-4240-b299-df8ff56e7371 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.246494 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd00fa-ae0c-4240-b299-df8ff56e7371 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.246774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd00fa-ae0c-4240-b299-df8ff56e7371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.250743 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5448a1-01f0-4e28-af2e-930aa5d75dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:25.251486 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5448a1-01f0-4e28-af2e-930aa5d75dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.251808 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5448a1-01f0-4e28-af2e-930aa5d75dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.252099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5448a1-01f0-4e28-af2e-930aa5d75dcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.253858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5448a1-01f0-4e28-af2e-930aa5d75dcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:25.255094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5448a1-01f0-4e28-af2e-930aa5d75dcf admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:25.259161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd00fa-ae0c-4240-b299-df8ff56e7371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:25.260842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd00fa-ae0c-4240-b299-df8ff56e7371 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:25.271757 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1023/2052] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:25.271757 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959e81-717a-4929-9862-6a63aa17dd16 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.271757 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959e81-717a-4929-9862-6a63aa17dd16 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.271757 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8959e81-717a-4929-9862-6a63aa17dd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.275221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1030/2053] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:25.283445 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd00fa-ae0c-4240-b299-df8ff56e7371 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:25.292055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b8959e81-717a-4929-9862-6a63aa17dd16 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:25.293304 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b8959e81-717a-4929-9862-6a63aa17dd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:25.302656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd00fa-ae0c-4240-b299-df8ff56e7371 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:25.306731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1024/2054] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:25.306731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8959e81-717a-4929-9862-6a63aa17dd16 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:25.314287 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8959e81-717a-4929-9862-6a63aa17dd16 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:25.319110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135e4ae-8756-4e38-9008-1f4bbd2077ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:25.320843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e4ae-8756-4e38-9008-1f4bbd2077ae admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.321348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e4ae-8756-4e38-9008-1f4bbd2077ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.321921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e4ae-8756-4e38-9008-1f4bbd2077ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.324676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135e4ae-8756-4e38-9008-1f4bbd2077ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:25.326917 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3135e4ae-8756-4e38-9008-1f4bbd2077ae admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:25.339710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092beea-0d2d-4b59-961e-42689cfbc3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:25.340639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092beea-0d2d-4b59-961e-42689cfbc3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.340941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092beea-0d2d-4b59-961e-42689cfbc3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.341220 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0092beea-0d2d-4b59-961e-42689cfbc3b8 admin admin] PATH_INFO: `/v3/projects/e11a48823b35421aaf7eff47da591bed/users/6649b33da78b468cac2f871ce779f365/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.362040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092beea-0d2d-4b59-961e-42689cfbc3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e11a48823b35421aaf7eff47da591bed, user_id=6649b33da78b468cac2f871ce779f365, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:25.365259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0092beea-0d2d-4b59-961e-42689cfbc3b8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:25.450745 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1025/2055] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:25 2022] PUT /identity/v3/projects/e11a48823b35421aaf7eff47da591bed/users/6649b33da78b468cac2f871ce779f365/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:25.450942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1031/2056] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:25 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:25.451031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092beea-0d2d-4b59-961e-42689cfbc3b8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:25.451856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135e4ae-8756-4e38-9008-1f4bbd2077ae admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:25.518633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:25.561280 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135e4ae-8756-4e38-9008-1f4bbd2077ae admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:25.564533 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0092beea-0d2d-4b59-961e-42689cfbc3b8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:25.569686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b01f7e-b277-45d0-ac55-62f6ddc7c634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:25.570739 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b01f7e-b277-45d0-ac55-62f6ddc7c634 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.571165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b01f7e-b277-45d0-ac55-62f6ddc7c634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.571780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b01f7e-b277-45d0-ac55-62f6ddc7c634 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.572133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49dce5-f555-4a2e-b3b9-dca6b47c6a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:25.572490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b01f7e-b277-45d0-ac55-62f6ddc7c634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:25.573374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49dce5-f555-4a2e-b3b9-dca6b47c6a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.573759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49dce5-f555-4a2e-b3b9-dca6b47c6a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.574050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49dce5-f555-4a2e-b3b9-dca6b47c6a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.574769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b01f7e-b277-45d0-ac55-62f6ddc7c634 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:25.575163 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49dce5-f555-4a2e-b3b9-dca6b47c6a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:25.575567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49dce5-f555-4a2e-b3b9-dca6b47c6a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:25.578096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49dce5-f555-4a2e-b3b9-dca6b47c6a8a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:25.593311 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1026/2057] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:25.594781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78d5a7-3a4c-40f7-b113-e19a6785c933 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.595652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78d5a7-3a4c-40f7-b113-e19a6785c933 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.595984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78d5a7-3a4c-40f7-b113-e19a6785c933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.634268 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8a78d5a7-3a4c-40f7-b113-e19a6785c933 None None] MFA Rules not processed for user `6649b33da78b468cac2f871ce779f365`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:25.636772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8a78d5a7-3a4c-40f7-b113-e19a6785c933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:25.699283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1032/2058] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:25 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:25.700414 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b01f7e-b277-45d0-ac55-62f6ddc7c634 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:25.712550 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b01f7e-b277-45d0-ac55-62f6ddc7c634 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:25.715033 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1027/2059] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:25.716594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78d5a7-3a4c-40f7-b113-e19a6785c933 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:25.725425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6161da-204f-4ffe-b075-27a7dd6efe98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:25.725425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6161da-204f-4ffe-b075-27a7dd6efe98 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.725425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6161da-204f-4ffe-b075-27a7dd6efe98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.725425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6161da-204f-4ffe-b075-27a7dd6efe98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.726024 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6161da-204f-4ffe-b075-27a7dd6efe98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:25.728238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6161da-204f-4ffe-b075-27a7dd6efe98 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:25.730281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78d5a7-3a4c-40f7-b113-e19a6785c933 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:25.738811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166c267-ec7c-49d3-8798-9972df072d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:25.739737 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166c267-ec7c-49d3-8798-9972df072d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.740093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166c267-ec7c-49d3-8798-9972df072d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.740444 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166c267-ec7c-49d3-8798-9972df072d2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.741265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166c267-ec7c-49d3-8798-9972df072d2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:25.743024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166c267-ec7c-49d3-8798-9972df072d2a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:25.757020 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1028/2060] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:25.757020 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166c267-ec7c-49d3-8798-9972df072d2a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:25.765285 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166c267-ec7c-49d3-8798-9972df072d2a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:25.770693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3415dfb-e13b-40dc-af94-1fcba7afec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:25.771351 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3415dfb-e13b-40dc-af94-1fcba7afec1c admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.771638 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3415dfb-e13b-40dc-af94-1fcba7afec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.771920 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3415dfb-e13b-40dc-af94-1fcba7afec1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.772620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3415dfb-e13b-40dc-af94-1fcba7afec1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:25.774880 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3415dfb-e13b-40dc-af94-1fcba7afec1c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:25.868987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1033/2061] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:25 2022] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:25.872107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6161da-204f-4ffe-b075-27a7dd6efe98 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:25.887535 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1029/2062] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:25 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:25.893069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3415dfb-e13b-40dc-af94-1fcba7afec1c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:25.893069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f3415dfb-e13b-40dc-af94-1fcba7afec1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:25.953551 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6161da-204f-4ffe-b075-27a7dd6efe98 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:25.964669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3415dfb-e13b-40dc-af94-1fcba7afec1c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:25.969858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:25.970736 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:25.971018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:25.971327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] PATH_INFO: `/v3/projects/d195a100e3e746a39ea2305e7d833604` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:25.973231 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d195a100e3e746a39ea2305e7d833604)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:25.975260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:26.018275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3345d-0d77-40ce-9adb-4df316bd51b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:26.019381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3345d-0d77-40ce-9adb-4df316bd51b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:26.019821 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3345d-0d77-40ce-9adb-4df316bd51b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:26.020336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3345d-0d77-40ce-9adb-4df316bd51b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:26.020994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3345d-0d77-40ce-9adb-4df316bd51b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:26.022713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3345d-0d77-40ce-9adb-4df316bd51b9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:26.035483 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1034/2063] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:26.036740 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3345d-0d77-40ce-9adb-4df316bd51b9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:26.047388 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3345d-0d77-40ce-9adb-4df316bd51b9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:26.053302 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da269d86-226d-4125-b1bb-19edf2da04cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:26.053798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da269d86-226d-4125-b1bb-19edf2da04cc admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:26.054093 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da269d86-226d-4125-b1bb-19edf2da04cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:26.054375 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da269d86-226d-4125-b1bb-19edf2da04cc admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:26.055075 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da269d86-226d-4125-b1bb-19edf2da04cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:26.057041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da269d86-226d-4125-b1bb-19edf2da04cc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:26.088147 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd195a100e3e746a39ea2305e7d833604', 'request_id': 'req-bca3f240-eabe-430a-8f24-7fecb3df69d2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.186226 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd195a100e3e746a39ea2305e7d833604', 'request_id': 'req-bca3f240-eabe-430a-8f24-7fecb3df69d2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.189015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:26.196061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1035/2064] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:26 2022] POST /identity/v3/users => generated 288 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:26.196061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da269d86-226d-4125-b1bb-19edf2da04cc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:26.198096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd195a100e3e746a39ea2305e7d833604', 'request_id': 'req-bca3f240-eabe-430a-8f24-7fecb3df69d2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.204862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da269d86-226d-4125-b1bb-19edf2da04cc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:26.214438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] The token cache is being invalidate because project d195a100e3e746a39ea2305e7d833604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:26.214858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.216212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.218156 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1030/2065] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:25 2022] DELETE /identity/v3/projects/d195a100e3e746a39ea2305e7d833604 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:26.219047 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:26.220502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:26.278475 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa22cc-9173-4c3f-83f8-f7572cb06936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:26.279618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa22cc-9173-4c3f-83f8-f7572cb06936 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:26.280069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa22cc-9173-4c3f-83f8-f7572cb06936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:26.280349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa22cc-9173-4c3f-83f8-f7572cb06936 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:26.281112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa22cc-9173-4c3f-83f8-f7572cb06936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:26.283215 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aa22cc-9173-4c3f-83f8-f7572cb06936 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:26.295683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3f240-eabe-430a-8f24-7fecb3df69d2 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:26.302058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637ee57-0890-4067-8bbf-0ffd1aeb9124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:26.303170 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637ee57-0890-4067-8bbf-0ffd1aeb9124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:26.303545 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637ee57-0890-4067-8bbf-0ffd1aeb9124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:26.303904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637ee57-0890-4067-8bbf-0ffd1aeb9124 admin admin] PATH_INFO: `/v3/users/e6554a0c8b044199a6568557d59c2012` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:26.305229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637ee57-0890-4067-8bbf-0ffd1aeb9124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6554a0c8b044199a6568557d59c2012)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:26.307228 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637ee57-0890-4067-8bbf-0ffd1aeb9124 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:26.375622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1036/2066] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:26 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:26.377105 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa22cc-9173-4c3f-83f8-f7572cb06936 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:26.381312 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c2aa22cc-9173-4c3f-83f8-f7572cb06936 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:26.392895 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aa22cc-9173-4c3f-83f8-f7572cb06936 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:26.400115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7b0eb-4dac-4893-b093-a9394a9443c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:26.401115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7b0eb-4dac-4893-b093-a9394a9443c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:26.401524 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7b0eb-4dac-4893-b093-a9394a9443c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:26.401930 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7b0eb-4dac-4893-b093-a9394a9443c4 admin admin] PATH_INFO: `/v3/projects/9e82122991b84f7885d332ec69f38373/users/5b96d2ccbfce4fb486ab59a834a9a6e4/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:26.417756 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7b0eb-4dac-4893-b093-a9394a9443c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e82122991b84f7885d332ec69f38373, user_id=5b96d2ccbfce4fb486ab59a834a9a6e4, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:26.420362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7b0eb-4dac-4893-b093-a9394a9443c4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:26.512265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1037/2067] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:26 2022] PUT /identity/v3/projects/9e82122991b84f7885d332ec69f38373/users/5b96d2ccbfce4fb486ab59a834a9a6e4/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:26.512972 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7b0eb-4dac-4893-b093-a9394a9443c4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:26.514654 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cfa7b0eb-4dac-4893-b093-a9394a9443c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:26.544251 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e637ee57-0890-4067-8bbf-0ffd1aeb9124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6554a0c8b044199a6568557d59c2012'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.544922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e637ee57-0890-4067-8bbf-0ffd1aeb9124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6554a0c8b044199a6568557d59c2012'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.545544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e637ee57-0890-4067-8bbf-0ffd1aeb9124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6554a0c8b044199a6568557d59c2012'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.561812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e637ee57-0890-4067-8bbf-0ffd1aeb9124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6554a0c8b044199a6568557d59c2012'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.568764 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e637ee57-0890-4067-8bbf-0ffd1aeb9124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6554a0c8b044199a6568557d59c2012'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.604166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7b0eb-4dac-4893-b093-a9394a9443c4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:26.609415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce79b32-8e55-4b78-b577-4bbd34c7e31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:26.610228 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce79b32-8e55-4b78-b577-4bbd34c7e31e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:26.610613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce79b32-8e55-4b78-b577-4bbd34c7e31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:26.610983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce79b32-8e55-4b78-b577-4bbd34c7e31e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:26.612084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce79b32-8e55-4b78-b577-4bbd34c7e31e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:26.614548 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce79b32-8e55-4b78-b577-4bbd34c7e31e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:26.626146 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1038/2068] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:26.627099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce79b32-8e55-4b78-b577-4bbd34c7e31e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:26.628795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bce79b32-8e55-4b78-b577-4bbd34c7e31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:26.644415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce79b32-8e55-4b78-b577-4bbd34c7e31e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:26.648522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71600f43-88d7-4be8-8aef-611c246048da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:26.649417 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71600f43-88d7-4be8-8aef-611c246048da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:26.649700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71600f43-88d7-4be8-8aef-611c246048da admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:26.650006 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71600f43-88d7-4be8-8aef-611c246048da admin admin] PATH_INFO: `/v3/users/26489bcc1ce94784acc83f3a3e003112` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:26.651251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71600f43-88d7-4be8-8aef-611c246048da admin admin] RBAC: Authorizing `identity:delete_user(user_id=26489bcc1ce94784acc83f3a3e003112)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:26.653318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71600f43-88d7-4be8-8aef-611c246048da admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:26.679160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1031/2069] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:26 2022] DELETE /identity/v3/users/e6554a0c8b044199a6568557d59c2012 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:26.684592 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637ee57-0890-4067-8bbf-0ffd1aeb9124 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:26.686453 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e637ee57-0890-4067-8bbf-0ffd1aeb9124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:26.771112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637ee57-0890-4067-8bbf-0ffd1aeb9124 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:26.776119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9c943-e553-4c1f-a32f-9d16ad083531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:26.776807 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9c943-e553-4c1f-a32f-9d16ad083531 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:26.777134 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9c943-e553-4c1f-a32f-9d16ad083531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:26.777412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9c943-e553-4c1f-a32f-9d16ad083531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:26.778139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9c943-e553-4c1f-a32f-9d16ad083531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:26.779892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9c943-e553-4c1f-a32f-9d16ad083531 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:26.792316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1032/2070] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:26.794008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438a1a1-7f61-43ce-9bda-7d7162c5974c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:26.794756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438a1a1-7f61-43ce-9bda-7d7162c5974c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:26.795490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438a1a1-7f61-43ce-9bda-7d7162c5974c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:26.824978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e438a1a1-7f61-43ce-9bda-7d7162c5974c None None] MFA Rules not processed for user `5b96d2ccbfce4fb486ab59a834a9a6e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:26.826289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e438a1a1-7f61-43ce-9bda-7d7162c5974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:26.842127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-71600f43-88d7-4be8-8aef-611c246048da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26489bcc1ce94784acc83f3a3e003112'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.902357 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1033/2071] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:26.902357 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438a1a1-7f61-43ce-9bda-7d7162c5974c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:26.902357 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e438a1a1-7f61-43ce-9bda-7d7162c5974c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:26.914528 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438a1a1-7f61-43ce-9bda-7d7162c5974c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:26.919188 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a670d-abc6-4856-84c7-5044e832490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:26.919859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a670d-abc6-4856-84c7-5044e832490e admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:26.920142 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a670d-abc6-4856-84c7-5044e832490e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:26.920417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a670d-abc6-4856-84c7-5044e832490e admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:26.921154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a670d-abc6-4856-84c7-5044e832490e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:26.922858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a670d-abc6-4856-84c7-5044e832490e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:26.932872 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1034/2072] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:26.934201 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d332ab1-2468-4253-8e7a-2295e6887f9e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:26.934507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d332ab1-2468-4253-8e7a-2295e6887f9e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:26.934767 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d332ab1-2468-4253-8e7a-2295e6887f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:26.945568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-71600f43-88d7-4be8-8aef-611c246048da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26489bcc1ce94784acc83f3a3e003112'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.947520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-71600f43-88d7-4be8-8aef-611c246048da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26489bcc1ce94784acc83f3a3e003112'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.954899 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0d332ab1-2468-4253-8e7a-2295e6887f9e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:26.956213 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0d332ab1-2468-4253-8e7a-2295e6887f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:26.960694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-71600f43-88d7-4be8-8aef-611c246048da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26489bcc1ce94784acc83f3a3e003112'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.961396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-71600f43-88d7-4be8-8aef-611c246048da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26489bcc1ce94784acc83f3a3e003112'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:26.964877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1035/2073] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:26.965750 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d332ab1-2468-4253-8e7a-2295e6887f9e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:26.975685 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d332ab1-2468-4253-8e7a-2295e6887f9e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:26.980677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb2144-2a54-4478-a8f8-72d5c779d632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:26.981581 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb2144-2a54-4478-a8f8-72d5c779d632 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:26.981941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb2144-2a54-4478-a8f8-72d5c779d632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:26.982261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb2144-2a54-4478-a8f8-72d5c779d632 admin admin] PATH_INFO: `/v3/projects/a7a080242e4546d9885c2f67332b0af8/users/adbbedaa7d8b42db8dccad5a8d348699/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:26.991996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1039/2074] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:26 2022] DELETE /identity/v3/users/26489bcc1ce94784acc83f3a3e003112 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:26.991996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71600f43-88d7-4be8-8aef-611c246048da admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:26.992232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-71600f43-88d7-4be8-8aef-611c246048da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:26.997656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb2144-2a54-4478-a8f8-72d5c779d632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a080242e4546d9885c2f67332b0af8, user_id=adbbedaa7d8b42db8dccad5a8d348699, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:27.000534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb2144-2a54-4478-a8f8-72d5c779d632 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:27.084513 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71600f43-88d7-4be8-8aef-611c246048da admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:27.089848 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdcf88-deba-4026-95d2-75938944b60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:27.090531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdcf88-deba-4026-95d2-75938944b60a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:27.090862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdcf88-deba-4026-95d2-75938944b60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:27.091089 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fdcf88-deba-4026-95d2-75938944b60a admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:27.091784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdcf88-deba-4026-95d2-75938944b60a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:27.093705 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fdcf88-deba-4026-95d2-75938944b60a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:27.094501 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1036/2075] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:26 2022] PUT /identity/v3/projects/a7a080242e4546d9885c2f67332b0af8/users/adbbedaa7d8b42db8dccad5a8d348699/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:27.097394 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb2144-2a54-4478-a8f8-72d5c779d632 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:27.097394 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-cccb2144-2a54-4478-a8f8-72d5c779d632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:27.163191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb2144-2a54-4478-a8f8-72d5c779d632 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:27.167969 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e0ec6-c5d9-4fd4-ad23-8af7594a65b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:27.168866 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e0ec6-c5d9-4fd4-ad23-8af7594a65b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:27.169150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e0ec6-c5d9-4fd4-ad23-8af7594a65b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:27.169430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e0ec6-c5d9-4fd4-ad23-8af7594a65b2 admin admin] PATH_INFO: `/v3/projects/c664192f021d4c5da1b59cb6bd071745/users/c6b2af58b8154f35bfe2c0cabb03c0b4/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:27.183492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1040/2076] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:26 2022] POST /identity/v3/projects => generated 389 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:27.184721 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdcf88-deba-4026-95d2-75938944b60a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:27.185832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e0ec6-c5d9-4fd4-ad23-8af7594a65b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c664192f021d4c5da1b59cb6bd071745, user_id=c6b2af58b8154f35bfe2c0cabb03c0b4, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:27.186479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-15fdcf88-deba-4026-95d2-75938944b60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:27.188767 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e0ec6-c5d9-4fd4-ad23-8af7594a65b2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:27.248361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fdcf88-deba-4026-95d2-75938944b60a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:27.252183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b0c15-d16e-44c3-9fdd-b96238aec7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:27.252840 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b0c15-d16e-44c3-9fdd-b96238aec7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:27.253147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b0c15-d16e-44c3-9fdd-b96238aec7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:27.254048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8b0c15-d16e-44c3-9fdd-b96238aec7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:27.256242 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0b8b0c15-d16e-44c3-9fdd-b96238aec7a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:27.301606 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1037/2077] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:27 2022] PUT /identity/v3/projects/c664192f021d4c5da1b59cb6bd071745/users/c6b2af58b8154f35bfe2c0cabb03c0b4/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:27.301606 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e0ec6-c5d9-4fd4-ad23-8af7594a65b2 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:27.303761 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c91e0ec6-c5d9-4fd4-ad23-8af7594a65b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:27.324826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b0c15-d16e-44c3-9fdd-b96238aec7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:27.326486 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8b0c15-d16e-44c3-9fdd-b96238aec7a4 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:27.337698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1041/2078] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:27.338549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b0c15-d16e-44c3-9fdd-b96238aec7a4 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:27.348137 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8b0c15-d16e-44c3-9fdd-b96238aec7a4 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:27.399701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e0ec6-c5d9-4fd4-ad23-8af7594a65b2 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:27.405957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d49d1-dac2-41c4-bc30-a23e03fe0ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:27.406749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d49d1-dac2-41c4-bc30-a23e03fe0ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:27.407039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d49d1-dac2-41c4-bc30-a23e03fe0ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:27.407316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d49d1-dac2-41c4-bc30-a23e03fe0ba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:27.408063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d49d1-dac2-41c4-bc30-a23e03fe0ba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:27.410385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878d49d1-dac2-41c4-bc30-a23e03fe0ba4 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:27.421150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1038/2079] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:27.423664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b919e06-5d9c-4f29-884e-fb5bfd2a7d6b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:27.423664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b919e06-5d9c-4f29-884e-fb5bfd2a7d6b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:27.423664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b919e06-5d9c-4f29-884e-fb5bfd2a7d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:27.428319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7d113-af27-4bf3-9281-df079c1d5d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:27.429077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7d113-af27-4bf3-9281-df079c1d5d25 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:27.429366 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7d113-af27-4bf3-9281-df079c1d5d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:27.429701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7d113-af27-4bf3-9281-df079c1d5d25 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:27.430380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7d113-af27-4bf3-9281-df079c1d5d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:27.437830 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7d113-af27-4bf3-9281-df079c1d5d25 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:27.459324 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4b919e06-5d9c-4f29-884e-fb5bfd2a7d6b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:27.460753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4b919e06-5d9c-4f29-884e-fb5bfd2a7d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:27.469399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1039/2080] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:27.470443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b919e06-5d9c-4f29-884e-fb5bfd2a7d6b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:27.481143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b919e06-5d9c-4f29-884e-fb5bfd2a7d6b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:27.485786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7792e5-52cb-43be-b907-82403c23f2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:27.486680 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7792e5-52cb-43be-b907-82403c23f2fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:27.486963 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7792e5-52cb-43be-b907-82403c23f2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:27.487241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7792e5-52cb-43be-b907-82403c23f2fe admin admin] PATH_INFO: `/v3/projects/a7a080242e4546d9885c2f67332b0af8/users/adbbedaa7d8b42db8dccad5a8d348699/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:27.489837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7792e5-52cb-43be-b907-82403c23f2fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a080242e4546d9885c2f67332b0af8, user_id=adbbedaa7d8b42db8dccad5a8d348699, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:27.492494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7792e5-52cb-43be-b907-82403c23f2fe admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:27.506602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1040/2081] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:27 2022] PUT /identity/v3/projects/a7a080242e4546d9885c2f67332b0af8/users/adbbedaa7d8b42db8dccad5a8d348699/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:27.507580 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7792e5-52cb-43be-b907-82403c23f2fe admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:27.539670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1042/2082] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:27 2022] POST /identity/v3/users => generated 301 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:27.539670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0afbe-3a62-4217-9a72-073c13234b9f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:27.539670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0afbe-3a62-4217-9a72-073c13234b9f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:27.539670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0afbe-3a62-4217-9a72-073c13234b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:27.571209 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-35c0afbe-3a62-4217-9a72-073c13234b9f None None] MFA Rules not processed for user `adbbedaa7d8b42db8dccad5a8d348699`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:27.574761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-35c0afbe-3a62-4217-9a72-073c13234b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:27.574919 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7792e5-52cb-43be-b907-82403c23f2fe admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:27.579654 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c5a7a-9a0d-4017-9687-32863c7953cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:27.580363 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c5a7a-9a0d-4017-9687-32863c7953cf service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:27.580617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c5a7a-9a0d-4017-9687-32863c7953cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:27.580969 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c5a7a-9a0d-4017-9687-32863c7953cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:27.664063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1043/2083] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:27.668967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0afbe-3a62-4217-9a72-073c13234b9f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:27.672880 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c5a7a-9a0d-4017-9687-32863c7953cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:27.674106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:27.681833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c5a7a-9a0d-4017-9687-32863c7953cf service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:27.682456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0afbe-3a62-4217-9a72-073c13234b9f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:27.687137 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e21281-ca7b-423e-bae3-f8645e8902b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:27.687961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1041/2084] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:27.688084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e21281-ca7b-423e-bae3-f8645e8902b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:27.688260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e21281-ca7b-423e-bae3-f8645e8902b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:27.688545 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e21281-ca7b-423e-bae3-f8645e8902b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:27.688652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c5a7a-9a0d-4017-9687-32863c7953cf service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:27.689510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e21281-ca7b-423e-bae3-f8645e8902b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:27.690245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c34c5a7a-9a0d-4017-9687-32863c7953cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:27.692055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e21281-ca7b-423e-bae3-f8645e8902b9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:27.710170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1044/2085] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:27.716216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e21281-ca7b-423e-bae3-f8645e8902b9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:27.729050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e21281-ca7b-423e-bae3-f8645e8902b9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:27.737566 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc94f21-bab5-40fe-b218-24350e795f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:27.739394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc94f21-bab5-40fe-b218-24350e795f10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:27.739832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc94f21-bab5-40fe-b218-24350e795f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:27.740288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc94f21-bab5-40fe-b218-24350e795f10 admin admin] PATH_INFO: `/v3/projects/3dfc5d78e4354e31aa6536652b828978/users/a10b1c912d244995920d8ac9732ec508/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:27.759931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc94f21-bab5-40fe-b218-24350e795f10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dfc5d78e4354e31aa6536652b828978, user_id=a10b1c912d244995920d8ac9732ec508, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:27.761424 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c5a7a-9a0d-4017-9687-32863c7953cf service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:27.763274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc94f21-bab5-40fe-b218-24350e795f10 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:27.765834 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62336ce3-78e6-4a50-b80b-420cb6ed4633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:27.766508 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62336ce3-78e6-4a50-b80b-420cb6ed4633 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:27.766794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62336ce3-78e6-4a50-b80b-420cb6ed4633 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:27.767127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62336ce3-78e6-4a50-b80b-420cb6ed4633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:27.770177 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-62336ce3-78e6-4a50-b80b-420cb6ed4633 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:27.840388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62336ce3-78e6-4a50-b80b-420cb6ed4633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:27.841935 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62336ce3-78e6-4a50-b80b-420cb6ed4633 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:27.852967 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1042/2086] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:27.873255 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1045/2087] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:27 2022] PUT /identity/v3/projects/3dfc5d78e4354e31aa6536652b828978/users/a10b1c912d244995920d8ac9732ec508/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:27.884059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62336ce3-78e6-4a50-b80b-420cb6ed4633 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:27.896940 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:27.903761 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62336ce3-78e6-4a50-b80b-420cb6ed4633 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:27.978637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70a215-67b8-4bbb-aca3-90b3874ad1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:27.979869 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70a215-67b8-4bbb-aca3-90b3874ad1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:27.980167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70a215-67b8-4bbb-aca3-90b3874ad1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:27.980452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab70a215-67b8-4bbb-aca3-90b3874ad1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:27.981203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70a215-67b8-4bbb-aca3-90b3874ad1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:27.982872 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab70a215-67b8-4bbb-aca3-90b3874ad1c1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:27.995393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc94f21-bab5-40fe-b218-24350e795f10 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:27.997934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1043/2088] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:27.998703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1cc94f21-bab5-40fe-b218-24350e795f10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:27.998825 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70a215-67b8-4bbb-aca3-90b3874ad1c1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:28.009822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab70a215-67b8-4bbb-aca3-90b3874ad1c1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:28.019301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b37c2-5842-421a-90be-d095d99e4b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:28.025837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b37c2-5842-421a-90be-d095d99e4b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:28.025837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b37c2-5842-421a-90be-d095d99e4b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:28.025837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b37c2-5842-421a-90be-d095d99e4b76 admin admin] PATH_INFO: `/v3/projects/3dfc5d78e4354e31aa6536652b828978/users/a10b1c912d244995920d8ac9732ec508/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:28.026355 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc94f21-bab5-40fe-b218-24350e795f10 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:28.028631 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:28.028781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b37c2-5842-421a-90be-d095d99e4b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dfc5d78e4354e31aa6536652b828978, user_id=a10b1c912d244995920d8ac9732ec508, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:28.030546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:28.031084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:28.032099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] PATH_INFO: `/v3/projects/8d1af0a1fab7499cb4298533fb306fad` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:28.033620 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d1af0a1fab7499cb4298533fb306fad)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:28.033781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870b37c2-5842-421a-90be-d095d99e4b76 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:28.037291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:28.058668 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1044/2089] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:27 2022] PUT /identity/v3/projects/3dfc5d78e4354e31aa6536652b828978/users/a10b1c912d244995920d8ac9732ec508/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:28.078301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824817-570a-4c69-9d5f-813b610b0b9a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:28.078301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824817-570a-4c69-9d5f-813b610b0b9a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:28.078301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53824817-570a-4c69-9d5f-813b610b0b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:28.122632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-53824817-570a-4c69-9d5f-813b610b0b9a None None] MFA Rules not processed for user `a10b1c912d244995920d8ac9732ec508`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:28.124058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-53824817-570a-4c69-9d5f-813b610b0b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:28.245612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1045/2090] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:28.245612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53824817-570a-4c69-9d5f-813b610b0b9a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:28.254844 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-53824817-570a-4c69-9d5f-813b610b0b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:28.256666 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d1af0a1fab7499cb4298533fb306fad', 'request_id': 'req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:28.325300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53824817-570a-4c69-9d5f-813b610b0b9a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:28.369235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d1af0a1fab7499cb4298533fb306fad', 'request_id': 'req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:28.378168 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d1af0a1fab7499cb4298533fb306fad', 'request_id': 'req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:28.392586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] The token cache is being invalidate because project 8d1af0a1fab7499cb4298533fb306fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:28.393539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:28.394802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:28.397930 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1046/2091] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:27 2022] DELETE /identity/v3/projects/8d1af0a1fab7499cb4298533fb306fad => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:28.399102 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:28.401437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:28.403165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819cc45-5f93-43af-92c7-22032b16c387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:28.404190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819cc45-5f93-43af-92c7-22032b16c387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:28.404497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819cc45-5f93-43af-92c7-22032b16c387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:28.404782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819cc45-5f93-43af-92c7-22032b16c387 admin admin] PATH_INFO: `/v3/projects/71d5310e06854c9f907a5ccd159a720c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:28.406072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819cc45-5f93-43af-92c7-22032b16c387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d5310e06854c9f907a5ccd159a720c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:28.410142 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819cc45-5f93-43af-92c7-22032b16c387 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:28.478309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6c85c-7bb4-4f42-a7e2-982fe7b00b69 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:28.482390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc062fc-a7fe-4a04-910b-2b30cda342a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:28.483047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc062fc-a7fe-4a04-910b-2b30cda342a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:28.483344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc062fc-a7fe-4a04-910b-2b30cda342a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:28.483607 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc062fc-a7fe-4a04-910b-2b30cda342a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:28.485389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6cc062fc-a7fe-4a04-910b-2b30cda342a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:28.520190 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:28.524176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3819cc45-5f93-43af-92c7-22032b16c387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d5310e06854c9f907a5ccd159a720c', 'request_id': 'req-3819cc45-5f93-43af-92c7-22032b16c387'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:28.556999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc062fc-a7fe-4a04-910b-2b30cda342a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:28.558535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc062fc-a7fe-4a04-910b-2b30cda342a5 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:28.570654 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1047/2092] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:28.571581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc062fc-a7fe-4a04-910b-2b30cda342a5 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:28.575254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6cc062fc-a7fe-4a04-910b-2b30cda342a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:28.586915 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc062fc-a7fe-4a04-910b-2b30cda342a5 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:28.591409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3819cc45-5f93-43af-92c7-22032b16c387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d5310e06854c9f907a5ccd159a720c', 'request_id': 'req-3819cc45-5f93-43af-92c7-22032b16c387'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:28.615620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3819cc45-5f93-43af-92c7-22032b16c387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d5310e06854c9f907a5ccd159a720c', 'request_id': 'req-3819cc45-5f93-43af-92c7-22032b16c387'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:28.655611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3819cc45-5f93-43af-92c7-22032b16c387 admin admin] The token cache is being invalidate because project 71d5310e06854c9f907a5ccd159a720c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:28.655611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3819cc45-5f93-43af-92c7-22032b16c387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:28.655611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-3819cc45-5f93-43af-92c7-22032b16c387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:28.655611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1046/2093] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:28 2022] DELETE /identity/v3/projects/71d5310e06854c9f907a5ccd159a720c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:28.655611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51c4a-c83c-4fba-8286-01ca6b13177c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:28.656047 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51c4a-c83c-4fba-8286-01ca6b13177c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:28.658719 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f51c4a-c83c-4fba-8286-01ca6b13177c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:28.660290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c9589-d431-475d-acdc-1e8e68384aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:28.661060 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c9589-d431-475d-acdc-1e8e68384aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:28.661313 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c9589-d431-475d-acdc-1e8e68384aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:28.661682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7c9589-d431-475d-acdc-1e8e68384aa4 admin admin] PATH_INFO: `/v3/users/f7c6d06a159a40d492a298cc27cfe495` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:28.663332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c9589-d431-475d-acdc-1e8e68384aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c6d06a159a40d492a298cc27cfe495)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:28.665086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7c9589-d431-475d-acdc-1e8e68384aa4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:28.686818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e5f51c4a-c83c-4fba-8286-01ca6b13177c None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:28.688156 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e5f51c4a-c83c-4fba-8286-01ca6b13177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:28.701782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1047/2094] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:28.706782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91aeea-d5bf-4566-ae88-c487f14a340a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:28.707362 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91aeea-d5bf-4566-ae88-c487f14a340a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:28.708176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c91aeea-d5bf-4566-ae88-c487f14a340a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:28.729280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0c91aeea-d5bf-4566-ae88-c487f14a340a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:28.730641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0c91aeea-d5bf-4566-ae88-c487f14a340a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:28.745038 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1048/2095] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:48:28.746159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91aeea-d5bf-4566-ae88-c487f14a340a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:28.757224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c91aeea-d5bf-4566-ae88-c487f14a340a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:28.763235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c821436-8122-49b2-b29d-83fad62d77d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:28.764080 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c821436-8122-49b2-b29d-83fad62d77d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:28.764374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c821436-8122-49b2-b29d-83fad62d77d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:28.764657 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c821436-8122-49b2-b29d-83fad62d77d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:28.766032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c821436-8122-49b2-b29d-83fad62d77d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:28.766352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c821436-8122-49b2-b29d-83fad62d77d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:28.768232 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c821436-8122-49b2-b29d-83fad62d77d3 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:28.785019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1049/2096] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:28.791589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c821436-8122-49b2-b29d-83fad62d77d3 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:28.808811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c821436-8122-49b2-b29d-83fad62d77d3 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:28.808811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee192d52-698c-4177-91f5-8ac9af2a8707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:28.809331 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee192d52-698c-4177-91f5-8ac9af2a8707 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:28.811208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee192d52-698c-4177-91f5-8ac9af2a8707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:28.811208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee192d52-698c-4177-91f5-8ac9af2a8707 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:28.811208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee192d52-698c-4177-91f5-8ac9af2a8707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:28.812593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee192d52-698c-4177-91f5-8ac9af2a8707 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:28.971291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1050/2097] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:28 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:48:28.976024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee192d52-698c-4177-91f5-8ac9af2a8707 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:28.978107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ee192d52-698c-4177-91f5-8ac9af2a8707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:29.011798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7d7c9589-d431-475d-acdc-1e8e68384aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c6d06a159a40d492a298cc27cfe495'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:29.049364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee192d52-698c-4177-91f5-8ac9af2a8707 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:29.055219 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b63bb37-15af-41b8-bc6b-0130618959d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:29.056129 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63bb37-15af-41b8-bc6b-0130618959d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:29.056417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63bb37-15af-41b8-bc6b-0130618959d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:29.056696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b63bb37-15af-41b8-bc6b-0130618959d2 admin admin] PATH_INFO: `/v3/users/5b96d2ccbfce4fb486ab59a834a9a6e4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:29.058052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63bb37-15af-41b8-bc6b-0130618959d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b96d2ccbfce4fb486ab59a834a9a6e4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:29.061587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b63bb37-15af-41b8-bc6b-0130618959d2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:29.111723 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7d7c9589-d431-475d-acdc-1e8e68384aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c6d06a159a40d492a298cc27cfe495'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:29.112443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7d7c9589-d431-475d-acdc-1e8e68384aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c6d06a159a40d492a298cc27cfe495'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:29.120658 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7d7c9589-d431-475d-acdc-1e8e68384aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c6d06a159a40d492a298cc27cfe495'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:29.121376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7d7c9589-d431-475d-acdc-1e8e68384aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c6d06a159a40d492a298cc27cfe495'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:29.138829 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1048/2098] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:28 2022] DELETE /identity/v3/users/f7c6d06a159a40d492a298cc27cfe495 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:29.139648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c9589-d431-475d-acdc-1e8e68384aa4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:29.140963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7d7c9589-d431-475d-acdc-1e8e68384aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:29.209201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:29.214668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7c9589-d431-475d-acdc-1e8e68384aa4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:29.219821 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d85f4-fff4-4555-8a46-474cb1a833c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:29.220515 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d85f4-fff4-4555-8a46-474cb1a833c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:29.220788 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d85f4-fff4-4555-8a46-474cb1a833c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:29.221219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d85f4-fff4-4555-8a46-474cb1a833c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:29.222524 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d85f4-fff4-4555-8a46-474cb1a833c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:29.224524 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d85f4-fff4-4555-8a46-474cb1a833c5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:29.272468 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4b63bb37-15af-41b8-bc6b-0130618959d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b96d2ccbfce4fb486ab59a834a9a6e4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:29.273163 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4b63bb37-15af-41b8-bc6b-0130618959d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b96d2ccbfce4fb486ab59a834a9a6e4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:29.288831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4b63bb37-15af-41b8-bc6b-0130618959d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b96d2ccbfce4fb486ab59a834a9a6e4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:29.297765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4b63bb37-15af-41b8-bc6b-0130618959d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b96d2ccbfce4fb486ab59a834a9a6e4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:29.306722 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4b63bb37-15af-41b8-bc6b-0130618959d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b96d2ccbfce4fb486ab59a834a9a6e4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:29.337640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1049/2099] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:29 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:29.341580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d85f4-fff4-4555-8a46-474cb1a833c5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:29.343542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-102d85f4-fff4-4555-8a46-474cb1a833c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:29.359430 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d85f4-fff4-4555-8a46-474cb1a833c5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:29.368032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500d7e5-db3a-4a36-8738-9baa76121684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:29.368815 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500d7e5-db3a-4a36-8738-9baa76121684 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:29.369295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500d7e5-db3a-4a36-8738-9baa76121684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:29.369584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b500d7e5-db3a-4a36-8738-9baa76121684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:29.370367 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500d7e5-db3a-4a36-8738-9baa76121684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:29.372048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b500d7e5-db3a-4a36-8738-9baa76121684 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:29.384382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1050/2100] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:48:29.388469 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500d7e5-db3a-4a36-8738-9baa76121684 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:29.398514 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1051/2101] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:28 2022] DELETE /identity/v3/users/5b96d2ccbfce4fb486ab59a834a9a6e4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:29.400937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b500d7e5-db3a-4a36-8738-9baa76121684 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:29.405090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa7d81-73c1-43e4-9bc3-ba8b544c249d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:29.405466 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa7d81-73c1-43e4-9bc3-ba8b544c249d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:29.406097 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa7d81-73c1-43e4-9bc3-ba8b544c249d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:29.425406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-18fa7d81-73c1-43e4-9bc3-ba8b544c249d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:29.427034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-18fa7d81-73c1-43e4-9bc3-ba8b544c249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:29.473012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:29.476210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dd64b-c7dc-454b-9129-c61857cfd49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:29.484142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dd64b-c7dc-454b-9129-c61857cfd49e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:29.484142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dd64b-c7dc-454b-9129-c61857cfd49e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:29.484142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31dd64b-c7dc-454b-9129-c61857cfd49e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:29.484142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dd64b-c7dc-454b-9129-c61857cfd49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:29.484142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31dd64b-c7dc-454b-9129-c61857cfd49e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:29.492113 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1051/2102] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:48:29.496324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dd64b-c7dc-454b-9129-c61857cfd49e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:29.507686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1052/2103] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:29.508618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31dd64b-c7dc-454b-9129-c61857cfd49e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:29.517166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9a531-b730-4edc-b9ae-ed9041bd3e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:29.517791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa7d81-73c1-43e4-9bc3-ba8b544c249d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:29.518114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9a531-b730-4edc-b9ae-ed9041bd3e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:29.518437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9a531-b730-4edc-b9ae-ed9041bd3e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:29.519191 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9a531-b730-4edc-b9ae-ed9041bd3e68 admin admin] PATH_INFO: `/v3/projects/ecaf6b6d596d45c597e10fdb312fcf0f/users/c838da622fa6439fb10caf88e90deaa1/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:29.521021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-18fa7d81-73c1-43e4-9bc3-ba8b544c249d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:29.535868 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9a531-b730-4edc-b9ae-ed9041bd3e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecaf6b6d596d45c597e10fdb312fcf0f, user_id=c838da622fa6439fb10caf88e90deaa1, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:29.541811 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9a531-b730-4edc-b9ae-ed9041bd3e68 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:29.584889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa7d81-73c1-43e4-9bc3-ba8b544c249d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:29.588716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791351c-e4ad-4c1c-a8d5-28b27989b7d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:29.589454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791351c-e4ad-4c1c-a8d5-28b27989b7d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:29.589762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791351c-e4ad-4c1c-a8d5-28b27989b7d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:29.590044 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791351c-e4ad-4c1c-a8d5-28b27989b7d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:29.600189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791351c-e4ad-4c1c-a8d5-28b27989b7d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:29.601639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791351c-e4ad-4c1c-a8d5-28b27989b7d8 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:29.611624 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1053/2104] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:48:29.634808 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1052/2105] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:29 2022] PUT /identity/v3/projects/ecaf6b6d596d45c597e10fdb312fcf0f/users/c838da622fa6439fb10caf88e90deaa1/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:48:29.648622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f750d0-8392-4b94-9aa7-141230125d7f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:29.648924 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f750d0-8392-4b94-9aa7-141230125d7f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:29.653114 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f750d0-8392-4b94-9aa7-141230125d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:29.716541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e7f750d0-8392-4b94-9aa7-141230125d7f None None] MFA Rules not processed for user `c838da622fa6439fb10caf88e90deaa1`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:29.721342 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e7f750d0-8392-4b94-9aa7-141230125d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:29.789554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9a531-b730-4edc-b9ae-ed9041bd3e68 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:29.791695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9aa9a531-b730-4edc-b9ae-ed9041bd3e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:29.842021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1054/2106] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:29.853634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f750d0-8392-4b94-9aa7-141230125d7f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:29.855909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e7f750d0-8392-4b94-9aa7-141230125d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:29.886446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9a531-b730-4edc-b9ae-ed9041bd3e68 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:29.890592 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d131e-d60e-4602-a4d1-887aea2a20f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:29.891251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d131e-d60e-4602-a4d1-887aea2a20f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:29.891536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d131e-d60e-4602-a4d1-887aea2a20f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:29.891811 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d131e-d60e-4602-a4d1-887aea2a20f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:29.894643 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1a3d131e-d60e-4602-a4d1-887aea2a20f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:29.922205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f750d0-8392-4b94-9aa7-141230125d7f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:29.926891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62fc91-ddb1-4179-b77f-cdec1b010091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:29.927667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62fc91-ddb1-4179-b77f-cdec1b010091 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:29.927913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62fc91-ddb1-4179-b77f-cdec1b010091 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:29.928549 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62fc91-ddb1-4179-b77f-cdec1b010091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:29.950495 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62fc91-ddb1-4179-b77f-cdec1b010091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:29.953649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62fc91-ddb1-4179-b77f-cdec1b010091 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:29.981372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1055/2107] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:29.983822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62fc91-ddb1-4179-b77f-cdec1b010091 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:29.988106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4d62fc91-ddb1-4179-b77f-cdec1b010091 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:29.993215 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d131e-d60e-4602-a4d1-887aea2a20f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:29.995674 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d131e-d60e-4602-a4d1-887aea2a20f2 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:30.012884 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1053/2108] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:30.014416 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d131e-d60e-4602-a4d1-887aea2a20f2 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:30.088836 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62fc91-ddb1-4179-b77f-cdec1b010091 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:30.093993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:30.095145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:30.095145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:30.095466 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] PATH_INFO: `/v3/projects/604d13a6efc14d969d0d353cae03fed6` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:30.096653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=604d13a6efc14d969d0d353cae03fed6)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:30.098792 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:30.166550 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d131e-d60e-4602-a4d1-887aea2a20f2 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:30.171630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630891d3-c2f1-4659-886f-5104376991af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:30.172691 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630891d3-c2f1-4659-886f-5104376991af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:30.173035 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630891d3-c2f1-4659-886f-5104376991af admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:30.173316 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630891d3-c2f1-4659-886f-5104376991af admin admin] PATH_INFO: `/v3/users/c838da622fa6439fb10caf88e90deaa1` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:30.176616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630891d3-c2f1-4659-886f-5104376991af admin admin] RBAC: Authorizing `identity:delete_user(user_id=c838da622fa6439fb10caf88e90deaa1)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:30.177099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630891d3-c2f1-4659-886f-5104376991af admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:30.245521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604d13a6efc14d969d0d353cae03fed6', 'request_id': 'req-b19ad3eb-ba20-476b-8eae-76c4dd890857'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.335195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604d13a6efc14d969d0d353cae03fed6', 'request_id': 'req-b19ad3eb-ba20-476b-8eae-76c4dd890857'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.341948 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604d13a6efc14d969d0d353cae03fed6', 'request_id': 'req-b19ad3eb-ba20-476b-8eae-76c4dd890857'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.353413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] The token cache is being invalidate because project 604d13a6efc14d969d0d353cae03fed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:30.353699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.354482 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.356093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1056/2109] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:29 2022] DELETE /identity/v3/projects/604d13a6efc14d969d0d353cae03fed6 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:30.356900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:30.358231 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:30.423842 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ad3eb-ba20-476b-8eae-76c4dd890857 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:30.429221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0685fb-277c-413a-b331-beb7594b18f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:30.431601 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0685fb-277c-413a-b331-beb7594b18f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:30.431601 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0685fb-277c-413a-b331-beb7594b18f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:30.431601 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0685fb-277c-413a-b331-beb7594b18f2 admin admin] PATH_INFO: `/v3/projects/9e82122991b84f7885d332ec69f38373` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:30.431902 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0685fb-277c-413a-b331-beb7594b18f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e82122991b84f7885d332ec69f38373)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:30.433756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0685fb-277c-413a-b331-beb7594b18f2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:30.477666 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-630891d3-c2f1-4659-886f-5104376991af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c838da622fa6439fb10caf88e90deaa1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.574269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-630891d3-c2f1-4659-886f-5104376991af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c838da622fa6439fb10caf88e90deaa1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.574925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-630891d3-c2f1-4659-886f-5104376991af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c838da622fa6439fb10caf88e90deaa1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.588836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-630891d3-c2f1-4659-886f-5104376991af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c838da622fa6439fb10caf88e90deaa1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.588948 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-630891d3-c2f1-4659-886f-5104376991af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c838da622fa6439fb10caf88e90deaa1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.610833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9f0685fb-277c-413a-b331-beb7594b18f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e82122991b84f7885d332ec69f38373', 'request_id': 'req-9f0685fb-277c-413a-b331-beb7594b18f2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.630389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1054/2110] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:30 2022] DELETE /identity/v3/users/c838da622fa6439fb10caf88e90deaa1 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:30.631583 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630891d3-c2f1-4659-886f-5104376991af admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:30.633116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-630891d3-c2f1-4659-886f-5104376991af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:30.709329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630891d3-c2f1-4659-886f-5104376991af admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:30.713934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cdd59-03b6-4694-ae00-a5bf41bd7cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:30.714815 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cdd59-03b6-4694-ae00-a5bf41bd7cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:30.715103 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cdd59-03b6-4694-ae00-a5bf41bd7cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:30.715374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9cdd59-03b6-4694-ae00-a5bf41bd7cf7 admin admin] PATH_INFO: `/v3/users/4a57b3a1c0094aa288d4057c0ca7a6e4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:30.716649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cdd59-03b6-4694-ae00-a5bf41bd7cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a57b3a1c0094aa288d4057c0ca7a6e4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:30.718616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9cdd59-03b6-4694-ae00-a5bf41bd7cf7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:30.766776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9f0685fb-277c-413a-b331-beb7594b18f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e82122991b84f7885d332ec69f38373', 'request_id': 'req-9f0685fb-277c-413a-b331-beb7594b18f2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.771130 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9f0685fb-277c-413a-b331-beb7594b18f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e82122991b84f7885d332ec69f38373', 'request_id': 'req-9f0685fb-277c-413a-b331-beb7594b18f2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.784188 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9f0685fb-277c-413a-b331-beb7594b18f2 admin admin] The token cache is being invalidate because project 9e82122991b84f7885d332ec69f38373 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:30.785072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9f0685fb-277c-413a-b331-beb7594b18f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.785998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9f0685fb-277c-413a-b331-beb7594b18f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.790863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1057/2111] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:30 2022] DELETE /identity/v3/projects/9e82122991b84f7885d332ec69f38373 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:30.792303 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f905ded-6ac9-446f-8a8f-67bbf9e96cde None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:30.792653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f905ded-6ac9-446f-8a8f-67bbf9e96cde None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:30.792938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f905ded-6ac9-446f-8a8f-67bbf9e96cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:30.827535 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7f905ded-6ac9-446f-8a8f-67bbf9e96cde None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:30.828796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7f905ded-6ac9-446f-8a8f-67bbf9e96cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:30.846265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1058/2112] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:30.851494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f905ded-6ac9-446f-8a8f-67bbf9e96cde None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:30.854011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7f905ded-6ac9-446f-8a8f-67bbf9e96cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:30.871563 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f905ded-6ac9-446f-8a8f-67bbf9e96cde None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:30.874360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:30.880294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3303a-0171-488d-9148-a90a9f6966f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:30.881623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3303a-0171-488d-9148-a90a9f6966f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:30.881934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3303a-0171-488d-9148-a90a9f6966f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:30.882209 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3303a-0171-488d-9148-a90a9f6966f5 admin admin] PATH_INFO: `/v3/users/a10b1c912d244995920d8ac9732ec508` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:30.883455 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3303a-0171-488d-9148-a90a9f6966f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a10b1c912d244995920d8ac9732ec508)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:30.885383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3303a-0171-488d-9148-a90a9f6966f5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:30.932088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ff9cdd59-03b6-4694-ae00-a5bf41bd7cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a57b3a1c0094aa288d4057c0ca7a6e4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.986179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ff9cdd59-03b6-4694-ae00-a5bf41bd7cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a57b3a1c0094aa288d4057c0ca7a6e4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.986855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ff9cdd59-03b6-4694-ae00-a5bf41bd7cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a57b3a1c0094aa288d4057c0ca7a6e4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.995205 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ff9cdd59-03b6-4694-ae00-a5bf41bd7cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a57b3a1c0094aa288d4057c0ca7a6e4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:30.995996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ff9cdd59-03b6-4694-ae00-a5bf41bd7cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a57b3a1c0094aa288d4057c0ca7a6e4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:31.032075 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1055/2113] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:30 2022] DELETE /identity/v3/users/4a57b3a1c0094aa288d4057c0ca7a6e4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:31.033239 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cdd59-03b6-4694-ae00-a5bf41bd7cf7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:31.036195 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ff9cdd59-03b6-4694-ae00-a5bf41bd7cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:31.112870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:31.114759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e1b3303a-0171-488d-9148-a90a9f6966f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a10b1c912d244995920d8ac9732ec508'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:31.119435 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e1b3303a-0171-488d-9148-a90a9f6966f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a10b1c912d244995920d8ac9732ec508'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:31.119435 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e1b3303a-0171-488d-9148-a90a9f6966f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a10b1c912d244995920d8ac9732ec508'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:31.129530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9cdd59-03b6-4694-ae00-a5bf41bd7cf7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:31.135233 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e1b3303a-0171-488d-9148-a90a9f6966f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a10b1c912d244995920d8ac9732ec508'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:31.137427 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b1992-0806-4395-bc8a-523881decab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:31.138147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b1992-0806-4395-bc8a-523881decab5 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:31.138432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b1992-0806-4395-bc8a-523881decab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:31.138868 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b1992-0806-4395-bc8a-523881decab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:31.141146 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f62b1992-0806-4395-bc8a-523881decab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:31.144627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e1b3303a-0171-488d-9148-a90a9f6966f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a10b1c912d244995920d8ac9732ec508'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:31.236732 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b1992-0806-4395-bc8a-523881decab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:31.238396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b1992-0806-4395-bc8a-523881decab5 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:31.244642 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1059/2114] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:30 2022] DELETE /identity/v3/users/a10b1c912d244995920d8ac9732ec508 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:31.248582 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1056/2115] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:31.727870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3303a-0171-488d-9148-a90a9f6966f5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:31.729338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e1b3303a-0171-488d-9148-a90a9f6966f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:31.889666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3303a-0171-488d-9148-a90a9f6966f5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:31.911387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:31.913810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:31.914715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:31.915268 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] PATH_INFO: `/v3/projects/b6bb4991a596422a8567bec7d176e645` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:31.921980 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6bb4991a596422a8567bec7d176e645)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:31.924120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:32.061460 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:32.090720 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6bb4991a596422a8567bec7d176e645', 'request_id': 'req-06ee381d-ea37-441f-8eeb-f3497ccebb7e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.097602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b1992-0806-4395-bc8a-523881decab5 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:32.099310 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f62b1992-0806-4395-bc8a-523881decab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:32.118704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b1992-0806-4395-bc8a-523881decab5 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:32.157737 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6bb4991a596422a8567bec7d176e645', 'request_id': 'req-06ee381d-ea37-441f-8eeb-f3497ccebb7e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.168861 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6bb4991a596422a8567bec7d176e645', 'request_id': 'req-06ee381d-ea37-441f-8eeb-f3497ccebb7e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.189909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] The token cache is being invalidate because project b6bb4991a596422a8567bec7d176e645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:32.190270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.191026 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.198298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1060/2116] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:31 2022] DELETE /identity/v3/projects/b6bb4991a596422a8567bec7d176e645 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:32.198298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:32.198298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:32.285680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:32.286655 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:32.286954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:32.287286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31 admin admin] PATH_INFO: `/v3/projects/ecaf6b6d596d45c597e10fdb312fcf0f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:32.297632 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecaf6b6d596d45c597e10fdb312fcf0f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:32.299705 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:32.308700 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee381d-ea37-441f-8eeb-f3497ccebb7e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:32.315356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a4312-f441-4f8a-9b46-29de3435cf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:32.316385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a4312-f441-4f8a-9b46-29de3435cf9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:32.316854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a4312-f441-4f8a-9b46-29de3435cf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:32.317334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a4312-f441-4f8a-9b46-29de3435cf9f admin admin] PATH_INFO: `/v3/projects/3dfc5d78e4354e31aa6536652b828978` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:32.319859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a4312-f441-4f8a-9b46-29de3435cf9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dfc5d78e4354e31aa6536652b828978)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:32.323668 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a4312-f441-4f8a-9b46-29de3435cf9f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:32.528810 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7b8a4312-f441-4f8a-9b46-29de3435cf9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dfc5d78e4354e31aa6536652b828978', 'request_id': 'req-7b8a4312-f441-4f8a-9b46-29de3435cf9f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.532916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecaf6b6d596d45c597e10fdb312fcf0f', 'request_id': 'req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.631899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecaf6b6d596d45c597e10fdb312fcf0f', 'request_id': 'req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.640615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecaf6b6d596d45c597e10fdb312fcf0f', 'request_id': 'req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.652576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31 admin admin] The token cache is being invalidate because project ecaf6b6d596d45c597e10fdb312fcf0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:32.653077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.653867 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f55c7da1-65cf-4eee-ae6d-08aecda9ab31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.658828 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1057/2117] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:32 2022] DELETE /identity/v3/projects/ecaf6b6d596d45c597e10fdb312fcf0f => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:32.658828 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda5c25-c126-4eca-b6a7-4afee9350132 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:32.658828 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda5c25-c126-4eca-b6a7-4afee9350132 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:32.658828 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda5c25-c126-4eca-b6a7-4afee9350132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:32.678222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-dfda5c25-c126-4eca-b6a7-4afee9350132 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:32.679616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dfda5c25-c126-4eca-b6a7-4afee9350132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:32.749477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1058/2118] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:32.751068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b035c-8bc0-4f15-bfe9-2eb77729b869 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:32.751385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b035c-8bc0-4f15-bfe9-2eb77729b869 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:32.751671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b035c-8bc0-4f15-bfe9-2eb77729b869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:32.763894 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7b8a4312-f441-4f8a-9b46-29de3435cf9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dfc5d78e4354e31aa6536652b828978', 'request_id': 'req-7b8a4312-f441-4f8a-9b46-29de3435cf9f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.766973 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:32.772204 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0a0b035c-8bc0-4f15-bfe9-2eb77729b869 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:32.774574 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0a0b035c-8bc0-4f15-bfe9-2eb77729b869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:32.774656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7b8a4312-f441-4f8a-9b46-29de3435cf9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dfc5d78e4354e31aa6536652b828978', 'request_id': 'req-7b8a4312-f441-4f8a-9b46-29de3435cf9f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.786316 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1059/2119] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:32.788018 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14076342-6361-4d1f-9690-39c53fb91a38 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:32.788379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14076342-6361-4d1f-9690-39c53fb91a38 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:32.788772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14076342-6361-4d1f-9690-39c53fb91a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:32.798746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7b8a4312-f441-4f8a-9b46-29de3435cf9f admin admin] The token cache is being invalidate because project 3dfc5d78e4354e31aa6536652b828978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:32.801180 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7b8a4312-f441-4f8a-9b46-29de3435cf9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.806253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7b8a4312-f441-4f8a-9b46-29de3435cf9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:32.809411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1061/2120] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:32 2022] DELETE /identity/v3/projects/3dfc5d78e4354e31aa6536652b828978 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:32.810918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055908b-b954-4b15-9ad7-2d1036b1c102 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:32.811258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055908b-b954-4b15-9ad7-2d1036b1c102 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:32.811496 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055908b-b954-4b15-9ad7-2d1036b1c102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:32.824267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-14076342-6361-4d1f-9690-39c53fb91a38 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:32.825406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-14076342-6361-4d1f-9690-39c53fb91a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:32.836996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1060/2121] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:32.838563 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c67a10-1b6a-46ea-bf0f-408b02aaca07 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:32.838840 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c67a10-1b6a-46ea-bf0f-408b02aaca07 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:32.839170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c67a10-1b6a-46ea-bf0f-408b02aaca07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:32.854649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-5055908b-b954-4b15-9ad7-2d1036b1c102 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:32.855903 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5055908b-b954-4b15-9ad7-2d1036b1c102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:32.868205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1062/2122] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:32.869824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055908b-b954-4b15-9ad7-2d1036b1c102 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:32.881295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b0c67a10-1b6a-46ea-bf0f-408b02aaca07 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:32.881814 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055908b-b954-4b15-9ad7-2d1036b1c102 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:32.882945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b0c67a10-1b6a-46ea-bf0f-408b02aaca07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:32.888429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ed104-c38b-4017-8005-03060b2b08b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:32.889413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ed104-c38b-4017-8005-03060b2b08b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:32.889792 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ed104-c38b-4017-8005-03060b2b08b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:32.890136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ed104-c38b-4017-8005-03060b2b08b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:32.892578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ed104-c38b-4017-8005-03060b2b08b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:32.892578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ed104-c38b-4017-8005-03060b2b08b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:32.894259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ed104-c38b-4017-8005-03060b2b08b1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:32.902405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1061/2123] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:32.903851 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c67a10-1b6a-46ea-bf0f-408b02aaca07 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:32.912115 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1063/2124] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:32.913834 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088d92-d63f-4a4d-9502-4d0cd2912294 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:32.915383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088d92-d63f-4a4d-9502-4d0cd2912294 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:32.915977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8088d92-d63f-4a4d-9502-4d0cd2912294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:32.918308 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c67a10-1b6a-46ea-bf0f-408b02aaca07 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:32.923484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31fc04-ac73-4e42-8b63-e305a5d22cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:32.925915 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31fc04-ac73-4e42-8b63-e305a5d22cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:32.925915 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31fc04-ac73-4e42-8b63-e305a5d22cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:32.926087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31fc04-ac73-4e42-8b63-e305a5d22cfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:32.928259 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31fc04-ac73-4e42-8b63-e305a5d22cfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:32.928711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31fc04-ac73-4e42-8b63-e305a5d22cfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:32.930521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff31fc04-ac73-4e42-8b63-e305a5d22cfd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:32.942030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b8088d92-d63f-4a4d-9502-4d0cd2912294 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:32.943391 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b8088d92-d63f-4a4d-9502-4d0cd2912294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:32.947323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1062/2125] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:32.948419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31fc04-ac73-4e42-8b63-e305a5d22cfd admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:32.960703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1064/2126] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:32.964178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31fc04-ac73-4e42-8b63-e305a5d22cfd admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:32.965880 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8088d92-d63f-4a4d-9502-4d0cd2912294 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:32.969079 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2226bd-367a-41bf-a134-931f48d98990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:32.969967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2226bd-367a-41bf-a134-931f48d98990 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:32.971857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2226bd-367a-41bf-a134-931f48d98990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:32.971857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2226bd-367a-41bf-a134-931f48d98990 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:32.971857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2226bd-367a-41bf-a134-931f48d98990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:32.973950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2226bd-367a-41bf-a134-931f48d98990 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:32.979316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8088d92-d63f-4a4d-9502-4d0cd2912294 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:32.985057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4dd4d-561f-4f13-9ac7-4c7373ac5708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:32.986113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4dd4d-561f-4f13-9ac7-4c7373ac5708 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:32.986602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4dd4d-561f-4f13-9ac7-4c7373ac5708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:32.987022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4dd4d-561f-4f13-9ac7-4c7373ac5708 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:32.988609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4dd4d-561f-4f13-9ac7-4c7373ac5708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:32.992803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4dd4d-561f-4f13-9ac7-4c7373ac5708 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:33.123946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1065/2128] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:32 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:33.124142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1063/2128] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:32 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:33.124934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4dd4d-561f-4f13-9ac7-4c7373ac5708 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:33.125338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2226bd-367a-41bf-a134-931f48d98990 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:33.212988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4dd4d-561f-4f13-9ac7-4c7373ac5708 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:33.221048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f3c66-826d-4392-9494-e0805c9c9349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:33.222913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f3c66-826d-4392-9494-e0805c9c9349 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:33.225554 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f3c66-826d-4392-9494-e0805c9c9349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:33.226235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42f3c66-826d-4392-9494-e0805c9c9349 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:33.228322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f3c66-826d-4392-9494-e0805c9c9349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:33.234142 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f3c66-826d-4392-9494-e0805c9c9349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:33.234142 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42f3c66-826d-4392-9494-e0805c9c9349 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:33.243902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2226bd-367a-41bf-a134-931f48d98990 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:33.253966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1066/2129] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:33.255112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f3c66-826d-4392-9494-e0805c9c9349 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:33.260222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7cfd3-ac4f-4518-8679-766f9fcf0b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:33.260989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7cfd3-ac4f-4518-8679-766f9fcf0b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:33.262052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7cfd3-ac4f-4518-8679-766f9fcf0b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:33.262052 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7cfd3-ac4f-4518-8679-766f9fcf0b7c admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:33.264717 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7cfd3-ac4f-4518-8679-766f9fcf0b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:33.264717 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7cfd3-ac4f-4518-8679-766f9fcf0b7c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:33.277147 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42f3c66-826d-4392-9494-e0805c9c9349 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:33.282541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34968af9-6407-4ec7-b8b6-110ecb172250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:33.285776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34968af9-6407-4ec7-b8b6-110ecb172250 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:33.285776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34968af9-6407-4ec7-b8b6-110ecb172250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:33.285776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34968af9-6407-4ec7-b8b6-110ecb172250 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:33.285776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34968af9-6407-4ec7-b8b6-110ecb172250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:33.286854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34968af9-6407-4ec7-b8b6-110ecb172250 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:33.372361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1064/2130] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:33 2022] POST /identity/v3/users => generated 287 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:33.373773 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7cfd3-ac4f-4518-8679-766f9fcf0b7c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:33.389354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7cfd3-ac4f-4518-8679-766f9fcf0b7c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:33.395792 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b97601-d627-4002-8c3c-64d2eb52f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:33.400274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1067/2131] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:33 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:33.400446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b97601-d627-4002-8c3c-64d2eb52f6d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:33.400446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b97601-d627-4002-8c3c-64d2eb52f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:33.400446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b97601-d627-4002-8c3c-64d2eb52f6d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:33.400446 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b97601-d627-4002-8c3c-64d2eb52f6d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:33.402228 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b97601-d627-4002-8c3c-64d2eb52f6d7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:33.402572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34968af9-6407-4ec7-b8b6-110ecb172250 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:33.416755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34968af9-6407-4ec7-b8b6-110ecb172250 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:33.423501 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085b233-3112-4f84-93f4-cdd051c10876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:33.425338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085b233-3112-4f84-93f4-cdd051c10876 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:33.425338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085b233-3112-4f84-93f4-cdd051c10876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:33.425338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085b233-3112-4f84-93f4-cdd051c10876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:33.426681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085b233-3112-4f84-93f4-cdd051c10876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:33.428609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085b233-3112-4f84-93f4-cdd051c10876 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:33.460334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1068/2132] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:33.461921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085b233-3112-4f84-93f4-cdd051c10876 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:33.478850 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085b233-3112-4f84-93f4-cdd051c10876 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:33.487689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9250fe-1c8b-41f2-9eaf-0a67d9a50aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:33.488755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9250fe-1c8b-41f2-9eaf-0a67d9a50aca admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:33.491193 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9250fe-1c8b-41f2-9eaf-0a67d9a50aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:33.493400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9250fe-1c8b-41f2-9eaf-0a67d9a50aca admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:33.494244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9250fe-1c8b-41f2-9eaf-0a67d9a50aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:33.495900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9250fe-1c8b-41f2-9eaf-0a67d9a50aca admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:33.506262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1065/2133] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:33 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:33.506262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b97601-d627-4002-8c3c-64d2eb52f6d7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:33.519909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1069/2134] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:33.519909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9250fe-1c8b-41f2-9eaf-0a67d9a50aca admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:33.546046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9250fe-1c8b-41f2-9eaf-0a67d9a50aca admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:33.636207 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b97601-d627-4002-8c3c-64d2eb52f6d7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:33.653947 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f0c98-dc95-4141-ba6b-4472de9f7f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:33.653947 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f0c98-dc95-4141-ba6b-4472de9f7f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:33.653947 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f0c98-dc95-4141-ba6b-4472de9f7f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:33.653947 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f0c98-dc95-4141-ba6b-4472de9f7f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:33.655131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f0c98-dc95-4141-ba6b-4472de9f7f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:33.660873 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662f0c98-dc95-4141-ba6b-4472de9f7f9e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:33.684349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08d44c-3934-4f9b-b543-4df55113cc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:33.685052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08d44c-3934-4f9b-b543-4df55113cc29 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:33.685400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08d44c-3934-4f9b-b543-4df55113cc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:33.685707 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b08d44c-3934-4f9b-b543-4df55113cc29 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:33.686477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08d44c-3934-4f9b-b543-4df55113cc29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:33.693789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1066/2135] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:33.693789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f0c98-dc95-4141-ba6b-4472de9f7f9e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:33.695809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b08d44c-3934-4f9b-b543-4df55113cc29 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:33.706942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:33.711161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f0c98-dc95-4141-ba6b-4472de9f7f9e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:33.731314 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b37be2-0405-4439-975e-1684749119c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:33.732028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b37be2-0405-4439-975e-1684749119c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:33.732304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b37be2-0405-4439-975e-1684749119c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:33.732580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b37be2-0405-4439-975e-1684749119c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:33.733327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b37be2-0405-4439-975e-1684749119c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:33.736240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b37be2-0405-4439-975e-1684749119c6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:33.758126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1067/2136] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:33.759398 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b37be2-0405-4439-975e-1684749119c6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:33.794526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b37be2-0405-4439-975e-1684749119c6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:33.802762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1070/2137] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:33 2022] POST /identity/v3/users => generated 293 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:33.802762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08d44c-3934-4f9b-b543-4df55113cc29 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:33.803882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de3801-b910-462d-a999-aa3f5f09d43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:33.806466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de3801-b910-462d-a999-aa3f5f09d43f admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:33.806838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de3801-b910-462d-a999-aa3f5f09d43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:33.807192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de3801-b910-462d-a999-aa3f5f09d43f admin admin] PATH_INFO: `/v3/projects/582f0ea88f8948808f78f31934eac393/users/603b5c82602343a4975b065917058cd5/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:33.818628 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b08d44c-3934-4f9b-b543-4df55113cc29 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:33.827013 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd013a-f2ed-4ce6-8cae-f88f99a074f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:33.828037 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd013a-f2ed-4ce6-8cae-f88f99a074f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:33.828381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd013a-f2ed-4ce6-8cae-f88f99a074f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:33.828737 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd013a-f2ed-4ce6-8cae-f88f99a074f7 admin admin] PATH_INFO: `/v3/projects/afd8b5681607488baf0c9572c7c9cd10/users/4b26fb2190c34a17b1444536249fcfb3/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:33.829464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de3801-b910-462d-a999-aa3f5f09d43f admin admin] RBAC: Authorizing `identity:create_grant(project_id=582f0ea88f8948808f78f31934eac393, user_id=603b5c82602343a4975b065917058cd5, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:33.832964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de3801-b910-462d-a999-aa3f5f09d43f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:33.846729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd013a-f2ed-4ce6-8cae-f88f99a074f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afd8b5681607488baf0c9572c7c9cd10, user_id=4b26fb2190c34a17b1444536249fcfb3, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:33.849536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd013a-f2ed-4ce6-8cae-f88f99a074f7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:33.929050 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1068/2138] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:33 2022] PUT /identity/v3/projects/582f0ea88f8948808f78f31934eac393/users/603b5c82602343a4975b065917058cd5/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:33.930049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de3801-b910-462d-a999-aa3f5f09d43f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:33.980685 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1071/2139] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:33 2022] PUT /identity/v3/projects/afd8b5681607488baf0c9572c7c9cd10/users/4b26fb2190c34a17b1444536249fcfb3/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:33.982123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b64be-22cf-4fcb-aaeb-1689e1beb5b3 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:33.982417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b64be-22cf-4fcb-aaeb-1689e1beb5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:33.982704 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b64be-22cf-4fcb-aaeb-1689e1beb5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:34.019403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3b9b64be-22cf-4fcb-aaeb-1689e1beb5b3 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:34.023573 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3b9b64be-22cf-4fcb-aaeb-1689e1beb5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:34.039593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de3801-b910-462d-a999-aa3f5f09d43f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:34.216035 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1072/2140] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:34.220669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d70994-9227-4f45-851a-9e8e264a7615 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:34.221060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d70994-9227-4f45-851a-9e8e264a7615 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:34.221349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d70994-9227-4f45-851a-9e8e264a7615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:34.241522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ab5ad-22cc-4662-9614-3e1875b17841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:34.242946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ab5ad-22cc-4662-9614-3e1875b17841 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:34.243630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ab5ad-22cc-4662-9614-3e1875b17841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:34.244069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ab5ad-22cc-4662-9614-3e1875b17841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:34.245806 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ab5ad-22cc-4662-9614-3e1875b17841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:34.247966 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ab5ad-22cc-4662-9614-3e1875b17841 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:34.259504 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-96d70994-9227-4f45-851a-9e8e264a7615 None None] MFA Rules not processed for user `4b26fb2190c34a17b1444536249fcfb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:34.261669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-96d70994-9227-4f45-851a-9e8e264a7615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:34.262793 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1069/2141] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:34.263768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ab5ad-22cc-4662-9614-3e1875b17841 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:34.267354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-419ab5ad-22cc-4662-9614-3e1875b17841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:34.348984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:34.351316 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ab5ad-22cc-4662-9614-3e1875b17841 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:34.356142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4f934-a418-45a4-9d80-5721d5685626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:34.357086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4f934-a418-45a4-9d80-5721d5685626 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:34.358358 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4f934-a418-45a4-9d80-5721d5685626 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:34.360566 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4f934-a418-45a4-9d80-5721d5685626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:34.376156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4f934-a418-45a4-9d80-5721d5685626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:34.377627 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4f934-a418-45a4-9d80-5721d5685626 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:34.391721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1073/2142] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:34.391721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d70994-9227-4f45-851a-9e8e264a7615 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:34.400336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1070/2143] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:34.402286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4f934-a418-45a4-9d80-5721d5685626 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:34.403598 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-90d4f934-a418-45a4-9d80-5721d5685626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:34.413859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d70994-9227-4f45-851a-9e8e264a7615 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:34.422040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c805ba-fbd6-4dc5-80fc-6b5211015b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:34.423836 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c805ba-fbd6-4dc5-80fc-6b5211015b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:34.424268 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c805ba-fbd6-4dc5-80fc-6b5211015b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:34.426651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c805ba-fbd6-4dc5-80fc-6b5211015b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:34.428589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c805ba-fbd6-4dc5-80fc-6b5211015b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:34.443714 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c805ba-fbd6-4dc5-80fc-6b5211015b15 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:34.460487 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1074/2144] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:34.466232 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c805ba-fbd6-4dc5-80fc-6b5211015b15 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:34.484170 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c805ba-fbd6-4dc5-80fc-6b5211015b15 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:34.492686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758e797-a86d-468a-91d8-9fb2d7da2811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:34.493730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758e797-a86d-468a-91d8-9fb2d7da2811 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:34.495449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758e797-a86d-468a-91d8-9fb2d7da2811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:34.495449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758e797-a86d-468a-91d8-9fb2d7da2811 admin admin] PATH_INFO: `/v3/projects/4d9fc5d6ca914cc08673be6fed986ece/users/f39717ac88874ece9c09435b3092355c/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:34.506438 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4f934-a418-45a4-9d80-5721d5685626 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:34.517518 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9824e-6a9c-43e9-b7c7-9e63ea2b7401 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:34.518389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9824e-6a9c-43e9-b7c7-9e63ea2b7401 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:34.518957 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9824e-6a9c-43e9-b7c7-9e63ea2b7401 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:34.519319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9824e-6a9c-43e9-b7c7-9e63ea2b7401 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:34.523210 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758e797-a86d-468a-91d8-9fb2d7da2811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9fc5d6ca914cc08673be6fed986ece, user_id=f39717ac88874ece9c09435b3092355c, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:34.526512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758e797-a86d-468a-91d8-9fb2d7da2811 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:34.539737 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9824e-6a9c-43e9-b7c7-9e63ea2b7401 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:34.541902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9824e-6a9c-43e9-b7c7-9e63ea2b7401 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:34.556995 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1071/2145] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:34.602684 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1075/2146] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:34 2022] PUT /identity/v3/projects/4d9fc5d6ca914cc08673be6fed986ece/users/f39717ac88874ece9c09435b3092355c/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:34.605529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9824e-6a9c-43e9-b7c7-9e63ea2b7401 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:34.615488 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b13faa-991f-4a89-aab0-66536662c880 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:34.615942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b13faa-991f-4a89-aab0-66536662c880 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:34.616366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b13faa-991f-4a89-aab0-66536662c880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:34.632607 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9824e-6a9c-43e9-b7c7-9e63ea2b7401 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:34.654702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a3b13faa-991f-4a89-aab0-66536662c880 None None] MFA Rules not processed for user `f39717ac88874ece9c09435b3092355c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:34.656319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a3b13faa-991f-4a89-aab0-66536662c880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:34.702155 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfdab9-0c1b-4a57-bdc5-ab96c0cbf880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:34.703776 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdab9-0c1b-4a57-bdc5-ab96c0cbf880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:34.704160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdab9-0c1b-4a57-bdc5-ab96c0cbf880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:34.704538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfdab9-0c1b-4a57-bdc5-ab96c0cbf880 admin admin] PATH_INFO: `/v3/users/4b26fb2190c34a17b1444536249fcfb3` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:34.706812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfdab9-0c1b-4a57-bdc5-ab96c0cbf880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b26fb2190c34a17b1444536249fcfb3)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:34.709057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfdab9-0c1b-4a57-bdc5-ab96c0cbf880 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:34.766416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1076/2147] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:34.783649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b13faa-991f-4a89-aab0-66536662c880 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:34.785353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a3b13faa-991f-4a89-aab0-66536662c880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:34.883431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b13faa-991f-4a89-aab0-66536662c880 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:34.889567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08b95d-4884-4a06-a9f1-e7df26470dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:34.890370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08b95d-4884-4a06-a9f1-e7df26470dea service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:34.890758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08b95d-4884-4a06-a9f1-e7df26470dea service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:34.891130 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08b95d-4884-4a06-a9f1-e7df26470dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:34.905428 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08b95d-4884-4a06-a9f1-e7df26470dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:34.913562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08b95d-4884-4a06-a9f1-e7df26470dea service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:34.930032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1077/2148] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:34.932117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08b95d-4884-4a06-a9f1-e7df26470dea service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:34.935727 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bd08b95d-4884-4a06-a9f1-e7df26470dea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:34.974222 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08b95d-4884-4a06-a9f1-e7df26470dea service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:34.990620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb851b06-13ef-400f-bd53-5685fa2532df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:34.992426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb851b06-13ef-400f-bd53-5685fa2532df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:34.992822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb851b06-13ef-400f-bd53-5685fa2532df admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:34.993297 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb851b06-13ef-400f-bd53-5685fa2532df admin admin] PATH_INFO: `/v3/users/6649b33da78b468cac2f871ce779f365` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:34.995019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb851b06-13ef-400f-bd53-5685fa2532df admin admin] RBAC: Authorizing `identity:delete_user(user_id=6649b33da78b468cac2f871ce779f365)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:34.997681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb851b06-13ef-400f-bd53-5685fa2532df admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:35.028480 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4cfdab9-0c1b-4a57-bdc5-ab96c0cbf880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b26fb2190c34a17b1444536249fcfb3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.117481 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4cfdab9-0c1b-4a57-bdc5-ab96c0cbf880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b26fb2190c34a17b1444536249fcfb3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.118415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4cfdab9-0c1b-4a57-bdc5-ab96c0cbf880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b26fb2190c34a17b1444536249fcfb3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.126916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4cfdab9-0c1b-4a57-bdc5-ab96c0cbf880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b26fb2190c34a17b1444536249fcfb3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.130093 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-c4cfdab9-0c1b-4a57-bdc5-ab96c0cbf880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b26fb2190c34a17b1444536249fcfb3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.154829 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1072/2149] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:34 2022] DELETE /identity/v3/users/4b26fb2190c34a17b1444536249fcfb3 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:35.157457 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfdab9-0c1b-4a57-bdc5-ab96c0cbf880 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:35.159036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c4cfdab9-0c1b-4a57-bdc5-ab96c0cbf880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:35.249224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfdab9-0c1b-4a57-bdc5-ab96c0cbf880 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:35.258481 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fd06c-9de7-473c-aa90-308173856f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:35.259708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fd06c-9de7-473c-aa90-308173856f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:35.260147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fd06c-9de7-473c-aa90-308173856f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:35.260569 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fd06c-9de7-473c-aa90-308173856f19 admin admin] PATH_INFO: `/v3/users/f39717ac88874ece9c09435b3092355c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:35.262736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fd06c-9de7-473c-aa90-308173856f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f39717ac88874ece9c09435b3092355c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:35.264936 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fd06c-9de7-473c-aa90-308173856f19 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:35.294279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cb851b06-13ef-400f-bd53-5685fa2532df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6649b33da78b468cac2f871ce779f365'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.296652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cb851b06-13ef-400f-bd53-5685fa2532df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6649b33da78b468cac2f871ce779f365'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.297867 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cb851b06-13ef-400f-bd53-5685fa2532df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6649b33da78b468cac2f871ce779f365'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.314359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cb851b06-13ef-400f-bd53-5685fa2532df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6649b33da78b468cac2f871ce779f365'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.325273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cb851b06-13ef-400f-bd53-5685fa2532df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6649b33da78b468cac2f871ce779f365'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.454478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1078/2150] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:34 2022] DELETE /identity/v3/users/6649b33da78b468cac2f871ce779f365 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:35.454478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0512d46-b1ec-47a2-a7ad-bf123c6212c5 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:35.454478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0512d46-b1ec-47a2-a7ad-bf123c6212c5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:35.454478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0512d46-b1ec-47a2-a7ad-bf123c6212c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:35.493837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e0512d46-b1ec-47a2-a7ad-bf123c6212c5 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:35.495342 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e0512d46-b1ec-47a2-a7ad-bf123c6212c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:35.521748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-947fd06c-9de7-473c-aa90-308173856f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f39717ac88874ece9c09435b3092355c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.595883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-947fd06c-9de7-473c-aa90-308173856f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f39717ac88874ece9c09435b3092355c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.600314 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-947fd06c-9de7-473c-aa90-308173856f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f39717ac88874ece9c09435b3092355c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.606879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-947fd06c-9de7-473c-aa90-308173856f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f39717ac88874ece9c09435b3092355c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.607763 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-947fd06c-9de7-473c-aa90-308173856f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f39717ac88874ece9c09435b3092355c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:35.610375 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:35.617418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1079/2151] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:35.618989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc5351-7e79-40ec-afcd-2574c73a0df0 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:35.619286 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc5351-7e79-40ec-afcd-2574c73a0df0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:35.619572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc5351-7e79-40ec-afcd-2574c73a0df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:35.636899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1073/2152] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:35 2022] DELETE /identity/v3/users/f39717ac88874ece9c09435b3092355c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:35.636899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843f95a-428c-4c55-978d-aca32f3b5a0e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:35.636899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843f95a-428c-4c55-978d-aca32f3b5a0e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:35.637169 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843f95a-428c-4c55-978d-aca32f3b5a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:35.665393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c843f95a-428c-4c55-978d-aca32f3b5a0e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:35.666925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c843f95a-428c-4c55-978d-aca32f3b5a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:35.669064 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-35cc5351-7e79-40ec-afcd-2574c73a0df0 None None] MFA Rules not processed for user `c6b2af58b8154f35bfe2c0cabb03c0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:35.670339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-35cc5351-7e79-40ec-afcd-2574c73a0df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:35.777133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1074/2153] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:35.777981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843f95a-428c-4c55-978d-aca32f3b5a0e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:35.781706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c843f95a-428c-4c55-978d-aca32f3b5a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:35.858785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1080/2154] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:35.860154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e7533-11c5-41f5-a323-414505aa991b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:35.860446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e7533-11c5-41f5-a323-414505aa991b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:35.860726 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e7533-11c5-41f5-a323-414505aa991b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:35.900610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7a7e7533-11c5-41f5-a323-414505aa991b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:35.902071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7a7e7533-11c5-41f5-a323-414505aa991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:35.919428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843f95a-428c-4c55-978d-aca32f3b5a0e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:35.922559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1081/2155] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:35.923485 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e7533-11c5-41f5-a323-414505aa991b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:35.938257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7a7e7533-11c5-41f5-a323-414505aa991b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:35.938415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae973995-22d9-4204-aa63-5a708730d2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:35.938415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973995-22d9-4204-aa63-5a708730d2bd service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:35.938415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973995-22d9-4204-aa63-5a708730d2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:35.938415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae973995-22d9-4204-aa63-5a708730d2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:35.949348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e7533-11c5-41f5-a323-414505aa991b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:35.953134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae973995-22d9-4204-aa63-5a708730d2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:35.954820 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae973995-22d9-4204-aa63-5a708730d2bd service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:35.961046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e056d3c-284b-47ad-90ac-9e9bc85e56fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:35.961645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e056d3c-284b-47ad-90ac-9e9bc85e56fc service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:35.961963 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e056d3c-284b-47ad-90ac-9e9bc85e56fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:35.962247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e056d3c-284b-47ad-90ac-9e9bc85e56fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:35.971212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1075/2156] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:35.972491 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae973995-22d9-4204-aa63-5a708730d2bd service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:35.974128 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ae973995-22d9-4204-aa63-5a708730d2bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:35.982752 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e056d3c-284b-47ad-90ac-9e9bc85e56fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:35.984612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e056d3c-284b-47ad-90ac-9e9bc85e56fc service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:36.002433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1082/2157] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:36.004417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e056d3c-284b-47ad-90ac-9e9bc85e56fc service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:36.014158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e056d3c-284b-47ad-90ac-9e9bc85e56fc service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:36.018300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452b141-f628-4ce7-adeb-8251a78e74de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:36.020176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b141-f628-4ce7-adeb-8251a78e74de service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:36.020470 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b141-f628-4ce7-adeb-8251a78e74de service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:36.020749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452b141-f628-4ce7-adeb-8251a78e74de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:36.033042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452b141-f628-4ce7-adeb-8251a78e74de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:36.035785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452b141-f628-4ce7-adeb-8251a78e74de service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:36.047287 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1083/2158] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:36.147800 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae973995-22d9-4204-aa63-5a708730d2bd service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:36.161658 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561cc84-7ec4-4ac7-9096-2229e7d36a88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:36.162443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561cc84-7ec4-4ac7-9096-2229e7d36a88 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:36.162667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561cc84-7ec4-4ac7-9096-2229e7d36a88 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:36.162946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561cc84-7ec4-4ac7-9096-2229e7d36a88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:36.182791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561cc84-7ec4-4ac7-9096-2229e7d36a88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:36.184580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561cc84-7ec4-4ac7-9096-2229e7d36a88 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:36.206584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1076/2159] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:36.346431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7269-fa81-4026-b925-14f50a488073 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:36.347048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7269-fa81-4026-b925-14f50a488073 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:36.347133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7269-fa81-4026-b925-14f50a488073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:36.416827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-769b7269-fa81-4026-b925-14f50a488073 None None] MFA Rules not processed for user `603b5c82602343a4975b065917058cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:36.416827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-769b7269-fa81-4026-b925-14f50a488073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:36.477193 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:36.536243 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1084/2160] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:36.540917 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561cc84-7ec4-4ac7-9096-2229e7d36a88 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:36.545987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c561cc84-7ec4-4ac7-9096-2229e7d36a88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:36.566677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561cc84-7ec4-4ac7-9096-2229e7d36a88 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:36.576175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5126e-1e06-4d8a-b129-584827ccc4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:36.576175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5126e-1e06-4d8a-b129-584827ccc4d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:36.576175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5126e-1e06-4d8a-b129-584827ccc4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:36.576175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5126e-1e06-4d8a-b129-584827ccc4d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:36.576526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5126e-1e06-4d8a-b129-584827ccc4d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:36.576861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5126e-1e06-4d8a-b129-584827ccc4d8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:36.677228 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1077/2161] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:36 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:36.677407 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7269-fa81-4026-b925-14f50a488073 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:36.678594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5126e-1e06-4d8a-b129-584827ccc4d8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:36.679080 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-769b7269-fa81-4026-b925-14f50a488073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:36.716665 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7269-fa81-4026-b925-14f50a488073 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:36.766073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5126e-1e06-4d8a-b129-584827ccc4d8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:36.772088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249468b-a254-4072-bc66-46d5ae75b24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:36.772802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249468b-a254-4072-bc66-46d5ae75b24a admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:36.773092 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249468b-a254-4072-bc66-46d5ae75b24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:36.773453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249468b-a254-4072-bc66-46d5ae75b24a admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:36.774193 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249468b-a254-4072-bc66-46d5ae75b24a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:36.776137 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249468b-a254-4072-bc66-46d5ae75b24a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:36.839634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:36.840541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:36.840780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:36.841056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] PATH_INFO: `/v3/projects/afd8b5681607488baf0c9572c7c9cd10` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:36.842377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afd8b5681607488baf0c9572c7c9cd10)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:36.844445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:36.890619 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1078/2162] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:36 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:36.891578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249468b-a254-4072-bc66-46d5ae75b24a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:36.895302 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c249468b-a254-4072-bc66-46d5ae75b24a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:36.913310 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249468b-a254-4072-bc66-46d5ae75b24a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:36.918199 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:36.919099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:36.919530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:36.919820 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] PATH_INFO: `/v3/projects/e11a48823b35421aaf7eff47da591bed` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:36.921031 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e11a48823b35421aaf7eff47da591bed)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:36.923044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:36.975457 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afd8b5681607488baf0c9572c7c9cd10', 'request_id': 'req-beb8a916-a07a-4887-97bf-15106173a9d8'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.043661 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afd8b5681607488baf0c9572c7c9cd10', 'request_id': 'req-beb8a916-a07a-4887-97bf-15106173a9d8'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.051204 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afd8b5681607488baf0c9572c7c9cd10', 'request_id': 'req-beb8a916-a07a-4887-97bf-15106173a9d8'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.064306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] The token cache is being invalidate because project afd8b5681607488baf0c9572c7c9cd10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:37.064595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.067461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.071342 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1085/2163] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:36 2022] DELETE /identity/v3/projects/afd8b5681607488baf0c9572c7c9cd10 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:37.072634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:37.074205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:37.088809 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e11a48823b35421aaf7eff47da591bed', 'request_id': 'req-ae19d6b8-75d4-4899-95e8-d0be6dd98982'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.158811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8a916-a07a-4887-97bf-15106173a9d8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:37.175635 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e11a48823b35421aaf7eff47da591bed', 'request_id': 'req-ae19d6b8-75d4-4899-95e8-d0be6dd98982'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.185831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e11a48823b35421aaf7eff47da591bed', 'request_id': 'req-ae19d6b8-75d4-4899-95e8-d0be6dd98982'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.199299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] The token cache is being invalidate because project e11a48823b35421aaf7eff47da591bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:37.199598 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.200440 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.202658 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1079/2164] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:36 2022] DELETE /identity/v3/projects/e11a48823b35421aaf7eff47da591bed => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:37.203703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:37.207781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:37.228075 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:37.229047 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:37.229445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:37.230052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] PATH_INFO: `/v3/projects/4d9fc5d6ca914cc08673be6fed986ece` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:37.231488 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9fc5d6ca914cc08673be6fed986ece)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:37.234022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:37.282657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19d6b8-75d4-4899-95e8-d0be6dd98982 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:37.287975 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068e406-8c50-440c-bcda-99419531a145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:37.288684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068e406-8c50-440c-bcda-99419531a145 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:37.288971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068e406-8c50-440c-bcda-99419531a145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:37.289252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068e406-8c50-440c-bcda-99419531a145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:37.294251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068e406-8c50-440c-bcda-99419531a145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:37.294251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068e406-8c50-440c-bcda-99419531a145 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:37.303088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1080/2165] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:37.304692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d080d8a-242f-4cbf-914d-336ba6990945 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:37.305549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d080d8a-242f-4cbf-914d-336ba6990945 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:37.305549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d080d8a-242f-4cbf-914d-336ba6990945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:37.324115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9d080d8a-242f-4cbf-914d-336ba6990945 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:37.325329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9d080d8a-242f-4cbf-914d-336ba6990945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:37.336214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1081/2166] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:37.337090 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d080d8a-242f-4cbf-914d-336ba6990945 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:37.338377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9d080d8a-242f-4cbf-914d-336ba6990945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:37.350616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d080d8a-242f-4cbf-914d-336ba6990945 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:37.369006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9fc5d6ca914cc08673be6fed986ece', 'request_id': 'req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.422656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f3b95-c297-4c3d-8524-4b8263fd889f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:37.423543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f3b95-c297-4c3d-8524-4b8263fd889f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:37.423827 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f3b95-c297-4c3d-8524-4b8263fd889f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:37.424103 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f3b95-c297-4c3d-8524-4b8263fd889f admin admin] PATH_INFO: `/v3/users/adbbedaa7d8b42db8dccad5a8d348699` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:37.425368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f3b95-c297-4c3d-8524-4b8263fd889f admin admin] RBAC: Authorizing `identity:delete_user(user_id=adbbedaa7d8b42db8dccad5a8d348699)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:37.427547 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f3b95-c297-4c3d-8524-4b8263fd889f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:37.472928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9fc5d6ca914cc08673be6fed986ece', 'request_id': 'req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.481399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9fc5d6ca914cc08673be6fed986ece', 'request_id': 'req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.494058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] The token cache is being invalidate because project 4d9fc5d6ca914cc08673be6fed986ece was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:37.494437 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.495225 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.497164 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1086/2167] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:37 2022] DELETE /identity/v3/projects/4d9fc5d6ca914cc08673be6fed986ece => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:37.497703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:37.499269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:37.519279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4a6b0-6d79-4470-a6a9-1e1497d22b86 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:37.520736 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1165d-ce4e-4d19-a897-ca4ab7a1fe86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:37.521645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1165d-ce4e-4d19-a897-ca4ab7a1fe86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:37.521963 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1165d-ce4e-4d19-a897-ca4ab7a1fe86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:37.522245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1165d-ce4e-4d19-a897-ca4ab7a1fe86 admin admin] PATH_INFO: `/v3/projects/60e26bc44577472c98320b427a6c44d5/users/37d02c424b2e4f2fb1bd2e42419e9ba0/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:37.538842 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1165d-ce4e-4d19-a897-ca4ab7a1fe86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e26bc44577472c98320b427a6c44d5, user_id=37d02c424b2e4f2fb1bd2e42419e9ba0, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:37.541577 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1165d-ce4e-4d19-a897-ca4ab7a1fe86 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:37.663069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6b3f3b95-c297-4c3d-8524-4b8263fd889f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adbbedaa7d8b42db8dccad5a8d348699'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.670101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1087/2168] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:37 2022] PUT /identity/v3/projects/60e26bc44577472c98320b427a6c44d5/users/37d02c424b2e4f2fb1bd2e42419e9ba0/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:37.671556 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e5aee-d742-440a-a990-474b8df0caa4 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:37.671867 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e5aee-d742-440a-a990-474b8df0caa4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:37.673171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e5aee-d742-440a-a990-474b8df0caa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:37.704612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-149e5aee-d742-440a-a990-474b8df0caa4 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:37.706608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-149e5aee-d742-440a-a990-474b8df0caa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:37.734210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6b3f3b95-c297-4c3d-8524-4b8263fd889f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adbbedaa7d8b42db8dccad5a8d348699'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.734882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6b3f3b95-c297-4c3d-8524-4b8263fd889f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adbbedaa7d8b42db8dccad5a8d348699'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.746659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6b3f3b95-c297-4c3d-8524-4b8263fd889f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adbbedaa7d8b42db8dccad5a8d348699'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.747506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6b3f3b95-c297-4c3d-8524-4b8263fd889f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adbbedaa7d8b42db8dccad5a8d348699'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:37.775573 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1082/2169] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:37 2022] DELETE /identity/v3/users/adbbedaa7d8b42db8dccad5a8d348699 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:37.777094 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1398e-53d0-45bc-ba05-2e40ba374227 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:37.777330 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1398e-53d0-45bc-ba05-2e40ba374227 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:37.777616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e1398e-53d0-45bc-ba05-2e40ba374227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:37.807847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1088/2170] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:37.808552 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e5aee-d742-440a-a990-474b8df0caa4 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:37.815169 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-149e5aee-d742-440a-a990-474b8df0caa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:37.819010 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-13e1398e-53d0-45bc-ba05-2e40ba374227 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:37.820126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-13e1398e-53d0-45bc-ba05-2e40ba374227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:37.837423 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:37.856665 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e5aee-d742-440a-a990-474b8df0caa4 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:37.938219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1083/2171] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:37.939160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1398e-53d0-45bc-ba05-2e40ba374227 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:37.954578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e1398e-53d0-45bc-ba05-2e40ba374227 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:37.957427 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d145e8-ca11-4f82-a4f2-d92e7efebb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:37.958336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d145e8-ca11-4f82-a4f2-d92e7efebb22 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:37.958766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d145e8-ca11-4f82-a4f2-d92e7efebb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:37.959194 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d145e8-ca11-4f82-a4f2-d92e7efebb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:37.960043 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84928e5-ed54-42eb-abb1-26a3e64a9aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:37.960276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d145e8-ca11-4f82-a4f2-d92e7efebb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:37.960690 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84928e5-ed54-42eb-abb1-26a3e64a9aad admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:37.960974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84928e5-ed54-42eb-abb1-26a3e64a9aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:37.961252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84928e5-ed54-42eb-abb1-26a3e64a9aad admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:37.962027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84928e5-ed54-42eb-abb1-26a3e64a9aad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:37.962341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84928e5-ed54-42eb-abb1-26a3e64a9aad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:37.962908 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d145e8-ca11-4f82-a4f2-d92e7efebb22 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:37.963987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84928e5-ed54-42eb-abb1-26a3e64a9aad admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:37.974449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1089/2172] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:37.975991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b63b7a-6a88-46cd-b26b-76d07bfcf5ba None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:37.976290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b63b7a-6a88-46cd-b26b-76d07bfcf5ba None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:37.976570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b63b7a-6a88-46cd-b26b-76d07bfcf5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:37.981191 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1084/2173] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:37.982246 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84928e5-ed54-42eb-abb1-26a3e64a9aad admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:37.995079 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84928e5-ed54-42eb-abb1-26a3e64a9aad admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:37.999584 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a4b63b7a-6a88-46cd-b26b-76d07bfcf5ba None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:38.000941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a4b63b7a-6a88-46cd-b26b-76d07bfcf5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:38.012212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1090/2174] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:38.013332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b63b7a-6a88-46cd-b26b-76d07bfcf5ba None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:38.024805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5d029-535d-44ee-a208-ddc3b0078b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:38.025590 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b63b7a-6a88-46cd-b26b-76d07bfcf5ba None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:38.025744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5d029-535d-44ee-a208-ddc3b0078b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:38.026079 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5d029-535d-44ee-a208-ddc3b0078b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:38.026362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5d029-535d-44ee-a208-ddc3b0078b78 admin admin] PATH_INFO: `/v3/projects/60e26bc44577472c98320b427a6c44d5/users/37d02c424b2e4f2fb1bd2e42419e9ba0/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:38.030836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5d029-535d-44ee-a208-ddc3b0078b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60e26bc44577472c98320b427a6c44d5, user_id=37d02c424b2e4f2fb1bd2e42419e9ba0, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:38.032280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a199f6-d269-4b64-85ee-2f881a86f243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:38.033152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a199f6-d269-4b64-85ee-2f881a86f243 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:38.033601 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a199f6-d269-4b64-85ee-2f881a86f243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:38.033743 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5d029-535d-44ee-a208-ddc3b0078b78 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:38.034832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a199f6-d269-4b64-85ee-2f881a86f243 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:38.035768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a199f6-d269-4b64-85ee-2f881a86f243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:38.038661 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a199f6-d269-4b64-85ee-2f881a86f243 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:38.053438 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1085/2175] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:37 2022] PUT /identity/v3/projects/60e26bc44577472c98320b427a6c44d5/users/37d02c424b2e4f2fb1bd2e42419e9ba0/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:38.054339 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5d029-535d-44ee-a208-ddc3b0078b78 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:38.144051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5d029-535d-44ee-a208-ddc3b0078b78 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:38.148969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a6c5b-5915-4f1f-bf47-d959e36473d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:38.149819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6c5b-5915-4f1f-bf47-d959e36473d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:38.150292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6c5b-5915-4f1f-bf47-d959e36473d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:38.150643 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6c5b-5915-4f1f-bf47-d959e36473d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:38.151458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a6c5b-5915-4f1f-bf47-d959e36473d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:38.151863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a6c5b-5915-4f1f-bf47-d959e36473d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:38.153586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a6c5b-5915-4f1f-bf47-d959e36473d3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:38.171301 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1086/2176] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:38.172697 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a6c5b-5915-4f1f-bf47-d959e36473d3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:38.184064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a6c5b-5915-4f1f-bf47-d959e36473d3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:38.190866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519cd83-af15-4f0f-b353-80fa698dd3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:38.191833 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519cd83-af15-4f0f-b353-80fa698dd3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:38.197406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519cd83-af15-4f0f-b353-80fa698dd3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:38.197406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519cd83-af15-4f0f-b353-80fa698dd3e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:38.197406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519cd83-af15-4f0f-b353-80fa698dd3e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:38.197667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1091/2177] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:38 2022] POST /identity/v3/projects => generated 389 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:38.199533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519cd83-af15-4f0f-b353-80fa698dd3e3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:38.200460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a199f6-d269-4b64-85ee-2f881a86f243 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:38.266849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a199f6-d269-4b64-85ee-2f881a86f243 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:38.272229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b875c-db7b-4e19-a1f2-14171b08d458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:38.273053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b875c-db7b-4e19-a1f2-14171b08d458 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:38.273414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b875c-db7b-4e19-a1f2-14171b08d458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:38.273935 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6b875c-db7b-4e19-a1f2-14171b08d458 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:38.274823 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b875c-db7b-4e19-a1f2-14171b08d458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:38.277110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6b875c-db7b-4e19-a1f2-14171b08d458 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:38.300625 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1087/2178] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:38 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:38.304943 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519cd83-af15-4f0f-b353-80fa698dd3e3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:38.394382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519cd83-af15-4f0f-b353-80fa698dd3e3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:38.404560 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea231210-904c-487b-989d-6dbac971618f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:38.411989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1092/2179] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:38 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:38.412841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea231210-904c-487b-989d-6dbac971618f admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:38.413197 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea231210-904c-487b-989d-6dbac971618f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:38.413537 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea231210-904c-487b-989d-6dbac971618f admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:38.414374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea231210-904c-487b-989d-6dbac971618f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:38.415675 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b875c-db7b-4e19-a1f2-14171b08d458 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:38.423700 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea231210-904c-487b-989d-6dbac971618f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:38.434597 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6b875c-db7b-4e19-a1f2-14171b08d458 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:38.444664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68df86-30f4-4d10-a958-3d9b9087b1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:38.445361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68df86-30f4-4d10-a958-3d9b9087b1dd admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:38.445652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68df86-30f4-4d10-a958-3d9b9087b1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:38.445971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68df86-30f4-4d10-a958-3d9b9087b1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:38.446756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68df86-30f4-4d10-a958-3d9b9087b1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:38.449082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68df86-30f4-4d10-a958-3d9b9087b1dd admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:38.470007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1093/2180] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:48:38.471221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68df86-30f4-4d10-a958-3d9b9087b1dd admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:38.483299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68df86-30f4-4d10-a958-3d9b9087b1dd admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:38.489823 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88a00e-8529-482a-a76b-bf70935097bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:38.490657 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88a00e-8529-482a-a76b-bf70935097bf admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:38.491275 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88a00e-8529-482a-a76b-bf70935097bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:38.491621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88a00e-8529-482a-a76b-bf70935097bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:38.492658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88a00e-8529-482a-a76b-bf70935097bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:38.494485 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88a00e-8529-482a-a76b-bf70935097bf admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:38.508629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1094/2181] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:38.513679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88a00e-8529-482a-a76b-bf70935097bf admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:38.517579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1088/2182] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:38 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:48:38.523133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea231210-904c-487b-989d-6dbac971618f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:38.534171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88a00e-8529-482a-a76b-bf70935097bf admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:38.537075 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d5663-b109-4369-89f5-bd557e1afde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:38.538421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d5663-b109-4369-89f5-bd557e1afde5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:38.538821 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d5663-b109-4369-89f5-bd557e1afde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:38.539179 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d5663-b109-4369-89f5-bd557e1afde5 admin admin] PATH_INFO: `/v3/projects/c213b8671d9d474a95cde4e0d0be38b8/users/e02ecade8d934e4ebd2b6cad6146bce8/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:38.544912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea231210-904c-487b-989d-6dbac971618f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:38.564261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aae63e-14cb-4427-8055-2bd5d357be73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:38.564984 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aae63e-14cb-4427-8055-2bd5d357be73 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:38.565090 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aae63e-14cb-4427-8055-2bd5d357be73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:38.565335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aae63e-14cb-4427-8055-2bd5d357be73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:38.566124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aae63e-14cb-4427-8055-2bd5d357be73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:38.566932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d5663-b109-4369-89f5-bd557e1afde5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c213b8671d9d474a95cde4e0d0be38b8, user_id=e02ecade8d934e4ebd2b6cad6146bce8, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:38.567753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aae63e-14cb-4427-8055-2bd5d357be73 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:38.570126 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d5663-b109-4369-89f5-bd557e1afde5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:38.594019 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1089/2183] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:48:38.598516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aae63e-14cb-4427-8055-2bd5d357be73 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:38.624087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aae63e-14cb-4427-8055-2bd5d357be73 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:38.640423 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bc6ea-557a-4c5d-9e9f-2249b3875d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:38.641132 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bc6ea-557a-4c5d-9e9f-2249b3875d3e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:38.642308 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bc6ea-557a-4c5d-9e9f-2249b3875d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:38.642308 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bc6ea-557a-4c5d-9e9f-2249b3875d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:38.642769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bc6ea-557a-4c5d-9e9f-2249b3875d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:38.645138 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bc6ea-557a-4c5d-9e9f-2249b3875d3e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:38.655405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1095/2184] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:38 2022] PUT /identity/v3/projects/c213b8671d9d474a95cde4e0d0be38b8/users/e02ecade8d934e4ebd2b6cad6146bce8/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:38.660540 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1090/2185] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:48:38.672526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d5663-b109-4369-89f5-bd557e1afde5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:38.673701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57accd-5ba4-4361-bfe0-ace1deb5077a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:38.674686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57accd-5ba4-4361-bfe0-ace1deb5077a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:38.675371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d57accd-5ba4-4361-bfe0-ace1deb5077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:38.737110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-1d57accd-5ba4-4361-bfe0-ace1deb5077a None None] MFA Rules not processed for user `e02ecade8d934e4ebd2b6cad6146bce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:38.738885 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1d57accd-5ba4-4361-bfe0-ace1deb5077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:38.789223 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d5663-b109-4369-89f5-bd557e1afde5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:38.821573 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ac8be-a106-43b2-9fd6-625343773380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:38.822011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ac8be-a106-43b2-9fd6-625343773380 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:38.822442 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1091/2186] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:38.829393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ac8be-a106-43b2-9fd6-625343773380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:38.836563 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ac8be-a106-43b2-9fd6-625343773380 admin admin] PATH_INFO: `/v3/projects/588a4eea2c614e38b7cb0193a4619299/users/a3afc9201efb407da39bb8cb31b26f49/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:38.836728 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57accd-5ba4-4361-bfe0-ace1deb5077a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:38.837937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1d57accd-5ba4-4361-bfe0-ace1deb5077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:38.876628 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ac8be-a106-43b2-9fd6-625343773380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=588a4eea2c614e38b7cb0193a4619299, user_id=a3afc9201efb407da39bb8cb31b26f49, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:38.886159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ac8be-a106-43b2-9fd6-625343773380 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:38.889310 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:38.936696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d57accd-5ba4-4361-bfe0-ace1deb5077a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:38.941326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f6a92-2a43-4613-888a-879c3d47b75d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:38.942038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f6a92-2a43-4613-888a-879c3d47b75d service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:38.942337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f6a92-2a43-4613-888a-879c3d47b75d service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:38.942662 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f6a92-2a43-4613-888a-879c3d47b75d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:38.959317 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f6a92-2a43-4613-888a-879c3d47b75d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:38.960663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f6a92-2a43-4613-888a-879c3d47b75d service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:38.971054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1092/2187] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:48:38.981080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f6a92-2a43-4613-888a-879c3d47b75d service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:38.984304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1a0f6a92-2a43-4613-888a-879c3d47b75d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:39.038945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1096/2188] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:38 2022] PUT /identity/v3/projects/588a4eea2c614e38b7cb0193a4619299/users/a3afc9201efb407da39bb8cb31b26f49/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:39.040649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b6113-503b-4298-94e4-189ae17319ef None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:39.040767 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b6113-503b-4298-94e4-189ae17319ef None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:39.043335 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b6113-503b-4298-94e4-189ae17319ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:39.048444 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f6a92-2a43-4613-888a-879c3d47b75d service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:39.111732 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7c5b6113-503b-4298-94e4-189ae17319ef None None] MFA Rules not processed for user `a3afc9201efb407da39bb8cb31b26f49`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:39.113572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7c5b6113-503b-4298-94e4-189ae17319ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:39.195163 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389595f-a112-41a0-b53c-b75ac7a0611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:39.196410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389595f-a112-41a0-b53c-b75ac7a0611d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:39.196911 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389595f-a112-41a0-b53c-b75ac7a0611d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:39.197509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389595f-a112-41a0-b53c-b75ac7a0611d admin admin] PATH_INFO: `/v3/projects/a7a080242e4546d9885c2f67332b0af8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:39.199132 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389595f-a112-41a0-b53c-b75ac7a0611d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a080242e4546d9885c2f67332b0af8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:39.202514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389595f-a112-41a0-b53c-b75ac7a0611d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:39.307728 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1097/2189] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:39.409115 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b6113-503b-4298-94e4-189ae17319ef None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:39.412602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7c5b6113-503b-4298-94e4-189ae17319ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:39.441466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3389595f-a112-41a0-b53c-b75ac7a0611d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a080242e4546d9885c2f67332b0af8', 'request_id': 'req-3389595f-a112-41a0-b53c-b75ac7a0611d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:39.505916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3389595f-a112-41a0-b53c-b75ac7a0611d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a080242e4546d9885c2f67332b0af8', 'request_id': 'req-3389595f-a112-41a0-b53c-b75ac7a0611d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:39.513846 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3389595f-a112-41a0-b53c-b75ac7a0611d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a080242e4546d9885c2f67332b0af8', 'request_id': 'req-3389595f-a112-41a0-b53c-b75ac7a0611d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:39.534642 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3389595f-a112-41a0-b53c-b75ac7a0611d admin admin] The token cache is being invalidate because project a7a080242e4546d9885c2f67332b0af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:39.536629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:39.537484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3389595f-a112-41a0-b53c-b75ac7a0611d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:39.539328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3389595f-a112-41a0-b53c-b75ac7a0611d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:39.549127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1093/2190] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:38 2022] DELETE /identity/v3/projects/a7a080242e4546d9885c2f67332b0af8 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:39.551221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582351d-ef54-42a6-9aea-5cbc0589ecc3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:39.551512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582351d-ef54-42a6-9aea-5cbc0589ecc3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:39.551795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582351d-ef54-42a6-9aea-5cbc0589ecc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:39.556673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b6113-503b-4298-94e4-189ae17319ef None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:39.585299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2582351d-ef54-42a6-9aea-5cbc0589ecc3 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:39.586676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2582351d-ef54-42a6-9aea-5cbc0589ecc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:39.617438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e81b8-7694-4753-ac67-c22785679990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:39.631637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e81b8-7694-4753-ac67-c22785679990 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:39.632287 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e81b8-7694-4753-ac67-c22785679990 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:39.633781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e81b8-7694-4753-ac67-c22785679990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:39.640219 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b58e81b8-7694-4753-ac67-c22785679990 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:39.756756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e81b8-7694-4753-ac67-c22785679990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:39.758572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e81b8-7694-4753-ac67-c22785679990 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:39.777686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1098/2191] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:39.814047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1094/2192] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:48:39.819897 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fd193-b2f6-4f2f-b6ce-18743e3d4bc9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:39.822247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fd193-b2f6-4f2f-b6ce-18743e3d4bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:39.822549 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fd193-b2f6-4f2f-b6ce-18743e3d4bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:39.894818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e68fd193-b2f6-4f2f-b6ce-18743e3d4bc9 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:39.897273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e68fd193-b2f6-4f2f-b6ce-18743e3d4bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:39.925837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1099/2193] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:39.929983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582351d-ef54-42a6-9aea-5cbc0589ecc3 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:39.945960 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582351d-ef54-42a6-9aea-5cbc0589ecc3 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:39.958368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1a363-d681-49bc-8a1b-b2dde041743d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:39.959126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1a363-d681-49bc-8a1b-b2dde041743d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:39.959415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1a363-d681-49bc-8a1b-b2dde041743d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:39.959694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1a363-d681-49bc-8a1b-b2dde041743d admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:39.960504 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1a363-d681-49bc-8a1b-b2dde041743d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:39.962655 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1a363-d681-49bc-8a1b-b2dde041743d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:39.966651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b1a363-d681-49bc-8a1b-b2dde041743d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:39.986843 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe19866-b4bc-421c-8412-09dd439b9ebf None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:39.987316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe19866-b4bc-421c-8412-09dd439b9ebf None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:39.987795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe19866-b4bc-421c-8412-09dd439b9ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:39.998829 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1095/2194] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:40.007638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1a363-d681-49bc-8a1b-b2dde041743d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:40.031025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b1a363-d681-49bc-8a1b-b2dde041743d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:40.042037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab041b4-ae98-478c-9a8c-6378422f8afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:40.042722 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab041b4-ae98-478c-9a8c-6378422f8afd admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:40.048707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab041b4-ae98-478c-9a8c-6378422f8afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:40.049102 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab041b4-ae98-478c-9a8c-6378422f8afd admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:40.049213 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-9fe19866-b4bc-421c-8412-09dd439b9ebf None None] MFA Rules not processed for user `37d02c424b2e4f2fb1bd2e42419e9ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:40.050649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9fe19866-b4bc-421c-8412-09dd439b9ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:40.050791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab041b4-ae98-478c-9a8c-6378422f8afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:40.052868 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab041b4-ae98-478c-9a8c-6378422f8afd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:40.185681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1100/2195] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:39 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:48:40.203382 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a11112-4711-4f6c-998f-2b717bfe8465 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:40.203814 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a11112-4711-4f6c-998f-2b717bfe8465 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:40.204176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a11112-4711-4f6c-998f-2b717bfe8465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:40.222594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1096/2196] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:40 2022] POST /identity/v3/projects => generated 367 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:48:40.225892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab041b4-ae98-478c-9a8c-6378422f8afd admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:40.266809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-50a11112-4711-4f6c-998f-2b717bfe8465 None None] MFA Rules not processed for user `603b5c82602343a4975b065917058cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:40.271752 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-50a11112-4711-4f6c-998f-2b717bfe8465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:40.355852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab041b4-ae98-478c-9a8c-6378422f8afd admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:40.361178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054cd42-e189-479a-b926-2aaa9591084d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:40.362559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054cd42-e189-479a-b926-2aaa9591084d admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:40.364675 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054cd42-e189-479a-b926-2aaa9591084d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:40.365139 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054cd42-e189-479a-b926-2aaa9591084d admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:40.366260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054cd42-e189-479a-b926-2aaa9591084d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:40.368468 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054cd42-e189-479a-b926-2aaa9591084d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:40.400102 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1101/2197] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:48:40.401403 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bfc6e-0f06-4a00-bbf1-692fbaeb5b6c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:40.401692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bfc6e-0f06-4a00-bbf1-692fbaeb5b6c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:40.402083 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5bfc6e-0f06-4a00-bbf1-692fbaeb5b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:40.426776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bf5bfc6e-0f06-4a00-bbf1-692fbaeb5b6c None None] MFA Rules not processed for user `c6b2af58b8154f35bfe2c0cabb03c0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:40.435144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bf5bfc6e-0f06-4a00-bbf1-692fbaeb5b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:40.455485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1097/2198] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:40 2022] POST /identity/v3/users => generated 284 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:40.457230 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054cd42-e189-479a-b926-2aaa9591084d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:40.459842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7054cd42-e189-479a-b926-2aaa9591084d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:40.515740 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1102/2199] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:40.517237 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bfc6e-0f06-4a00-bbf1-692fbaeb5b6c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:40.531418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5bfc6e-0f06-4a00-bbf1-692fbaeb5b6c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:40.537760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee53aa-3e2c-4f01-a13a-af20e3024d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:40.538356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee53aa-3e2c-4f01-a13a-af20e3024d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:40.538641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee53aa-3e2c-4f01-a13a-af20e3024d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:40.538957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee53aa-3e2c-4f01-a13a-af20e3024d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:40.539720 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee53aa-3e2c-4f01-a13a-af20e3024d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:40.541356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ee53aa-3e2c-4f01-a13a-af20e3024d18 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:40.553852 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1103/2200] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:40.557070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee53aa-3e2c-4f01-a13a-af20e3024d18 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:40.571624 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee53aa-3e2c-4f01-a13a-af20e3024d18 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:40.577021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337297d-7a00-41f3-8b9c-4de9490177e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:40.577663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337297d-7a00-41f3-8b9c-4de9490177e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:40.579688 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337297d-7a00-41f3-8b9c-4de9490177e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:40.579688 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337297d-7a00-41f3-8b9c-4de9490177e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:40.579688 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337297d-7a00-41f3-8b9c-4de9490177e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:40.581679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337297d-7a00-41f3-8b9c-4de9490177e2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:40.587865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054cd42-e189-479a-b926-2aaa9591084d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:40.594675 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e191c-e963-4ce6-86f0-d08e5f5c0299 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:40.595622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e191c-e963-4ce6-86f0-d08e5f5c0299 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:40.595816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1104/2201] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:40.595970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e191c-e963-4ce6-86f0-d08e5f5c0299 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:40.596160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e191c-e963-4ce6-86f0-d08e5f5c0299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:40.598421 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-522e191c-e963-4ce6-86f0-d08e5f5c0299 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:40.600499 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337297d-7a00-41f3-8b9c-4de9490177e2 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:40.614588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337297d-7a00-41f3-8b9c-4de9490177e2 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:40.619513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a95251-56b9-4e62-8ca6-c9ffa9829ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:40.620610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a95251-56b9-4e62-8ca6-c9ffa9829ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:40.620884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a95251-56b9-4e62-8ca6-c9ffa9829ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:40.621167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a95251-56b9-4e62-8ca6-c9ffa9829ea9 admin admin] PATH_INFO: `/v3/projects/7b0cdd1b750e41d18767feceb29d694e/users/2840484a25334af981b3aea87591e5c9/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:40.634318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e191c-e963-4ce6-86f0-d08e5f5c0299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:40.637075 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e191c-e963-4ce6-86f0-d08e5f5c0299 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:40.649971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1098/2202] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:40.651409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a95251-56b9-4e62-8ca6-c9ffa9829ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0cdd1b750e41d18767feceb29d694e, user_id=2840484a25334af981b3aea87591e5c9, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:40.654161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a95251-56b9-4e62-8ca6-c9ffa9829ea9 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:40.758425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1105/2203] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:40 2022] PUT /identity/v3/projects/7b0cdd1b750e41d18767feceb29d694e/users/2840484a25334af981b3aea87591e5c9/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:48:40.770174 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db39868-205c-478b-bd94-1ed9f418391d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:40.770484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db39868-205c-478b-bd94-1ed9f418391d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:40.770740 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db39868-205c-478b-bd94-1ed9f418391d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:40.836229 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2db39868-205c-478b-bd94-1ed9f418391d None None] MFA Rules not processed for user `2840484a25334af981b3aea87591e5c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:40.837571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2db39868-205c-478b-bd94-1ed9f418391d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:40.972593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1099/2204] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:40.974557 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a95251-56b9-4e62-8ca6-c9ffa9829ea9 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:41.090117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a95251-56b9-4e62-8ca6-c9ffa9829ea9 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:41.095430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe515eb-165b-47bc-8b31-50d3937dbfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:41.096338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe515eb-165b-47bc-8b31-50d3937dbfe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:41.101219 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe515eb-165b-47bc-8b31-50d3937dbfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:41.101219 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe515eb-165b-47bc-8b31-50d3937dbfe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:41.101642 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe515eb-165b-47bc-8b31-50d3937dbfe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:41.103802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe515eb-165b-47bc-8b31-50d3937dbfe8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:41.276026 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1106/2205] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:40 2022] POST /identity/v3/projects => generated 367 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:41.281512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db39868-205c-478b-bd94-1ed9f418391d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:41.299526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db39868-205c-478b-bd94-1ed9f418391d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:41.405131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417221bf-65fa-42ff-b820-d3a9c46697c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:41.406234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417221bf-65fa-42ff-b820-d3a9c46697c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:41.406540 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417221bf-65fa-42ff-b820-d3a9c46697c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:41.406806 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417221bf-65fa-42ff-b820-d3a9c46697c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:41.407698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417221bf-65fa-42ff-b820-d3a9c46697c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:41.409744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417221bf-65fa-42ff-b820-d3a9c46697c3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:41.538147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1100/2206] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:41 2022] POST /identity/v3/users => generated 290 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:41.542270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe515eb-165b-47bc-8b31-50d3937dbfe8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:41.553509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe515eb-165b-47bc-8b31-50d3937dbfe8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:41.558677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f94b1-b454-4784-b458-30fc52aae501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:41.559393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f94b1-b454-4784-b458-30fc52aae501 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:41.572954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f94b1-b454-4784-b458-30fc52aae501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:41.572954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f94b1-b454-4784-b458-30fc52aae501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:41.572954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f94b1-b454-4784-b458-30fc52aae501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:41.572954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f94b1-b454-4784-b458-30fc52aae501 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:41.582117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1107/2207] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:41.583414 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417221bf-65fa-42ff-b820-d3a9c46697c3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:41.595415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417221bf-65fa-42ff-b820-d3a9c46697c3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:41.602371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8f053-a9ec-4df0-b5c0-bae76490cf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:41.603608 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8f053-a9ec-4df0-b5c0-bae76490cf2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:41.604084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8f053-a9ec-4df0-b5c0-bae76490cf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:41.604534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f8f053-a9ec-4df0-b5c0-bae76490cf2b admin admin] PATH_INFO: `/v3/projects/0629c103e8de484f872f3462e4256ad5/users/9a10eef5b490449b92c29b3935a5dfcb/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:41.622190 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8f053-a9ec-4df0-b5c0-bae76490cf2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0629c103e8de484f872f3462e4256ad5, user_id=9a10eef5b490449b92c29b3935a5dfcb, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:41.624974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f8f053-a9ec-4df0-b5c0-bae76490cf2b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:41.731583 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1101/2208] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:41 2022] PUT /identity/v3/projects/0629c103e8de484f872f3462e4256ad5/users/9a10eef5b490449b92c29b3935a5dfcb/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:48:41.736947 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f94b1-b454-4784-b458-30fc52aae501 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:41.752631 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f94b1-b454-4784-b458-30fc52aae501 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:41.871157 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45048d02-85da-4a5c-8bb5-30151a60e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:41.871854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45048d02-85da-4a5c-8bb5-30151a60e85e admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:41.872204 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45048d02-85da-4a5c-8bb5-30151a60e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:41.872493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45048d02-85da-4a5c-8bb5-30151a60e85e admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:41.873242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45048d02-85da-4a5c-8bb5-30151a60e85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:41.874947 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45048d02-85da-4a5c-8bb5-30151a60e85e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:41.887160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1108/2209] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:41.891428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8f053-a9ec-4df0-b5c0-bae76490cf2b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:41.904275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f8f053-a9ec-4df0-b5c0-bae76490cf2b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:41.911673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571a24a-607b-4a79-8d93-fffd2adddffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:41.912882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571a24a-607b-4a79-8d93-fffd2adddffa admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:41.913550 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571a24a-607b-4a79-8d93-fffd2adddffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:41.914005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1571a24a-607b-4a79-8d93-fffd2adddffa admin admin] PATH_INFO: `/v3/projects/0629c103e8de484f872f3462e4256ad5/users/9a10eef5b490449b92c29b3935a5dfcb/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:41.917349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571a24a-607b-4a79-8d93-fffd2adddffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0629c103e8de484f872f3462e4256ad5, user_id=9a10eef5b490449b92c29b3935a5dfcb, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:41.921754 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1571a24a-607b-4a79-8d93-fffd2adddffa admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:41.940719 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1102/2210] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:41 2022] PUT /identity/v3/projects/0629c103e8de484f872f3462e4256ad5/users/9a10eef5b490449b92c29b3935a5dfcb/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:41.965843 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899d79b-6eb8-4768-a41c-8a32e1fe400c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:41.966136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899d79b-6eb8-4768-a41c-8a32e1fe400c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:41.968806 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899d79b-6eb8-4768-a41c-8a32e1fe400c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:42.023503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-2899d79b-6eb8-4768-a41c-8a32e1fe400c None None] MFA Rules not processed for user `9a10eef5b490449b92c29b3935a5dfcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:42.024896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2899d79b-6eb8-4768-a41c-8a32e1fe400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:42.114001 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1109/2211] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:41 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:42.133576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571a24a-607b-4a79-8d93-fffd2adddffa admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:42.137834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1571a24a-607b-4a79-8d93-fffd2adddffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:42.218154 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1571a24a-607b-4a79-8d93-fffd2adddffa admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:42.221966 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc207562-989d-48b6-aa67-841332b553bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:42.222629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc207562-989d-48b6-aa67-841332b553bc service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:42.222915 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc207562-989d-48b6-aa67-841332b553bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:42.223307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc207562-989d-48b6-aa67-841332b553bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:42.232916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc207562-989d-48b6-aa67-841332b553bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:42.241151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc207562-989d-48b6-aa67-841332b553bc service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:42.269871 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1103/2212] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:42 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:42.390274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:42.584522 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899d79b-6eb8-4768-a41c-8a32e1fe400c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:42.594499 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899d79b-6eb8-4768-a41c-8a32e1fe400c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:42.598649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047fbab-0210-4d0d-926c-b0bbec38413b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:42.599324 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047fbab-0210-4d0d-926c-b0bbec38413b service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:42.599604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047fbab-0210-4d0d-926c-b0bbec38413b service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:42.600324 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047fbab-0210-4d0d-926c-b0bbec38413b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:42.658185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047fbab-0210-4d0d-926c-b0bbec38413b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:42.660238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047fbab-0210-4d0d-926c-b0bbec38413b service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:42.671063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1110/2213] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:43.209380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:45.944672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc207562-989d-48b6-aa67-841332b553bc service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:45.947166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-dc207562-989d-48b6-aa67-841332b553bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:46.024913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc207562-989d-48b6-aa67-841332b553bc service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:46.029762 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539dbac-37fa-4be6-b52a-4bca3cef04bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:46.030649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539dbac-37fa-4be6-b52a-4bca3cef04bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:46.030941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539dbac-37fa-4be6-b52a-4bca3cef04bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:46.031226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539dbac-37fa-4be6-b52a-4bca3cef04bc admin admin] PATH_INFO: `/v3/users/a3afc9201efb407da39bb8cb31b26f49` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:46.032448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539dbac-37fa-4be6-b52a-4bca3cef04bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3afc9201efb407da39bb8cb31b26f49)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:46.034457 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539dbac-37fa-4be6-b52a-4bca3cef04bc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:46.083382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:46.299561 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7539dbac-37fa-4be6-b52a-4bca3cef04bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3afc9201efb407da39bb8cb31b26f49'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:46.413532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7539dbac-37fa-4be6-b52a-4bca3cef04bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3afc9201efb407da39bb8cb31b26f49'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:46.420864 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7539dbac-37fa-4be6-b52a-4bca3cef04bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3afc9201efb407da39bb8cb31b26f49'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:46.423077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7539dbac-37fa-4be6-b52a-4bca3cef04bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3afc9201efb407da39bb8cb31b26f49'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:46.423778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7539dbac-37fa-4be6-b52a-4bca3cef04bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3afc9201efb407da39bb8cb31b26f49'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:46.446622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1104/2214] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:45 2022] DELETE /identity/v3/users/a3afc9201efb407da39bb8cb31b26f49 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:46.462001 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392d7b0-aabd-46df-ab67-f184190a43e0 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:46.462783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392d7b0-aabd-46df-ab67-f184190a43e0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:46.463084 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392d7b0-aabd-46df-ab67-f184190a43e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:46.482777 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b392d7b0-aabd-46df-ab67-f184190a43e0 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:46.484008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b392d7b0-aabd-46df-ab67-f184190a43e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:46.538470 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:46.566245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1111/2215] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:46.573521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539dbac-37fa-4be6-b52a-4bca3cef04bc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:46.575178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7539dbac-37fa-4be6-b52a-4bca3cef04bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:46.705254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539dbac-37fa-4be6-b52a-4bca3cef04bc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:46.711240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c22df-5668-4c99-9468-e5f7927b6687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:46.712920 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c22df-5668-4c99-9468-e5f7927b6687 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:46.712920 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c22df-5668-4c99-9468-e5f7927b6687 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:46.712920 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c22df-5668-4c99-9468-e5f7927b6687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:46.728939 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c22df-5668-4c99-9468-e5f7927b6687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:46.730854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c22df-5668-4c99-9468-e5f7927b6687 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:46.754626 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1105/2216] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:46.863222 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7fd8-5f06-43f5-804b-bf0c8afecb2d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:46.863976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7fd8-5f06-43f5-804b-bf0c8afecb2d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:46.864232 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c7fd8-5f06-43f5-804b-bf0c8afecb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:46.885673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-df1c7fd8-5f06-43f5-804b-bf0c8afecb2d None None] MFA Rules not processed for user `2ea1ada84a544d959a7a3954993fb6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:46.887571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-df1c7fd8-5f06-43f5-804b-bf0c8afecb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:47.013591 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1112/2217] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:47.791711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c22df-5668-4c99-9468-e5f7927b6687 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:47.793148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c71c22df-5668-4c99-9468-e5f7927b6687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:47.811663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c22df-5668-4c99-9468-e5f7927b6687 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:47.818435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e91042-8a4b-4d6e-8115-66e48e4f66ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:47.820865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e91042-8a4b-4d6e-8115-66e48e4f66ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:47.821339 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e91042-8a4b-4d6e-8115-66e48e4f66ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:47.821865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e91042-8a4b-4d6e-8115-66e48e4f66ed admin admin] PATH_INFO: `/v3/projects/588a4eea2c614e38b7cb0193a4619299` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:47.823405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e91042-8a4b-4d6e-8115-66e48e4f66ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=588a4eea2c614e38b7cb0193a4619299)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:47.825869 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e91042-8a4b-4d6e-8115-66e48e4f66ed admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:48.037715 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:48.041167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-66e91042-8a4b-4d6e-8115-66e48e4f66ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588a4eea2c614e38b7cb0193a4619299', 'request_id': 'req-66e91042-8a4b-4d6e-8115-66e48e4f66ed'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:48.139871 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-66e91042-8a4b-4d6e-8115-66e48e4f66ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588a4eea2c614e38b7cb0193a4619299', 'request_id': 'req-66e91042-8a4b-4d6e-8115-66e48e4f66ed'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:48.153492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-66e91042-8a4b-4d6e-8115-66e48e4f66ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588a4eea2c614e38b7cb0193a4619299', 'request_id': 'req-66e91042-8a4b-4d6e-8115-66e48e4f66ed'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:48.170526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-66e91042-8a4b-4d6e-8115-66e48e4f66ed admin admin] The token cache is being invalidate because project 588a4eea2c614e38b7cb0193a4619299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:48.170947 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-66e91042-8a4b-4d6e-8115-66e48e4f66ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:48.179519 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-66e91042-8a4b-4d6e-8115-66e48e4f66ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:48.179519 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1106/2218] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:47 2022] DELETE /identity/v3/projects/588a4eea2c614e38b7cb0193a4619299 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:48.184662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee201-26ad-49dd-a930-04c5b7d4f7af None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:48.185906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee201-26ad-49dd-a930-04c5b7d4f7af None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:48.186376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ee201-26ad-49dd-a930-04c5b7d4f7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:48.218850 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-102ee201-26ad-49dd-a930-04c5b7d4f7af None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:48.220166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-102ee201-26ad-49dd-a930-04c5b7d4f7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:48.359021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1113/2219] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:48.367329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ecd4-df18-4b8d-a9af-2f8395d627d2 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:48.368020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ecd4-df18-4b8d-a9af-2f8395d627d2 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:48.368432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045ecd4-df18-4b8d-a9af-2f8395d627d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:48.409554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e045ecd4-df18-4b8d-a9af-2f8395d627d2 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:48.413980 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:48.424072 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e045ecd4-df18-4b8d-a9af-2f8395d627d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:48.440227 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1107/2220] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:48.441715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ee201-26ad-49dd-a930-04c5b7d4f7af None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:48.463433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ee201-26ad-49dd-a930-04c5b7d4f7af None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:48.480511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f38c54-3a0d-4d40-a401-d3c2b419d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:48.481871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f38c54-3a0d-4d40-a401-d3c2b419d07d admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:48.487387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f38c54-3a0d-4d40-a401-d3c2b419d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:48.487387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f38c54-3a0d-4d40-a401-d3c2b419d07d admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:48.487387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f38c54-3a0d-4d40-a401-d3c2b419d07d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:48.487387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f38c54-3a0d-4d40-a401-d3c2b419d07d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:48.487387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f38c54-3a0d-4d40-a401-d3c2b419d07d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:48.518695 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1114/2221] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:48.519334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045ecd4-df18-4b8d-a9af-2f8395d627d2 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:48.533057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045ecd4-df18-4b8d-a9af-2f8395d627d2 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:48.546164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464eac1-cc4d-4634-95ec-a0a2502144a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:48.546856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464eac1-cc4d-4634-95ec-a0a2502144a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:48.549862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464eac1-cc4d-4634-95ec-a0a2502144a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:48.550211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464eac1-cc4d-4634-95ec-a0a2502144a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:48.552268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464eac1-cc4d-4634-95ec-a0a2502144a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:48.557061 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464eac1-cc4d-4634-95ec-a0a2502144a1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:48.660314 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1108/2222] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:48 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:48.661103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f38c54-3a0d-4d40-a401-d3c2b419d07d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:48.678781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f38c54-3a0d-4d40-a401-d3c2b419d07d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:48.759058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473cfb9-1e3a-4094-ab66-584422a3eb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:48.760214 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473cfb9-1e3a-4094-ab66-584422a3eb52 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:48.760644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473cfb9-1e3a-4094-ab66-584422a3eb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:48.761070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473cfb9-1e3a-4094-ab66-584422a3eb52 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:48.761980 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473cfb9-1e3a-4094-ab66-584422a3eb52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:48.768948 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e473cfb9-1e3a-4094-ab66-584422a3eb52 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:48.934769 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1115/2223] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:48 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:48:48.936145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464eac1-cc4d-4634-95ec-a0a2502144a1 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:48.953691 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464eac1-cc4d-4634-95ec-a0a2502144a1 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:48.961649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c83ec-8c18-4e0a-9927-070780a93e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:48.962825 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c83ec-8c18-4e0a-9927-070780a93e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:48.963261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c83ec-8c18-4e0a-9927-070780a93e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:48.963768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c83ec-8c18-4e0a-9927-070780a93e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:48.964837 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c83ec-8c18-4e0a-9927-070780a93e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:48.967752 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c83ec-8c18-4e0a-9927-070780a93e60 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:48.981207 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1109/2224] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:48.985814 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473cfb9-1e3a-4094-ab66-584422a3eb52 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:49.000755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473cfb9-1e3a-4094-ab66-584422a3eb52 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:49.015818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b7378c-3b1c-431e-83db-94b1aac15f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:49.017609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7378c-3b1c-431e-83db-94b1aac15f48 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:49.019512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7378c-3b1c-431e-83db-94b1aac15f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:49.019782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b7378c-3b1c-431e-83db-94b1aac15f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:49.020566 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7378c-3b1c-431e-83db-94b1aac15f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:49.024871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b7378c-3b1c-431e-83db-94b1aac15f48 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:49.036798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1116/2225] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:48:49.041051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c83ec-8c18-4e0a-9927-070780a93e60 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:49.055191 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c83ec-8c18-4e0a-9927-070780a93e60 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:49.060110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b81a43-3ff4-4b42-b733-e974796b33fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:49.061019 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b81a43-3ff4-4b42-b733-e974796b33fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:49.061291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b81a43-3ff4-4b42-b733-e974796b33fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:49.061608 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b81a43-3ff4-4b42-b733-e974796b33fd admin admin] PATH_INFO: `/v3/projects/a421acfa796a4d7791cb16ef2053395a/users/c0af8a84c9214b708dd6e710c98efc3c/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:49.102668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b81a43-3ff4-4b42-b733-e974796b33fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a421acfa796a4d7791cb16ef2053395a, user_id=c0af8a84c9214b708dd6e710c98efc3c, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:49.107538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b81a43-3ff4-4b42-b733-e974796b33fd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:49.205235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1110/2226] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:49 2022] PUT /identity/v3/projects/a421acfa796a4d7791cb16ef2053395a/users/c0af8a84c9214b708dd6e710c98efc3c/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:49.213935 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cc236-7eaa-4ed2-b6e2-21cc75c58a91 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:49.214430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cc236-7eaa-4ed2-b6e2-21cc75c58a91 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:49.214581 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cc236-7eaa-4ed2-b6e2-21cc75c58a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:49.242585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e22cc236-7eaa-4ed2-b6e2-21cc75c58a91 None None] MFA Rules not processed for user `c0af8a84c9214b708dd6e710c98efc3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:49.243858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e22cc236-7eaa-4ed2-b6e2-21cc75c58a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:49.314011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1117/2227] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:49.319303 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b81a43-3ff4-4b42-b733-e974796b33fd admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:49.407187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b81a43-3ff4-4b42-b733-e974796b33fd admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:49.407187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4b55e-d394-43f1-bd79-8e5eb2bfad87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:49.407187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4b55e-d394-43f1-bd79-8e5eb2bfad87 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:49.407187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4b55e-d394-43f1-bd79-8e5eb2bfad87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:49.407648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4b55e-d394-43f1-bd79-8e5eb2bfad87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:49.407648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4b55e-d394-43f1-bd79-8e5eb2bfad87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:49.407648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4b55e-d394-43f1-bd79-8e5eb2bfad87 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:49.454035 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:49.524497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1111/2228] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:49 2022] POST /identity/v3/projects => generated 385 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:49.527916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cc236-7eaa-4ed2-b6e2-21cc75c58a91 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:49.536761 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cc236-7eaa-4ed2-b6e2-21cc75c58a91 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:49.598082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06804ce3-0c65-4557-a273-81bb9b5f812d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:49.598764 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06804ce3-0c65-4557-a273-81bb9b5f812d admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:49.599051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06804ce3-0c65-4557-a273-81bb9b5f812d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:49.599338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06804ce3-0c65-4557-a273-81bb9b5f812d admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:49.600031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06804ce3-0c65-4557-a273-81bb9b5f812d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:49.602092 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06804ce3-0c65-4557-a273-81bb9b5f812d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:49.728934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1118/2229] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:49 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:48:49.733244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4b55e-d394-43f1-bd79-8e5eb2bfad87 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:49.749160 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4b55e-d394-43f1-bd79-8e5eb2bfad87 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:49.755249 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70077b0c-4fea-42a2-85f6-31b908c59e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:49.756778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70077b0c-4fea-42a2-85f6-31b908c59e6e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:49.757073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70077b0c-4fea-42a2-85f6-31b908c59e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:49.757348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70077b0c-4fea-42a2-85f6-31b908c59e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:49.758133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70077b0c-4fea-42a2-85f6-31b908c59e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:49.759765 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70077b0c-4fea-42a2-85f6-31b908c59e6e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:49.774227 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1112/2230] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:49.782293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06804ce3-0c65-4557-a273-81bb9b5f812d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:49.787280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06804ce3-0c65-4557-a273-81bb9b5f812d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:49.792365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126494b5-7fc0-4339-ae5a-eb4c92954a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:49.793050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126494b5-7fc0-4339-ae5a-eb4c92954a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:49.793339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126494b5-7fc0-4339-ae5a-eb4c92954a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:49.793621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126494b5-7fc0-4339-ae5a-eb4c92954a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:49.794635 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126494b5-7fc0-4339-ae5a-eb4c92954a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:49.796088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126494b5-7fc0-4339-ae5a-eb4c92954a51 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:49.809023 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1119/2231] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:49.818680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70077b0c-4fea-42a2-85f6-31b908c59e6e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:49.829817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70077b0c-4fea-42a2-85f6-31b908c59e6e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:49.843587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038a702-7d1c-4613-b776-960f8d1cd94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:49.843587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a702-7d1c-4613-b776-960f8d1cd94c admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:49.843587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a702-7d1c-4613-b776-960f8d1cd94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:49.843587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a702-7d1c-4613-b776-960f8d1cd94c admin admin] PATH_INFO: `/v3/projects/aecb023043454cea89c839ee5503cb80/users/5267f6660bda4604be658a859f41e118/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:49.863580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038a702-7d1c-4613-b776-960f8d1cd94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aecb023043454cea89c839ee5503cb80, user_id=5267f6660bda4604be658a859f41e118, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:49.868621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038a702-7d1c-4613-b776-960f8d1cd94c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:49.954179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1113/2232] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:49 2022] PUT /identity/v3/projects/aecb023043454cea89c839ee5503cb80/users/5267f6660bda4604be658a859f41e118/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:49.966311 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb362c61-3923-4e84-b154-332c6ca7d3ba None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:49.966597 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb362c61-3923-4e84-b154-332c6ca7d3ba None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:49.969907 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb362c61-3923-4e84-b154-332c6ca7d3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:50.000674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-fb362c61-3923-4e84-b154-332c6ca7d3ba None None] MFA Rules not processed for user `5267f6660bda4604be658a859f41e118`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:50.001902 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fb362c61-3923-4e84-b154-332c6ca7d3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:50.092359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1120/2233] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:50.097696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038a702-7d1c-4613-b776-960f8d1cd94c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:50.192498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038a702-7d1c-4613-b776-960f8d1cd94c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:50.198329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97083924-dfcd-49c7-98f2-b9adadef0b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:50.199348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97083924-dfcd-49c7-98f2-b9adadef0b59 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:50.200056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97083924-dfcd-49c7-98f2-b9adadef0b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:50.200892 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97083924-dfcd-49c7-98f2-b9adadef0b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:50.201801 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97083924-dfcd-49c7-98f2-b9adadef0b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:50.204957 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97083924-dfcd-49c7-98f2-b9adadef0b59 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:50.365144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1114/2234] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:50 2022] POST /identity/v3/projects => generated 383 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:50.369264 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb362c61-3923-4e84-b154-332c6ca7d3ba None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:50.385877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb362c61-3923-4e84-b154-332c6ca7d3ba None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:50.466884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdff311-64f7-4cff-ae7a-203cfb8f20f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:50.468173 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdff311-64f7-4cff-ae7a-203cfb8f20f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:50.468631 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdff311-64f7-4cff-ae7a-203cfb8f20f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:50.468927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdff311-64f7-4cff-ae7a-203cfb8f20f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:50.470281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdff311-64f7-4cff-ae7a-203cfb8f20f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:50.480384 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdff311-64f7-4cff-ae7a-203cfb8f20f7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:50.569463 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1121/2235] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:50 2022] POST /identity/v3/users => generated 298 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:50.573154 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97083924-dfcd-49c7-98f2-b9adadef0b59 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:50.590556 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:50.596707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97083924-dfcd-49c7-98f2-b9adadef0b59 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:50.602688 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a033d4-6ed4-482f-acab-4b448edad11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:50.603364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a033d4-6ed4-482f-acab-4b448edad11d admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:50.603653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a033d4-6ed4-482f-acab-4b448edad11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:50.603938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a033d4-6ed4-482f-acab-4b448edad11d admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:50.604743 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a033d4-6ed4-482f-acab-4b448edad11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:50.607136 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a033d4-6ed4-482f-acab-4b448edad11d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:50.625304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1115/2236] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:50.626596 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdff311-64f7-4cff-ae7a-203cfb8f20f7 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:50.637704 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdff311-64f7-4cff-ae7a-203cfb8f20f7 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:50.642440 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf4e96-a377-4e47-97bf-3e5061d4992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:50.643336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4e96-a377-4e47-97bf-3e5061d4992d admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:50.643647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4e96-a377-4e47-97bf-3e5061d4992d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:50.643919 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf4e96-a377-4e47-97bf-3e5061d4992d admin admin] PATH_INFO: `/v3/projects/f5b61e87ce63435c9eb6c7fc1375cf5b/users/33fbd1308c634be09dd4d177ab7547ed/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:50.658936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf4e96-a377-4e47-97bf-3e5061d4992d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b61e87ce63435c9eb6c7fc1375cf5b, user_id=33fbd1308c634be09dd4d177ab7547ed, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:50.661627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf4e96-a377-4e47-97bf-3e5061d4992d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:50.752829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1122/2237] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:50 2022] PUT /identity/v3/projects/f5b61e87ce63435c9eb6c7fc1375cf5b/users/33fbd1308c634be09dd4d177ab7547ed/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:48:50.757135 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a033d4-6ed4-482f-acab-4b448edad11d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:50.767537 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a033d4-6ed4-482f-acab-4b448edad11d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:50.824741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4d96a-d2d3-4077-9582-bdd407e4fcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:50.825364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4d96a-d2d3-4077-9582-bdd407e4fcb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:50.825650 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4d96a-d2d3-4077-9582-bdd407e4fcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:50.825961 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4d96a-d2d3-4077-9582-bdd407e4fcb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:50.826693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4d96a-d2d3-4077-9582-bdd407e4fcb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:50.828349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4d96a-d2d3-4077-9582-bdd407e4fcb0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:50.838229 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1116/2238] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:50.842400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf4e96-a377-4e47-97bf-3e5061d4992d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:50.853508 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf4e96-a377-4e47-97bf-3e5061d4992d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:50.858314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc91aff-10fc-490d-8777-96521d31dffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:50.859210 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc91aff-10fc-490d-8777-96521d31dffc admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:50.859490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc91aff-10fc-490d-8777-96521d31dffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:50.859768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc91aff-10fc-490d-8777-96521d31dffc admin admin] PATH_INFO: `/v3/projects/f5b61e87ce63435c9eb6c7fc1375cf5b/users/33fbd1308c634be09dd4d177ab7547ed/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:50.862041 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc91aff-10fc-490d-8777-96521d31dffc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5b61e87ce63435c9eb6c7fc1375cf5b, user_id=33fbd1308c634be09dd4d177ab7547ed, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:50.864964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc91aff-10fc-490d-8777-96521d31dffc admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:50.876759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1123/2239] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:50 2022] PUT /identity/v3/projects/f5b61e87ce63435c9eb6c7fc1375cf5b/users/33fbd1308c634be09dd4d177ab7547ed/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:50.888513 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2370109-751d-4af6-9ec2-bb63ac785029 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:50.888920 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2370109-751d-4af6-9ec2-bb63ac785029 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:50.889399 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2370109-751d-4af6-9ec2-bb63ac785029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:50.919999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f2370109-751d-4af6-9ec2-bb63ac785029 None None] MFA Rules not processed for user `33fbd1308c634be09dd4d177ab7547ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:50.921312 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f2370109-751d-4af6-9ec2-bb63ac785029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:50.976796 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:51.026077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1117/2240] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:51.092378 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc91aff-10fc-490d-8777-96521d31dffc admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:51.094167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9dc91aff-10fc-490d-8777-96521d31dffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:51.168381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc91aff-10fc-490d-8777-96521d31dffc admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:51.173496 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ec196-501e-4774-a1c3-8f01e16d9bed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:51.174254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ec196-501e-4774-a1c3-8f01e16d9bed service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:51.174603 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ec196-501e-4774-a1c3-8f01e16d9bed service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:51.175531 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ec196-501e-4774-a1c3-8f01e16d9bed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:51.274276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ec196-501e-4774-a1c3-8f01e16d9bed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:51.274276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ec196-501e-4774-a1c3-8f01e16d9bed service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:51.285012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1124/2241] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:51.859222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2370109-751d-4af6-9ec2-bb63ac785029 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:51.860885 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f2370109-751d-4af6-9ec2-bb63ac785029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:51.948911 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2370109-751d-4af6-9ec2-bb63ac785029 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:51.957746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3266b8-8c5a-4947-80e9-1a119fa4f523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:51.959134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3266b8-8c5a-4947-80e9-1a119fa4f523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:51.959497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3266b8-8c5a-4947-80e9-1a119fa4f523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:51.959879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3266b8-8c5a-4947-80e9-1a119fa4f523 admin admin] PATH_INFO: `/v3/users/2840484a25334af981b3aea87591e5c9` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:51.961390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3266b8-8c5a-4947-80e9-1a119fa4f523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2840484a25334af981b3aea87591e5c9)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:51.965565 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3266b8-8c5a-4947-80e9-1a119fa4f523 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:52.157740 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7f3266b8-8c5a-4947-80e9-1a119fa4f523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2840484a25334af981b3aea87591e5c9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:52.224769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7f3266b8-8c5a-4947-80e9-1a119fa4f523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2840484a25334af981b3aea87591e5c9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:52.225396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7f3266b8-8c5a-4947-80e9-1a119fa4f523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2840484a25334af981b3aea87591e5c9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:52.233057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7f3266b8-8c5a-4947-80e9-1a119fa4f523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2840484a25334af981b3aea87591e5c9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:52.233988 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7f3266b8-8c5a-4947-80e9-1a119fa4f523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2840484a25334af981b3aea87591e5c9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:52.251369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1118/2242] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:51 2022] DELETE /identity/v3/users/2840484a25334af981b3aea87591e5c9 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:52.257077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f9923-0650-4562-9a9d-64706cd3d6af None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:52.257541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f9923-0650-4562-9a9d-64706cd3d6af None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:52.257681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f9923-0650-4562-9a9d-64706cd3d6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:52.284176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6c4f9923-0650-4562-9a9d-64706cd3d6af None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:52.285805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6c4f9923-0650-4562-9a9d-64706cd3d6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:52.344891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1125/2243] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:52.355342 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3266b8-8c5a-4947-80e9-1a119fa4f523 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:52.356449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:52.356761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7f3266b8-8c5a-4947-80e9-1a119fa4f523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:52.416434 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3266b8-8c5a-4947-80e9-1a119fa4f523 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:52.420178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043368c-9017-4f20-8845-764e19e8868b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:52.420837 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043368c-9017-4f20-8845-764e19e8868b service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:52.424352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043368c-9017-4f20-8845-764e19e8868b service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:52.424352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043368c-9017-4f20-8845-764e19e8868b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:52.431979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043368c-9017-4f20-8845-764e19e8868b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:52.433433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043368c-9017-4f20-8845-764e19e8868b service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:52.445604 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1119/2244] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:53.236362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:53.321037 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f9923-0650-4562-9a9d-64706cd3d6af None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:53.322615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6c4f9923-0650-4562-9a9d-64706cd3d6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:53.334713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f9923-0650-4562-9a9d-64706cd3d6af None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:53.345310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:53.346130 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:53.346472 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:53.346670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] PATH_INFO: `/v3/projects/7b0cdd1b750e41d18767feceb29d694e` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:53.348203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0cdd1b750e41d18767feceb29d694e)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:53.350064 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:53.519720 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0cdd1b750e41d18767feceb29d694e', 'request_id': 'req-dd6d6608-3b15-49c6-bef9-109607d33c2f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:53.609731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0cdd1b750e41d18767feceb29d694e', 'request_id': 'req-dd6d6608-3b15-49c6-bef9-109607d33c2f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:53.617556 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0cdd1b750e41d18767feceb29d694e', 'request_id': 'req-dd6d6608-3b15-49c6-bef9-109607d33c2f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:53.634203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] The token cache is being invalidate because project 7b0cdd1b750e41d18767feceb29d694e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:53.634556 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:53.635215 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:53.637432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1126/2245] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:53 2022] DELETE /identity/v3/projects/7b0cdd1b750e41d18767feceb29d694e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:53.641156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043368c-9017-4f20-8845-764e19e8868b service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:53.663474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043368c-9017-4f20-8845-764e19e8868b service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:53.728328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03692f-a69e-42ee-adb3-ecedbfc9e965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:53.729170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03692f-a69e-42ee-adb3-ecedbfc9e965 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:53.729454 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03692f-a69e-42ee-adb3-ecedbfc9e965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:53.729747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03692f-a69e-42ee-adb3-ecedbfc9e965 admin admin] PATH_INFO: `/v3/users/9a10eef5b490449b92c29b3935a5dfcb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:53.731009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03692f-a69e-42ee-adb3-ecedbfc9e965 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a10eef5b490449b92c29b3935a5dfcb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:53.732989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03692f-a69e-42ee-adb3-ecedbfc9e965 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:53.950583 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be03692f-a69e-42ee-adb3-ecedbfc9e965 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a10eef5b490449b92c29b3935a5dfcb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:54.007626 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:54.009137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:54.022449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d6608-3b15-49c6-bef9-109607d33c2f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:54.027656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c042df-1f56-44a8-b0b8-6f760c3ac9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:54.028961 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c042df-1f56-44a8-b0b8-6f760c3ac9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:54.029245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c042df-1f56-44a8-b0b8-6f760c3ac9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:54.029678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c042df-1f56-44a8-b0b8-6f760c3ac9a6 admin admin] PATH_INFO: `/v3/users/e02ecade8d934e4ebd2b6cad6146bce8` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:54.031089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c042df-1f56-44a8-b0b8-6f760c3ac9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e02ecade8d934e4ebd2b6cad6146bce8)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:54.033042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c042df-1f56-44a8-b0b8-6f760c3ac9a6 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:54.047468 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be03692f-a69e-42ee-adb3-ecedbfc9e965 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a10eef5b490449b92c29b3935a5dfcb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:54.048302 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be03692f-a69e-42ee-adb3-ecedbfc9e965 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a10eef5b490449b92c29b3935a5dfcb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:54.057576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be03692f-a69e-42ee-adb3-ecedbfc9e965 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a10eef5b490449b92c29b3935a5dfcb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:54.058238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be03692f-a69e-42ee-adb3-ecedbfc9e965 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a10eef5b490449b92c29b3935a5dfcb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:54.079166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1120/2246] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:53 2022] DELETE /identity/v3/users/9a10eef5b490449b92c29b3935a5dfcb => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:54.258354 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-89c042df-1f56-44a8-b0b8-6f760c3ac9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e02ecade8d934e4ebd2b6cad6146bce8'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:54.259313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-89c042df-1f56-44a8-b0b8-6f760c3ac9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e02ecade8d934e4ebd2b6cad6146bce8'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:54.260728 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-89c042df-1f56-44a8-b0b8-6f760c3ac9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e02ecade8d934e4ebd2b6cad6146bce8'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:54.276144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-89c042df-1f56-44a8-b0b8-6f760c3ac9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e02ecade8d934e4ebd2b6cad6146bce8'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:54.284987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-89c042df-1f56-44a8-b0b8-6f760c3ac9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e02ecade8d934e4ebd2b6cad6146bce8'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:54.424902 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1127/2247] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:48:54 2022] DELETE /identity/v3/users/e02ecade8d934e4ebd2b6cad6146bce8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:54.432663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b92d-ddde-4487-9a4d-aa875ad7e7d8 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:54.433118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b92d-ddde-4487-9a4d-aa875ad7e7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:54.433589 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74b92d-ddde-4487-9a4d-aa875ad7e7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:54.469699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-ed74b92d-ddde-4487-9a4d-aa875ad7e7d8 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:54.474553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ed74b92d-ddde-4487-9a4d-aa875ad7e7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:54.485137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c042df-1f56-44a8-b0b8-6f760c3ac9a6 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:54.487948 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-89c042df-1f56-44a8-b0b8-6f760c3ac9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:54.556391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1121/2248] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:48:54.566907 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c042df-1f56-44a8-b0b8-6f760c3ac9a6 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:54.567235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74b92d-ddde-4487-9a4d-aa875ad7e7d8 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:54.568793 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ed74b92d-ddde-4487-9a4d-aa875ad7e7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:54.571072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02697380-fb3f-43cb-99b9-7fa57e5c1515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:54.571865 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02697380-fb3f-43cb-99b9-7fa57e5c1515 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:54.572362 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02697380-fb3f-43cb-99b9-7fa57e5c1515 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:54.572645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02697380-fb3f-43cb-99b9-7fa57e5c1515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:54.574463 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-02697380-fb3f-43cb-99b9-7fa57e5c1515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:54.628864 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74b92d-ddde-4487-9a4d-aa875ad7e7d8 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:54.633125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e1be9f-45e3-4d5b-bf3b-a94960943a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:54.634199 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1be9f-45e3-4d5b-bf3b-a94960943a7b service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:54.634653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1be9f-45e3-4d5b-bf3b-a94960943a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:54.635107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e1be9f-45e3-4d5b-bf3b-a94960943a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:54.637263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02697380-fb3f-43cb-99b9-7fa57e5c1515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:54.638808 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02697380-fb3f-43cb-99b9-7fa57e5c1515 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:54.645693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1be9f-45e3-4d5b-bf3b-a94960943a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:54.652915 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e1be9f-45e3-4d5b-bf3b-a94960943a7b service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:54.653092 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1128/2249] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:48:54.658392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1122/2250] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:48:54.684979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02697380-fb3f-43cb-99b9-7fa57e5c1515 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:54.686527 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-02697380-fb3f-43cb-99b9-7fa57e5c1515 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:54.705103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02697380-fb3f-43cb-99b9-7fa57e5c1515 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:54.733627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fcdf5-47b7-42de-9c60-87a323d2954c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:54.733627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fcdf5-47b7-42de-9c60-87a323d2954c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:54.733627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fcdf5-47b7-42de-9c60-87a323d2954c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:54.733627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fcdf5-47b7-42de-9c60-87a323d2954c admin admin] PATH_INFO: `/v3/projects/0629c103e8de484f872f3462e4256ad5` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:54.734030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fcdf5-47b7-42de-9c60-87a323d2954c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0629c103e8de484f872f3462e4256ad5)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:54.734030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fcdf5-47b7-42de-9c60-87a323d2954c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:55.049280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cb3fcdf5-47b7-42de-9c60-87a323d2954c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0629c103e8de484f872f3462e4256ad5', 'request_id': 'req-cb3fcdf5-47b7-42de-9c60-87a323d2954c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:55.164998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cb3fcdf5-47b7-42de-9c60-87a323d2954c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0629c103e8de484f872f3462e4256ad5', 'request_id': 'req-cb3fcdf5-47b7-42de-9c60-87a323d2954c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:55.174278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cb3fcdf5-47b7-42de-9c60-87a323d2954c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0629c103e8de484f872f3462e4256ad5', 'request_id': 'req-cb3fcdf5-47b7-42de-9c60-87a323d2954c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:55.196160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cb3fcdf5-47b7-42de-9c60-87a323d2954c admin admin] The token cache is being invalidate because project 0629c103e8de484f872f3462e4256ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:55.196827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cb3fcdf5-47b7-42de-9c60-87a323d2954c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:55.197647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-cb3fcdf5-47b7-42de-9c60-87a323d2954c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:55.213016 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1129/2251] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:54 2022] DELETE /identity/v3/projects/0629c103e8de484f872f3462e4256ad5 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:55.226022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2abaa-8885-4eb4-990b-43d208ad45ff None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:55.226384 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2abaa-8885-4eb4-990b-43d208ad45ff None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:55.226743 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2abaa-8885-4eb4-990b-43d208ad45ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:55.266244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-80c2abaa-8885-4eb4-990b-43d208ad45ff None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:55.270344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-80c2abaa-8885-4eb4-990b-43d208ad45ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:55.375670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1123/2252] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:55.385152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273f53-0ca7-41fd-aeb9-538eb226744b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:55.385458 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273f53-0ca7-41fd-aeb9-538eb226744b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:55.386388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77273f53-0ca7-41fd-aeb9-538eb226744b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:55.407071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-77273f53-0ca7-41fd-aeb9-538eb226744b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:55.408312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-77273f53-0ca7-41fd-aeb9-538eb226744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:55.420913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1130/2253] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:55.421846 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2abaa-8885-4eb4-990b-43d208ad45ff None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:55.433902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2abaa-8885-4eb4-990b-43d208ad45ff None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:55.442163 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842eb83-f56c-4771-8e7c-b3965e5ae0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:55.443076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842eb83-f56c-4771-8e7c-b3965e5ae0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:55.456994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842eb83-f56c-4771-8e7c-b3965e5ae0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:55.456994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842eb83-f56c-4771-8e7c-b3965e5ae0e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:55.456994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842eb83-f56c-4771-8e7c-b3965e5ae0e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:48:55.456994 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842eb83-f56c-4771-8e7c-b3965e5ae0e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:55.457439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3842eb83-f56c-4771-8e7c-b3965e5ae0e9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:55.461422 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77273f53-0ca7-41fd-aeb9-538eb226744b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:55.463751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-77273f53-0ca7-41fd-aeb9-538eb226744b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:55.484710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77273f53-0ca7-41fd-aeb9-538eb226744b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:55.484874 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:55.486073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:55.486593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:55.487126 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] PATH_INFO: `/v3/projects/c213b8671d9d474a95cde4e0d0be38b8` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:55.488811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c213b8671d9d474a95cde4e0d0be38b8)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:55.491573 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:55.496617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1124/2254] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:48:55.497706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842eb83-f56c-4771-8e7c-b3965e5ae0e9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:55.513411 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3842eb83-f56c-4771-8e7c-b3965e5ae0e9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:55.519418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceab231-2a82-439c-9282-175958169045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:55.520172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab231-2a82-439c-9282-175958169045 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:55.520549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab231-2a82-439c-9282-175958169045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:55.520832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab231-2a82-439c-9282-175958169045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:55.521571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceab231-2a82-439c-9282-175958169045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:55.523552 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceab231-2a82-439c-9282-175958169045 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:55.650628 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1125/2255] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:48:55 2022] POST /identity/v3/projects => generated 367 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:55.651805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceab231-2a82-439c-9282-175958169045 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:55.680998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c213b8671d9d474a95cde4e0d0be38b8', 'request_id': 'req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:55.745626 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceab231-2a82-439c-9282-175958169045 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:55.750849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a198386-e785-4f06-b30e-a69072bb9f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:55.751618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a198386-e785-4f06-b30e-a69072bb9f13 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:55.751978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a198386-e785-4f06-b30e-a69072bb9f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:55.752551 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a198386-e785-4f06-b30e-a69072bb9f13 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:55.753781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a198386-e785-4f06-b30e-a69072bb9f13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:55.756410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a198386-e785-4f06-b30e-a69072bb9f13 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:55.874832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c213b8671d9d474a95cde4e0d0be38b8', 'request_id': 'req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:55.879870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1126/2256] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:48:55 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:48:55.886159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a198386-e785-4f06-b30e-a69072bb9f13 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:55.889683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c213b8671d9d474a95cde4e0d0be38b8', 'request_id': 'req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:55.896378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a198386-e785-4f06-b30e-a69072bb9f13 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:55.898129 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] The token cache is being invalidate because project c213b8671d9d474a95cde4e0d0be38b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:48:55.901090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:55.901090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:48:55.901090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1131/2257] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:48:55 2022] DELETE /identity/v3/projects/c213b8671d9d474a95cde4e0d0be38b8 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:48:55.901388 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41228cf-dca8-4e6d-9882-fafc575cd453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:55.902063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41228cf-dca8-4e6d-9882-fafc575cd453 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:55.902350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41228cf-dca8-4e6d-9882-fafc575cd453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:55.902633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41228cf-dca8-4e6d-9882-fafc575cd453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:55.903382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41228cf-dca8-4e6d-9882-fafc575cd453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:55.905056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41228cf-dca8-4e6d-9882-fafc575cd453 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:55.916194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1127/2258] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:48:55.928178 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:55.929656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:56.005355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaf56a-386a-47f0-bddd-b29bb3c09ebc admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:56.010776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9113b8-bef0-418c-bd9d-2ed48a32a8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:56.011478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9113b8-bef0-418c-bd9d-2ed48a32a8fa admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:56.011767 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9113b8-bef0-418c-bd9d-2ed48a32a8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:56.012049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9113b8-bef0-418c-bd9d-2ed48a32a8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:56.012941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9113b8-bef0-418c-bd9d-2ed48a32a8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:56.014641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9113b8-bef0-418c-bd9d-2ed48a32a8fa admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:56.026650 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1132/2259] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:48:56.030620 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41228cf-dca8-4e6d-9882-fafc575cd453 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:56.043667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41228cf-dca8-4e6d-9882-fafc575cd453 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:56.049147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b380e-048d-426f-b52d-a3ecdc54f571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:56.050779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b380e-048d-426f-b52d-a3ecdc54f571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:56.051068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b380e-048d-426f-b52d-a3ecdc54f571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:56.051349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b380e-048d-426f-b52d-a3ecdc54f571 admin admin] PATH_INFO: `/v3/projects/f95ac71c38f147a7a6f5b4a3abcc3971/users/dc8fc6f390d246e7967d81fba223d2de/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:56.068080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b380e-048d-426f-b52d-a3ecdc54f571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95ac71c38f147a7a6f5b4a3abcc3971, user_id=dc8fc6f390d246e7967d81fba223d2de, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:56.071093 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b380e-048d-426f-b52d-a3ecdc54f571 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:56.141493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1128/2260] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:48:56 2022] PUT /identity/v3/projects/f95ac71c38f147a7a6f5b4a3abcc3971/users/dc8fc6f390d246e7967d81fba223d2de/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:48:56.155129 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25bc8-54d4-489b-ab7f-38be70994cdf None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:56.155671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25bc8-54d4-489b-ab7f-38be70994cdf None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:56.156196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25bc8-54d4-489b-ab7f-38be70994cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:56.186740 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d8d25bc8-54d4-489b-ab7f-38be70994cdf None None] MFA Rules not processed for user `dc8fc6f390d246e7967d81fba223d2de`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:48:56.187976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d8d25bc8-54d4-489b-ab7f-38be70994cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:56.270567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1133/2261] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:48:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:48:56.284665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b380e-048d-426f-b52d-a3ecdc54f571 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:56.287228 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6d9b380e-048d-426f-b52d-a3ecdc54f571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:56.386517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b380e-048d-426f-b52d-a3ecdc54f571 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:56.390352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd21b3-4cc5-40cb-aeb7-bf08fe34a9d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669a11ce83b746eeb7f4e7d0acca4b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:56.391016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd21b3-4cc5-40cb-aeb7-bf08fe34a9d7 service glance] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:56.391296 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd21b3-4cc5-40cb-aeb7-bf08fe34a9d7 service glance] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:56.391569 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd21b3-4cc5-40cb-aeb7-bf08fe34a9d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:56.405928 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd21b3-4cc5-40cb-aeb7-bf08fe34a9d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:56.409978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd21b3-4cc5-40cb-aeb7-bf08fe34a9d7 service glance] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:56.419223 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1129/2262] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:56.431633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:56.734747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d25bc8-54d4-489b-ab7f-38be70994cdf None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:56.736195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d8d25bc8-54d4-489b-ab7f-38be70994cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:56.813694 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d25bc8-54d4-489b-ab7f-38be70994cdf None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:56.818946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43362edd-f6fc-4ebc-b037-d5237f52a794 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:56.819648 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43362edd-f6fc-4ebc-b037-d5237f52a794 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:56.820041 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43362edd-f6fc-4ebc-b037-d5237f52a794 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:56.820986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43362edd-f6fc-4ebc-b037-d5237f52a794 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:56.822245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-43362edd-f6fc-4ebc-b037-d5237f52a794 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:56.887979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43362edd-f6fc-4ebc-b037-d5237f52a794 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:56.889426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43362edd-f6fc-4ebc-b037-d5237f52a794 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:56.900509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1134/2263] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:57.013494 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:58.510568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:58.707389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd21b3-4cc5-40cb-aeb7-bf08fe34a9d7 service glance] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:48:58.718716 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd21b3-4cc5-40cb-aeb7-bf08fe34a9d7 service glance] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:48:58.722256 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291b41f-6c83-412b-afd0-3bfefa0cbb5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:48:58.722912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291b41f-6c83-412b-afd0-3bfefa0cbb5a service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:48:58.724070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291b41f-6c83-412b-afd0-3bfefa0cbb5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:48:58.724886 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291b41f-6c83-412b-afd0-3bfefa0cbb5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:48:58.726793 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e291b41f-6c83-412b-afd0-3bfefa0cbb5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:48:58.807158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291b41f-6c83-412b-afd0-3bfefa0cbb5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:48:58.812088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291b41f-6c83-412b-afd0-3bfefa0cbb5a service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:48:58.820869 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1130/2264] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:48:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:48:59.105248 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:48:59.819951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:01.259315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:01.562056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:01.903243 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43362edd-f6fc-4ebc-b037-d5237f52a794 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:01.904706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-43362edd-f6fc-4ebc-b037-d5237f52a794 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:01.972929 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43362edd-f6fc-4ebc-b037-d5237f52a794 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:01.978103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44d26b-08a1-400e-87ac-4dbf9720128a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:01.979021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44d26b-08a1-400e-87ac-4dbf9720128a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:01.979307 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44d26b-08a1-400e-87ac-4dbf9720128a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:01.979589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44d26b-08a1-400e-87ac-4dbf9720128a admin admin] PATH_INFO: `/v3/users/c0af8a84c9214b708dd6e710c98efc3c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:01.980798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44d26b-08a1-400e-87ac-4dbf9720128a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0af8a84c9214b708dd6e710c98efc3c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:01.982800 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44d26b-08a1-400e-87ac-4dbf9720128a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:02.197327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fa44d26b-08a1-400e-87ac-4dbf9720128a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0af8a84c9214b708dd6e710c98efc3c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:02.198379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fa44d26b-08a1-400e-87ac-4dbf9720128a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0af8a84c9214b708dd6e710c98efc3c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:02.199189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fa44d26b-08a1-400e-87ac-4dbf9720128a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0af8a84c9214b708dd6e710c98efc3c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:02.214184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fa44d26b-08a1-400e-87ac-4dbf9720128a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0af8a84c9214b708dd6e710c98efc3c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:02.221600 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fa44d26b-08a1-400e-87ac-4dbf9720128a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0af8a84c9214b708dd6e710c98efc3c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:02.304925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1135/2265] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:49:01 2022] DELETE /identity/v3/users/c0af8a84c9214b708dd6e710c98efc3c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:02.309584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7163937-ded7-4d8a-b915-5db3474db754 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:02.310070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7163937-ded7-4d8a-b915-5db3474db754 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:02.310188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7163937-ded7-4d8a-b915-5db3474db754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:02.336283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d7163937-ded7-4d8a-b915-5db3474db754 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:02.337533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d7163937-ded7-4d8a-b915-5db3474db754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:02.402070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1131/2266] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:02.412620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44d26b-08a1-400e-87ac-4dbf9720128a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:02.414079 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fa44d26b-08a1-400e-87ac-4dbf9720128a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:02.482402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44d26b-08a1-400e-87ac-4dbf9720128a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:02.486142 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96b3b6-48e4-45ea-989c-aa224c1ec3ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:02.486812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b3b6-48e4-45ea-989c-aa224c1ec3ef service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:02.487090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b3b6-48e4-45ea-989c-aa224c1ec3ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:02.487361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96b3b6-48e4-45ea-989c-aa224c1ec3ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:02.498536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96b3b6-48e4-45ea-989c-aa224c1ec3ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:02.500004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96b3b6-48e4-45ea-989c-aa224c1ec3ef service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:02.511363 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1136/2267] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:49:02.978403 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7163937-ded7-4d8a-b915-5db3474db754 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:02.980883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d7163937-ded7-4d8a-b915-5db3474db754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:02.996167 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7163937-ded7-4d8a-b915-5db3474db754 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:03.015819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:03.018379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:03.018980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:03.019431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] PATH_INFO: `/v3/projects/a421acfa796a4d7791cb16ef2053395a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:03.022178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] RBAC: Authorizing `identity:delete_project(project_id=a421acfa796a4d7791cb16ef2053395a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:03.024355 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:03.165208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a421acfa796a4d7791cb16ef2053395a', 'request_id': 'req-d92f5622-1767-4aaf-b2d1-6d57075edeff'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:03.229934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a421acfa796a4d7791cb16ef2053395a', 'request_id': 'req-d92f5622-1767-4aaf-b2d1-6d57075edeff'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:03.237860 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a421acfa796a4d7791cb16ef2053395a', 'request_id': 'req-d92f5622-1767-4aaf-b2d1-6d57075edeff'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:03.252251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] The token cache is being invalidate because project a421acfa796a4d7791cb16ef2053395a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:49:03.252594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:03.253216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:03.255814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1132/2268] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:49:02 2022] DELETE /identity/v3/projects/a421acfa796a4d7791cb16ef2053395a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:03.259949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96b3b6-48e4-45ea-989c-aa224c1ec3ef service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:03.271644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96b3b6-48e4-45ea-989c-aa224c1ec3ef service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:03.321453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:03.357255 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35559f35-9419-4701-a8b0-6a37794780a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:03.358424 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35559f35-9419-4701-a8b0-6a37794780a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:03.358791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35559f35-9419-4701-a8b0-6a37794780a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:03.359145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35559f35-9419-4701-a8b0-6a37794780a9 admin admin] PATH_INFO: `/v3/users/5267f6660bda4604be658a859f41e118` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:03.360501 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35559f35-9419-4701-a8b0-6a37794780a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5267f6660bda4604be658a859f41e118)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:03.362820 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35559f35-9419-4701-a8b0-6a37794780a9 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:03.391290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:03.537161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-35559f35-9419-4701-a8b0-6a37794780a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5267f6660bda4604be658a859f41e118'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:03.537856 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-35559f35-9419-4701-a8b0-6a37794780a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5267f6660bda4604be658a859f41e118'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:03.538491 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-35559f35-9419-4701-a8b0-6a37794780a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5267f6660bda4604be658a859f41e118'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:03.555682 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-35559f35-9419-4701-a8b0-6a37794780a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5267f6660bda4604be658a859f41e118'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:03.564905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-35559f35-9419-4701-a8b0-6a37794780a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5267f6660bda4604be658a859f41e118'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:03.648366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1137/2269] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:49:03 2022] DELETE /identity/v3/users/5267f6660bda4604be658a859f41e118 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:04.139163 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:04.556729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:04.637410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:04.641305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:04.680334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92f5622-1767-4aaf-b2d1-6d57075edeff admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:04.783533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:04.784788 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:04.785220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:04.785654 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] PATH_INFO: `/v3/projects/aecb023043454cea89c839ee5503cb80` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:04.788946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=aecb023043454cea89c839ee5503cb80)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:04.791120 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:04.955657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aecb023043454cea89c839ee5503cb80', 'request_id': 'req-267cff54-02c0-4954-ae67-4b4277e5acdd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:05.037127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aecb023043454cea89c839ee5503cb80', 'request_id': 'req-267cff54-02c0-4954-ae67-4b4277e5acdd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:05.044539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aecb023043454cea89c839ee5503cb80', 'request_id': 'req-267cff54-02c0-4954-ae67-4b4277e5acdd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:05.056315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] The token cache is being invalidate because project aecb023043454cea89c839ee5503cb80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:49:05.056615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:05.057392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:05.059532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1133/2270] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:49:04 2022] DELETE /identity/v3/projects/aecb023043454cea89c839ee5503cb80 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:05.063705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35559f35-9419-4701-a8b0-6a37794780a9 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:05.065252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-35559f35-9419-4701-a8b0-6a37794780a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:05.077272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:05.081029 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35559f35-9419-4701-a8b0-6a37794780a9 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:05.146266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0432d76-38e9-4a9b-86e7-c7c2c0fd6a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:05.147428 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0432d76-38e9-4a9b-86e7-c7c2c0fd6a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:05.147722 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0432d76-38e9-4a9b-86e7-c7c2c0fd6a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:05.148004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0432d76-38e9-4a9b-86e7-c7c2c0fd6a49 admin admin] PATH_INFO: `/v3/users/33fbd1308c634be09dd4d177ab7547ed` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:05.149283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0432d76-38e9-4a9b-86e7-c7c2c0fd6a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fbd1308c634be09dd4d177ab7547ed)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:05.151312 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0432d76-38e9-4a9b-86e7-c7c2c0fd6a49 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:05.156518 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:05.286879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a0432d76-38e9-4a9b-86e7-c7c2c0fd6a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fbd1308c634be09dd4d177ab7547ed'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:05.287452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a0432d76-38e9-4a9b-86e7-c7c2c0fd6a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fbd1308c634be09dd4d177ab7547ed'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:05.288099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a0432d76-38e9-4a9b-86e7-c7c2c0fd6a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fbd1308c634be09dd4d177ab7547ed'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:05.300411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a0432d76-38e9-4a9b-86e7-c7c2c0fd6a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fbd1308c634be09dd4d177ab7547ed'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:05.311600 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a0432d76-38e9-4a9b-86e7-c7c2c0fd6a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fbd1308c634be09dd4d177ab7547ed'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:05.405416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1138/2271] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:49:05 2022] DELETE /identity/v3/users/33fbd1308c634be09dd4d177ab7547ed => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:05.741479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:05.860962 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:06.013157 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:06.015661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:06.031249 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cff54-02c0-4954-ae67-4b4277e5acdd admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:06.109915 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd9767-f219-473d-925a-3847adbe8955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:06.110783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd9767-f219-473d-925a-3847adbe8955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:06.111058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd9767-f219-473d-925a-3847adbe8955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:06.111327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd9767-f219-473d-925a-3847adbe8955 admin admin] PATH_INFO: `/v3/projects/f5b61e87ce63435c9eb6c7fc1375cf5b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:06.112626 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd9767-f219-473d-925a-3847adbe8955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5b61e87ce63435c9eb6c7fc1375cf5b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:06.114963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd9767-f219-473d-925a-3847adbe8955 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:06.235281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-80dd9767-f219-473d-925a-3847adbe8955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5b61e87ce63435c9eb6c7fc1375cf5b', 'request_id': 'req-80dd9767-f219-473d-925a-3847adbe8955'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:06.265064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:06.310065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-80dd9767-f219-473d-925a-3847adbe8955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5b61e87ce63435c9eb6c7fc1375cf5b', 'request_id': 'req-80dd9767-f219-473d-925a-3847adbe8955'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:06.317357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-80dd9767-f219-473d-925a-3847adbe8955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5b61e87ce63435c9eb6c7fc1375cf5b', 'request_id': 'req-80dd9767-f219-473d-925a-3847adbe8955'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:06.327878 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-80dd9767-f219-473d-925a-3847adbe8955 admin admin] The token cache is being invalidate because project f5b61e87ce63435c9eb6c7fc1375cf5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:49:06.328168 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-80dd9767-f219-473d-925a-3847adbe8955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:06.328861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-80dd9767-f219-473d-925a-3847adbe8955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:06.330468 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1134/2272] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:49:06 2022] DELETE /identity/v3/projects/f5b61e87ce63435c9eb6c7fc1375cf5b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:06.334106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:06.336338 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9359a05-c986-4fc5-a462-5d0c3d4151ec None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:06.336621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9359a05-c986-4fc5-a462-5d0c3d4151ec None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:06.336934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9359a05-c986-4fc5-a462-5d0c3d4151ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:06.358326 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a9359a05-c986-4fc5-a462-5d0c3d4151ec None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:06.359554 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a9359a05-c986-4fc5-a462-5d0c3d4151ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:06.422481 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1139/2273] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:06.432166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982cbb-fb09-4104-8ec8-d92ee8043aaf None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:06.432458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982cbb-fb09-4104-8ec8-d92ee8043aaf None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:06.432759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73982cbb-fb09-4104-8ec8-d92ee8043aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:06.452234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-73982cbb-fb09-4104-8ec8-d92ee8043aaf None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:06.453533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-73982cbb-fb09-4104-8ec8-d92ee8043aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:06.463362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1135/2274] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:06.467766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9359a05-c986-4fc5-a462-5d0c3d4151ec None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:06.479017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9359a05-c986-4fc5-a462-5d0c3d4151ec None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:06.483954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331b934-1f7a-4fc1-b819-e329ca384d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:06.484629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331b934-1f7a-4fc1-b819-e329ca384d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:06.484922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331b934-1f7a-4fc1-b819-e329ca384d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:06.487910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331b934-1f7a-4fc1-b819-e329ca384d41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:06.487910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331b934-1f7a-4fc1-b819-e329ca384d41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:49:06.487910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331b934-1f7a-4fc1-b819-e329ca384d41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:06.487910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331b934-1f7a-4fc1-b819-e329ca384d41 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:06.499931 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1140/2275] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:49:06.504197 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73982cbb-fb09-4104-8ec8-d92ee8043aaf None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:06.514609 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73982cbb-fb09-4104-8ec8-d92ee8043aaf None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:06.519315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a52e1-fdcd-4c72-bc4b-3665ec138b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:06.520664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a52e1-fdcd-4c72-bc4b-3665ec138b31 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:06.521125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a52e1-fdcd-4c72-bc4b-3665ec138b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:06.521125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a52e1-fdcd-4c72-bc4b-3665ec138b31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:06.522081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a52e1-fdcd-4c72-bc4b-3665ec138b31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:06.523999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097a52e1-fdcd-4c72-bc4b-3665ec138b31 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:06.667402 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1136/2276] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:49:06 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:49:06.671702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331b934-1f7a-4fc1-b819-e329ca384d41 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:06.681812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331b934-1f7a-4fc1-b819-e329ca384d41 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:06.739315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:06.740870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043853d4-a315-4b5f-9aa5-deaef8c92241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:06.741694 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043853d4-a315-4b5f-9aa5-deaef8c92241 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:06.742043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043853d4-a315-4b5f-9aa5-deaef8c92241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:06.742310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043853d4-a315-4b5f-9aa5-deaef8c92241 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:06.743031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043853d4-a315-4b5f-9aa5-deaef8c92241 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:06.745078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043853d4-a315-4b5f-9aa5-deaef8c92241 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:06.896730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1141/2277] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:49:06 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:49:06.899427 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a52e1-fdcd-4c72-bc4b-3665ec138b31 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:06.918732 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097a52e1-fdcd-4c72-bc4b-3665ec138b31 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:06.924448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2405b-c71f-404f-8ed3-bc0d04e3fbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:06.925244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2405b-c71f-404f-8ed3-bc0d04e3fbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:06.925616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2405b-c71f-404f-8ed3-bc0d04e3fbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:06.925997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2405b-c71f-404f-8ed3-bc0d04e3fbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:06.927568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2405b-c71f-404f-8ed3-bc0d04e3fbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:06.929276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2405b-c71f-404f-8ed3-bc0d04e3fbe7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:06.940498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1137/2278] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:49:06.945249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043853d4-a315-4b5f-9aa5-deaef8c92241 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:06.956545 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043853d4-a315-4b5f-9aa5-deaef8c92241 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:06.962348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6200e-f60a-4388-bda3-4cc7888276a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:06.963033 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6200e-f60a-4388-bda3-4cc7888276a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:06.963323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6200e-f60a-4388-bda3-4cc7888276a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:06.964062 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6200e-f60a-4388-bda3-4cc7888276a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:06.964348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6200e-f60a-4388-bda3-4cc7888276a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:06.966115 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d6200e-f60a-4388-bda3-4cc7888276a0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:06.974035 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:06.985681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1142/2279] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:49:06.989670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2405b-c71f-404f-8ed3-bc0d04e3fbe7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:07.001862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2405b-c71f-404f-8ed3-bc0d04e3fbe7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:07.030770 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f496a-3b70-407c-9801-06bb0adebf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:07.031724 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f496a-3b70-407c-9801-06bb0adebf9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:07.033184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:07.033652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f496a-3b70-407c-9801-06bb0adebf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:07.046284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f496a-3b70-407c-9801-06bb0adebf9d admin admin] PATH_INFO: `/v3/projects/399fd2fa613c4b2894ca288b89cfa868/users/932477935de24a98a0447b911e77d11f/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:07.063170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f496a-3b70-407c-9801-06bb0adebf9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=399fd2fa613c4b2894ca288b89cfa868, user_id=932477935de24a98a0447b911e77d11f, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:07.072730 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f496a-3b70-407c-9801-06bb0adebf9d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:07.168562 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1138/2280] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:49:06 2022] PUT /identity/v3/projects/399fd2fa613c4b2894ca288b89cfa868/users/932477935de24a98a0447b911e77d11f/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:49:07.180277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139837-83b2-4006-88b3-e18d055651e7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:07.180798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139837-83b2-4006-88b3-e18d055651e7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:07.181007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3139837-83b2-4006-88b3-e18d055651e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:07.212482 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e3139837-83b2-4006-88b3-e18d055651e7 None None] MFA Rules not processed for user `932477935de24a98a0447b911e77d11f`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:07.213711 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e3139837-83b2-4006-88b3-e18d055651e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:07.280056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1143/2281] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:49:07.292048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f496a-3b70-407c-9801-06bb0adebf9d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:07.293822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-781f496a-3b70-407c-9801-06bb0adebf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:07.344901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:07.353950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f496a-3b70-407c-9801-06bb0adebf9d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:07.357638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba063f-6e0b-45a9-a9f8-88354ff12adc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:07.358331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba063f-6e0b-45a9-a9f8-88354ff12adc service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:07.358615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba063f-6e0b-45a9-a9f8-88354ff12adc service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:07.358897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba063f-6e0b-45a9-a9f8-88354ff12adc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:07.367444 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba063f-6e0b-45a9-a9f8-88354ff12adc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:07.368882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba063f-6e0b-45a9-a9f8-88354ff12adc service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:07.377694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1139/2282] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:49:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:49:07.488309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:07.579030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:07.842404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:08.067057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:08.601458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:08.676291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:09.110303 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:09.179492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:09.374020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:09.442619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:09.898972 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:10.070473 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:10.116515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:10.293181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:10.310604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:10.447599 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:10.510780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3139837-83b2-4006-88b3-e18d055651e7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:10.522950 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:10.594888 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3139837-83b2-4006-88b3-e18d055651e7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:10.600178 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad3a40-25e3-421c-8b41-c3ee7a558393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:10.601068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad3a40-25e3-421c-8b41-c3ee7a558393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:10.601349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad3a40-25e3-421c-8b41-c3ee7a558393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:10.601624 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad3a40-25e3-421c-8b41-c3ee7a558393 admin admin] PATH_INFO: `/v3/users/932477935de24a98a0447b911e77d11f` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:10.603007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad3a40-25e3-421c-8b41-c3ee7a558393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932477935de24a98a0447b911e77d11f)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:10.604954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad3a40-25e3-421c-8b41-c3ee7a558393 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:10.687716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:10.852858 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e5ad3a40-25e3-421c-8b41-c3ee7a558393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932477935de24a98a0447b911e77d11f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:10.853541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e5ad3a40-25e3-421c-8b41-c3ee7a558393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932477935de24a98a0447b911e77d11f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:10.854362 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e5ad3a40-25e3-421c-8b41-c3ee7a558393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932477935de24a98a0447b911e77d11f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:10.871004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e5ad3a40-25e3-421c-8b41-c3ee7a558393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932477935de24a98a0447b911e77d11f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:10.878337 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-e5ad3a40-25e3-421c-8b41-c3ee7a558393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932477935de24a98a0447b911e77d11f'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:10.904774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:10.967060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1144/2283] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:49:10 2022] DELETE /identity/v3/users/932477935de24a98a0447b911e77d11f => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:10.971659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063065-261e-4b27-b35d-cba03b76771f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:10.971949 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063065-261e-4b27-b35d-cba03b76771f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:10.972436 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4063065-261e-4b27-b35d-cba03b76771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:10.991171 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c4063065-261e-4b27-b35d-cba03b76771f None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:10.992512 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c4063065-261e-4b27-b35d-cba03b76771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:11.003210 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:11.053368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1140/2284] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:11.062998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad3a40-25e3-421c-8b41-c3ee7a558393 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:11.064541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e5ad3a40-25e3-421c-8b41-c3ee7a558393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:11.124603 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad3a40-25e3-421c-8b41-c3ee7a558393 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:11.128806 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f155b33-2d76-4281-8144-895b2e045981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:11.129461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f155b33-2d76-4281-8144-895b2e045981 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:11.130363 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f155b33-2d76-4281-8144-895b2e045981 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:11.135502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f155b33-2d76-4281-8144-895b2e045981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:11.140280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f155b33-2d76-4281-8144-895b2e045981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:11.141713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f155b33-2d76-4281-8144-895b2e045981 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:11.152311 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1145/2285] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:49:11.453770 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:11.523595 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:11.649530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4063065-261e-4b27-b35d-cba03b76771f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:11.651127 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c4063065-261e-4b27-b35d-cba03b76771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:11.666643 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4063065-261e-4b27-b35d-cba03b76771f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:11.673347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99af8de-3f9b-4d88-9f93-00027c2951b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:11.674434 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99af8de-3f9b-4d88-9f93-00027c2951b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:11.674956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99af8de-3f9b-4d88-9f93-00027c2951b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:11.675237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99af8de-3f9b-4d88-9f93-00027c2951b3 admin admin] PATH_INFO: `/v3/projects/399fd2fa613c4b2894ca288b89cfa868` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:11.677259 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99af8de-3f9b-4d88-9f93-00027c2951b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=399fd2fa613c4b2894ca288b89cfa868)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:11.680073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99af8de-3f9b-4d88-9f93-00027c2951b3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:11.854698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d99af8de-3f9b-4d88-9f93-00027c2951b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '399fd2fa613c4b2894ca288b89cfa868', 'request_id': 'req-d99af8de-3f9b-4d88-9f93-00027c2951b3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:11.934589 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d99af8de-3f9b-4d88-9f93-00027c2951b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '399fd2fa613c4b2894ca288b89cfa868', 'request_id': 'req-d99af8de-3f9b-4d88-9f93-00027c2951b3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:11.943900 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d99af8de-3f9b-4d88-9f93-00027c2951b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '399fd2fa613c4b2894ca288b89cfa868', 'request_id': 'req-d99af8de-3f9b-4d88-9f93-00027c2951b3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:11.957622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d99af8de-3f9b-4d88-9f93-00027c2951b3 admin admin] The token cache is being invalidate because project 399fd2fa613c4b2894ca288b89cfa868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:49:11.958151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d99af8de-3f9b-4d88-9f93-00027c2951b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:11.958898 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d99af8de-3f9b-4d88-9f93-00027c2951b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:11.961662 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1141/2286] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:49:11 2022] DELETE /identity/v3/projects/399fd2fa613c4b2894ca288b89cfa868 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:11.967045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6926c4-4396-4f81-978a-88e3ed61eb69 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:11.967382 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6926c4-4396-4f81-978a-88e3ed61eb69 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:11.967763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6926c4-4396-4f81-978a-88e3ed61eb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:11.989256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-df6926c4-4396-4f81-978a-88e3ed61eb69 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:11.990553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-df6926c4-4396-4f81-978a-88e3ed61eb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:12.087781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1146/2287] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:12.095447 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7003a-916b-4666-81a9-adb96b7ea93d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:12.095817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7003a-916b-4666-81a9-adb96b7ea93d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:12.096180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7003a-916b-4666-81a9-adb96b7ea93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:12.100619 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:12.120085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d7e7003a-916b-4666-81a9-adb96b7ea93d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:12.121527 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d7e7003a-916b-4666-81a9-adb96b7ea93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:12.133106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1142/2288] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:12.136014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6926c4-4396-4f81-978a-88e3ed61eb69 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:12.148076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6926c4-4396-4f81-978a-88e3ed61eb69 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:12.153039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e36efd-6c1c-450e-a872-0c49f3d20b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:12.153933 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e36efd-6c1c-450e-a872-0c49f3d20b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:12.154318 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e36efd-6c1c-450e-a872-0c49f3d20b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:12.154663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e36efd-6c1c-450e-a872-0c49f3d20b0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:12.155508 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e36efd-6c1c-450e-a872-0c49f3d20b0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:49:12.155896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e36efd-6c1c-450e-a872-0c49f3d20b0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:12.157879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e36efd-6c1c-450e-a872-0c49f3d20b0d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:12.171250 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1147/2289] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:49:12.175495 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7003a-916b-4666-81a9-adb96b7ea93d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:12.200630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7003a-916b-4666-81a9-adb96b7ea93d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:12.206847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371a442-15ab-4128-8c01-51f6bfded6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:12.207623 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371a442-15ab-4128-8c01-51f6bfded6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:12.208116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371a442-15ab-4128-8c01-51f6bfded6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:12.208399 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371a442-15ab-4128-8c01-51f6bfded6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:12.209236 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371a442-15ab-4128-8c01-51f6bfded6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:12.214704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371a442-15ab-4128-8c01-51f6bfded6f7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:12.321604 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1143/2290] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:49:12 2022] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:49:12.326572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e36efd-6c1c-450e-a872-0c49f3d20b0d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:12.342795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e36efd-6c1c-450e-a872-0c49f3d20b0d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:12.373917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:12.416586 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a7082-3c80-476d-ade4-e3f9efd81620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:12.417278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a7082-3c80-476d-ade4-e3f9efd81620 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:12.417566 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a7082-3c80-476d-ade4-e3f9efd81620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:12.417888 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a7082-3c80-476d-ade4-e3f9efd81620 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:12.418612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a7082-3c80-476d-ade4-e3f9efd81620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:12.420580 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a7082-3c80-476d-ade4-e3f9efd81620 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:12.513707 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1148/2291] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:49:12 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:49:12.515001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371a442-15ab-4128-8c01-51f6bfded6f7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:12.525850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371a442-15ab-4128-8c01-51f6bfded6f7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:12.530863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e674f9a-b26e-4c7c-a948-643eb91ce4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:12.531550 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674f9a-b26e-4c7c-a948-643eb91ce4fb admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:12.531881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674f9a-b26e-4c7c-a948-643eb91ce4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:12.532869 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e674f9a-b26e-4c7c-a948-643eb91ce4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:12.533821 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e674f9a-b26e-4c7c-a948-643eb91ce4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:12.535454 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e674f9a-b26e-4c7c-a948-643eb91ce4fb admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:12.547418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1144/2292] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:49:12.551478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a7082-3c80-476d-ade4-e3f9efd81620 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:12.562128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a7082-3c80-476d-ade4-e3f9efd81620 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:12.567123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950fb73-8e62-4ae5-9460-b72e183ebd1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:12.567891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950fb73-8e62-4ae5-9460-b72e183ebd1f admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:12.568239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950fb73-8e62-4ae5-9460-b72e183ebd1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:12.568581 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950fb73-8e62-4ae5-9460-b72e183ebd1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:12.569495 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950fb73-8e62-4ae5-9460-b72e183ebd1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:12.571225 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950fb73-8e62-4ae5-9460-b72e183ebd1f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:12.581374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1149/2293] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:49:12.586261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e674f9a-b26e-4c7c-a948-643eb91ce4fb admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:12.596455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e674f9a-b26e-4c7c-a948-643eb91ce4fb admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:12.602334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98346341-be02-47d2-81d1-d7d9caf0ef42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:12.605745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98346341-be02-47d2-81d1-d7d9caf0ef42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:12.605745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98346341-be02-47d2-81d1-d7d9caf0ef42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:12.605745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98346341-be02-47d2-81d1-d7d9caf0ef42 admin admin] PATH_INFO: `/v3/projects/88f5b8dec52244dea1c8cd256cf0b805/users/2025deb3a9534995a3148f7662211873/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:12.620963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98346341-be02-47d2-81d1-d7d9caf0ef42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88f5b8dec52244dea1c8cd256cf0b805, user_id=2025deb3a9534995a3148f7662211873, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:12.624089 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98346341-be02-47d2-81d1-d7d9caf0ef42 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:12.693348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1145/2294] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:49:12 2022] PUT /identity/v3/projects/88f5b8dec52244dea1c8cd256cf0b805/users/2025deb3a9534995a3148f7662211873/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:12.704708 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ded91-f466-4e44-8ba7-55adac40aabb None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:12.705008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ded91-f466-4e44-8ba7-55adac40aabb None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:12.705374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ded91-f466-4e44-8ba7-55adac40aabb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:12.734112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-973ded91-f466-4e44-8ba7-55adac40aabb None None] MFA Rules not processed for user `2025deb3a9534995a3148f7662211873`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:12.735378 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-973ded91-f466-4e44-8ba7-55adac40aabb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:12.800572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1150/2295] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:12.817702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98346341-be02-47d2-81d1-d7d9caf0ef42 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:12.817702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-98346341-be02-47d2-81d1-d7d9caf0ef42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:12.871695 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98346341-be02-47d2-81d1-d7d9caf0ef42 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:12.875635 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d4ad8-92ca-48a5-98c0-2223410d4564 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669a11ce83b746eeb7f4e7d0acca4b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:12.876322 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4ad8-92ca-48a5-98c0-2223410d4564 service glance] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:12.876621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4ad8-92ca-48a5-98c0-2223410d4564 service glance] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:12.876894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d4ad8-92ca-48a5-98c0-2223410d4564 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:12.886779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d4ad8-92ca-48a5-98c0-2223410d4564 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:12.888201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d4ad8-92ca-48a5-98c0-2223410d4564 service glance] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:12.897954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1146/2296] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:49:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:49:12.961350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:13.079424 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:13.847226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:14.115925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:14.641471 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:15.110310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:15.916238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:15.950518 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953b1f0-6ef2-46d8-998f-17d4aa26e96e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:15.951176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953b1f0-6ef2-46d8-998f-17d4aa26e96e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:15.951845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953b1f0-6ef2-46d8-998f-17d4aa26e96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:15.975468 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4953b1f0-6ef2-46d8-998f-17d4aa26e96e None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:15.977360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4953b1f0-6ef2-46d8-998f-17d4aa26e96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:16.056431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1151/2297] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:49:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:16.113148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d4ad8-92ca-48a5-98c0-2223410d4564 service glance] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:16.116113 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-114d4ad8-92ca-48a5-98c0-2223410d4564 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:16.215376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d4ad8-92ca-48a5-98c0-2223410d4564 service glance] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:16.220382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d3200-5704-4c55-ab74-48297fdc861e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:16.221028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d3200-5704-4c55-ab74-48297fdc861e service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:16.221307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d3200-5704-4c55-ab74-48297fdc861e service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:16.221612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d3200-5704-4c55-ab74-48297fdc861e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:16.232076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d3200-5704-4c55-ab74-48297fdc861e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:16.233653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4d3200-5704-4c55-ab74-48297fdc861e service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:16.242420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1147/2298] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:49:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:49:16.910896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:16.968537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d98dac-0315-457b-8812-206dfac4102f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:16.969251 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d98dac-0315-457b-8812-206dfac4102f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:16.969374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d98dac-0315-457b-8812-206dfac4102f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:16.989604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-71d98dac-0315-457b-8812-206dfac4102f None None] MFA Rules not processed for user `26ef0b53b0254e3a96490839cd4dd85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:16.991042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-71d98dac-0315-457b-8812-206dfac4102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:17.164313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1152/2299] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:17.898857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:18.544300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:18.984605 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:19.156215 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:20.212806 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:29.148448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf9977-9785-495d-a791-3144369a7354 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:29.149030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf9977-9785-495d-a791-3144369a7354 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:29.149030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf9977-9785-495d-a791-3144369a7354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:29.170150 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c7cf9977-9785-495d-a791-3144369a7354 None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:29.171759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c7cf9977-9785-495d-a791-3144369a7354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:29.180423 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1148/2300] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:49:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:29.219725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d98dac-0315-457b-8812-206dfac4102f None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:29.246123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d98dac-0315-457b-8812-206dfac4102f None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:29.251688 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd22b2-73e1-4b39-b3aa-308bdf648846 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:29.258789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd22b2-73e1-4b39-b3aa-308bdf648846 service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:29.258789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd22b2-73e1-4b39-b3aa-308bdf648846 service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:29.258789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd22b2-73e1-4b39-b3aa-308bdf648846 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:29.262284 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd22b2-73e1-4b39-b3aa-308bdf648846 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:29.263912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd22b2-73e1-4b39-b3aa-308bdf648846 service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:29.274043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1153/2301] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:49:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:49:31.688275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf9977-9785-495d-a791-3144369a7354 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:31.690819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c7cf9977-9785-495d-a791-3144369a7354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:31.795104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf9977-9785-495d-a791-3144369a7354 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:31.801970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c522ee-2ae6-416f-a9ef-ea38231d3a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:31.802969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c522ee-2ae6-416f-a9ef-ea38231d3a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:31.803255 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c522ee-2ae6-416f-a9ef-ea38231d3a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:31.803615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c522ee-2ae6-416f-a9ef-ea38231d3a1e admin admin] PATH_INFO: `/v3/users/dc8fc6f390d246e7967d81fba223d2de` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:31.804908 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c522ee-2ae6-416f-a9ef-ea38231d3a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc8fc6f390d246e7967d81fba223d2de)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:31.807025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c522ee-2ae6-416f-a9ef-ea38231d3a1e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:31.851345 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:31.997870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-25c522ee-2ae6-416f-a9ef-ea38231d3a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc8fc6f390d246e7967d81fba223d2de'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:32.075066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-25c522ee-2ae6-416f-a9ef-ea38231d3a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc8fc6f390d246e7967d81fba223d2de'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:32.075944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-25c522ee-2ae6-416f-a9ef-ea38231d3a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc8fc6f390d246e7967d81fba223d2de'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:32.085680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-25c522ee-2ae6-416f-a9ef-ea38231d3a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc8fc6f390d246e7967d81fba223d2de'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:32.086492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-25c522ee-2ae6-416f-a9ef-ea38231d3a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc8fc6f390d246e7967d81fba223d2de'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:32.106759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1149/2302] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:49:31 2022] DELETE /identity/v3/users/dc8fc6f390d246e7967d81fba223d2de => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:32.112051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42796eb9-b879-4206-8cc9-bdef2e878750 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:32.112932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42796eb9-b879-4206-8cc9-bdef2e878750 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:32.113215 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42796eb9-b879-4206-8cc9-bdef2e878750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:32.135615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-42796eb9-b879-4206-8cc9-bdef2e878750 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:32.137302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-42796eb9-b879-4206-8cc9-bdef2e878750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:32.204433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1154/2303] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:49:32.215610 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c522ee-2ae6-416f-a9ef-ea38231d3a1e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:32.219438 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-25c522ee-2ae6-416f-a9ef-ea38231d3a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:32.297770 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c522ee-2ae6-416f-a9ef-ea38231d3a1e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:32.301555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56305e-a5db-4ee9-bf41-fca932c20190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:32.302366 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56305e-a5db-4ee9-bf41-fca932c20190 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:32.306492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56305e-a5db-4ee9-bf41-fca932c20190 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:32.306492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56305e-a5db-4ee9-bf41-fca932c20190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:32.312851 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56305e-a5db-4ee9-bf41-fca932c20190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:32.314637 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56305e-a5db-4ee9-bf41-fca932c20190 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:32.325905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1150/2304] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:49:32.849053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42796eb9-b879-4206-8cc9-bdef2e878750 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:32.851028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-42796eb9-b879-4206-8cc9-bdef2e878750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:32.871198 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42796eb9-b879-4206-8cc9-bdef2e878750 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:32.881431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:32.882647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:32.883754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:32.884228 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958 admin admin] PATH_INFO: `/v3/projects/f95ac71c38f147a7a6f5b4a3abcc3971` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:32.886611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95ac71c38f147a7a6f5b4a3abcc3971)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:32.888638 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:33.061612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95ac71c38f147a7a6f5b4a3abcc3971', 'request_id': 'req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:33.115421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95ac71c38f147a7a6f5b4a3abcc3971', 'request_id': 'req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:33.125173 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95ac71c38f147a7a6f5b4a3abcc3971', 'request_id': 'req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:33.163094 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958 admin admin] The token cache is being invalidate because project f95ac71c38f147a7a6f5b4a3abcc3971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:49:33.163401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:33.164278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-4c9aa9d5-6105-47e2-8ba7-f9ffae63e958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:33.168398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1155/2305] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:49:32 2022] DELETE /identity/v3/projects/f95ac71c38f147a7a6f5b4a3abcc3971 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:33.173297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc941c-b04d-4384-bc67-20e68505ece0 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:33.174986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc941c-b04d-4384-bc67-20e68505ece0 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:33.175629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc941c-b04d-4384-bc67-20e68505ece0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:33.198671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c3dc941c-b04d-4384-bc67-20e68505ece0 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:33.200109 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c3dc941c-b04d-4384-bc67-20e68505ece0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:33.287429 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1151/2306] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:33.295277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d654a-e4c5-4956-95c6-97da55c86eac None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:33.295572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d654a-e4c5-4956-95c6-97da55c86eac None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:33.295860 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d654a-e4c5-4956-95c6-97da55c86eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:33.338259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f82d654a-e4c5-4956-95c6-97da55c86eac None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:33.347406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f82d654a-e4c5-4956-95c6-97da55c86eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:33.362033 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1156/2307] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:49:33.366180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc941c-b04d-4384-bc67-20e68505ece0 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:33.376448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc941c-b04d-4384-bc67-20e68505ece0 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:33.390113 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccc132-db5c-444d-9a1d-1d758e430941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:33.390799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccc132-db5c-444d-9a1d-1d758e430941 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:33.391419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccc132-db5c-444d-9a1d-1d758e430941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:33.391716 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccc132-db5c-444d-9a1d-1d758e430941 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:33.396661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccc132-db5c-444d-9a1d-1d758e430941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:49:33.397075 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccc132-db5c-444d-9a1d-1d758e430941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:33.399407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccc132-db5c-444d-9a1d-1d758e430941 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:33.416502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1152/2308] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:49:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:49:33.417669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d654a-e4c5-4956-95c6-97da55c86eac None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:33.432911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d654a-e4c5-4956-95c6-97da55c86eac None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:33.438352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870085b-b50c-45fa-9281-2a11cffdf9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:33.439301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870085b-b50c-45fa-9281-2a11cffdf9ba admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:33.439524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870085b-b50c-45fa-9281-2a11cffdf9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:33.439805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870085b-b50c-45fa-9281-2a11cffdf9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:33.440835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870085b-b50c-45fa-9281-2a11cffdf9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:33.444407 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870085b-b50c-45fa-9281-2a11cffdf9ba admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:33.449227 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:33.557011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1157/2309] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:49:33 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:49:33.561361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccc132-db5c-444d-9a1d-1d758e430941 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:33.580269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccc132-db5c-444d-9a1d-1d758e430941 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:33.660510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:33.710841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4f215-b6a1-4dec-b295-8da6be981345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:33.728636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f215-b6a1-4dec-b295-8da6be981345 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:33.728636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f215-b6a1-4dec-b295-8da6be981345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:33.728636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4f215-b6a1-4dec-b295-8da6be981345 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:33.728636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4f215-b6a1-4dec-b295-8da6be981345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:33.728636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4f215-b6a1-4dec-b295-8da6be981345 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:33.847449 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1153/2310] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:49:33 2022] POST /identity/v3/users => generated 287 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:49:33.852425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870085b-b50c-45fa-9281-2a11cffdf9ba admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:33.867876 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870085b-b50c-45fa-9281-2a11cffdf9ba admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:33.878963 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15011ab2-587d-444e-a80d-8e23cd94635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:33.882313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15011ab2-587d-444e-a80d-8e23cd94635a admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:33.882313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15011ab2-587d-444e-a80d-8e23cd94635a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:33.888906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15011ab2-587d-444e-a80d-8e23cd94635a admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:33.888906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15011ab2-587d-444e-a80d-8e23cd94635a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:33.888906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15011ab2-587d-444e-a80d-8e23cd94635a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:33.907332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1158/2311] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:49:33.912172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4f215-b6a1-4dec-b295-8da6be981345 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:33.936629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4f215-b6a1-4dec-b295-8da6be981345 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:33.950216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b308b-fbdc-486e-b0e7-9df561753137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:33.950907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b308b-fbdc-486e-b0e7-9df561753137 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:33.951194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b308b-fbdc-486e-b0e7-9df561753137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:33.951474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b308b-fbdc-486e-b0e7-9df561753137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:33.952235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b308b-fbdc-486e-b0e7-9df561753137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:33.953914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b308b-fbdc-486e-b0e7-9df561753137 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:33.965802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1154/2312] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:49:33 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:49:33.969625 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15011ab2-587d-444e-a80d-8e23cd94635a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:33.981812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15011ab2-587d-444e-a80d-8e23cd94635a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:33.990643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2db42-7411-4954-8593-bd8040152046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:33.991375 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2db42-7411-4954-8593-bd8040152046 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:33.992139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2db42-7411-4954-8593-bd8040152046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:33.992139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2db42-7411-4954-8593-bd8040152046 admin admin] PATH_INFO: `/v3/projects/fee872ff9c504e12a106c0ad30219d8e/users/4c1f857fbece4795a1f363022c40f549/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:34.014390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2db42-7411-4954-8593-bd8040152046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fee872ff9c504e12a106c0ad30219d8e, user_id=4c1f857fbece4795a1f363022c40f549, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:34.019918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2db42-7411-4954-8593-bd8040152046 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:34.137334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1159/2313] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:49:33 2022] PUT /identity/v3/projects/fee872ff9c504e12a106c0ad30219d8e/users/4c1f857fbece4795a1f363022c40f549/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:49:34.139503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72274f8-c68f-41c5-b833-a14e9a25cca6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:34.139877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72274f8-c68f-41c5-b833-a14e9a25cca6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:34.140211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72274f8-c68f-41c5-b833-a14e9a25cca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:34.209514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e72274f8-c68f-41c5-b833-a14e9a25cca6 None None] MFA Rules not processed for user `4c1f857fbece4795a1f363022c40f549`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:34.217078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e72274f8-c68f-41c5-b833-a14e9a25cca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:34.350003 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1155/2314] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:34.361714 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2db42-7411-4954-8593-bd8040152046 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:34.363664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dae2db42-7411-4954-8593-bd8040152046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:34.537059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2db42-7411-4954-8593-bd8040152046 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:34.543955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942404f-61ac-48b9-ac10-773d37d14fc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:34.545530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942404f-61ac-48b9-ac10-773d37d14fc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:34.546263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942404f-61ac-48b9-ac10-773d37d14fc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:34.546610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942404f-61ac-48b9-ac10-773d37d14fc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:34.559032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942404f-61ac-48b9-ac10-773d37d14fc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:34.561300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942404f-61ac-48b9-ac10-773d37d14fc2 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:34.576435 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1160/2315] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:49:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:49:35.627570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946429f-726a-4b1a-8f56-489618d1bdb9 None None] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:35.628300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946429f-726a-4b1a-8f56-489618d1bdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:35.628300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c946429f-726a-4b1a-8f56-489618d1bdb9 None None] PATH_INFO: `/` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:35.630655 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1156/2316] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 20 22:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:49:35.792366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3382ef-5fe8-4e84-8cae-bf20e7dfad62 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:35.794324 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3382ef-5fe8-4e84-8cae-bf20e7dfad62 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:35.806042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3382ef-5fe8-4e84-8cae-bf20e7dfad62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:35.863645 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bd3382ef-5fe8-4e84-8cae-bf20e7dfad62 None None] MFA Rules not processed for user `67c92c8d2b9d41e489e4c03ae4e71fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:35.866181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bd3382ef-5fe8-4e84-8cae-bf20e7dfad62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:36.056621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1161/2317] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 20 22:49:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:49:36.074313 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946429f-726a-4b1a-8f56-489618d1bdb9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:36.076948 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c946429f-726a-4b1a-8f56-489618d1bdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:36.171003 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c946429f-726a-4b1a-8f56-489618d1bdb9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:36.175609 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d57b4e-e75e-4c5f-89d4-465ead0a9462 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669a11ce83b746eeb7f4e7d0acca4b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:36.176415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d57b4e-e75e-4c5f-89d4-465ead0a9462 service glance] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:36.177389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d57b4e-e75e-4c5f-89d4-465ead0a9462 service glance] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:36.178245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d57b4e-e75e-4c5f-89d4-465ead0a9462 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:36.196270 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d57b4e-e75e-4c5f-89d4-465ead0a9462 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:36.197791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d57b4e-e75e-4c5f-89d4-465ead0a9462 service glance] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:36.217313 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1157/2318] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:49:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:49:36.523023 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02855cd-a6da-4fa9-9080-418af8034171 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:36.523609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02855cd-a6da-4fa9-9080-418af8034171 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:36.524109 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02855cd-a6da-4fa9-9080-418af8034171 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:36.527279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1162/2319] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 20 22:49:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:49:36.542363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3035f-768c-43ce-8da5-632d336f1b54 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:36.543025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3035f-768c-43ce-8da5-632d336f1b54 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:36.543520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3035f-768c-43ce-8da5-632d336f1b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:36.574480 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-19e3035f-768c-43ce-8da5-632d336f1b54 None None] MFA Rules not processed for user `d3faac5703c54396bcdba9e149a6d35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:36.576092 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-19e3035f-768c-43ce-8da5-632d336f1b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:36.636628 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:36.669709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1158/2320] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 20 22:49:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:49:36.683684 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02855cd-a6da-4fa9-9080-418af8034171 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:36.687468 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c02855cd-a6da-4fa9-9080-418af8034171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:36.700761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3035f-768c-43ce-8da5-632d336f1b54 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:36.704435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-19e3035f-768c-43ce-8da5-632d336f1b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:36.739894 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02855cd-a6da-4fa9-9080-418af8034171 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:36.746588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f845b5e-4fd7-4ca0-8a7a-59a004ea0d7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:36.747888 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f845b5e-4fd7-4ca0-8a7a-59a004ea0d7f service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:36.748185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f845b5e-4fd7-4ca0-8a7a-59a004ea0d7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:36.749508 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f845b5e-4fd7-4ca0-8a7a-59a004ea0d7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:36.764113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f845b5e-4fd7-4ca0-8a7a-59a004ea0d7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:36.767431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f845b5e-4fd7-4ca0-8a7a-59a004ea0d7f service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:36.778729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1163/2321] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:49:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:49:36.844359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3035f-768c-43ce-8da5-632d336f1b54 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:36.850716 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace88817-2ea6-4566-a9b4-243b6ba7598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:36.851619 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace88817-2ea6-4566-a9b4-243b6ba7598d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:36.852223 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace88817-2ea6-4566-a9b4-243b6ba7598d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:36.852522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace88817-2ea6-4566-a9b4-243b6ba7598d admin admin] PATH_INFO: `/v3/users/603b5c82602343a4975b065917058cd5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:36.854031 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace88817-2ea6-4566-a9b4-243b6ba7598d admin admin] RBAC: Authorizing `identity:delete_user(user_id=603b5c82602343a4975b065917058cd5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:36.862950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace88817-2ea6-4566-a9b4-243b6ba7598d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:36.923681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7284f-c388-43d0-a3cf-fb61e0c21879 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:36.925503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7284f-c388-43d0-a3cf-fb61e0c21879 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:36.925503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7284f-c388-43d0-a3cf-fb61e0c21879 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:36.926165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1164/2322] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 20 22:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:49:36.932677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccb128-1f0f-4a71-84ff-46473e268d49 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:36.933199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccb128-1f0f-4a71-84ff-46473e268d49 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:36.933748 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ccb128-1f0f-4a71-84ff-46473e268d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:36.967108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-11ccb128-1f0f-4a71-84ff-46473e268d49 None None] MFA Rules not processed for user `67c92c8d2b9d41e489e4c03ae4e71fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:36.970586 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-11ccb128-1f0f-4a71-84ff-46473e268d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:36.993708 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1165/2323] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 20 22:49:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:37.008788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccb128-1f0f-4a71-84ff-46473e268d49 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:37.038651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ccb128-1f0f-4a71-84ff-46473e268d49 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:37.045458 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55ff93-f5ef-410f-affb-49f583ee8b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:37.046530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ff93-f5ef-410f-affb-49f583ee8b21 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:37.046802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ff93-f5ef-410f-affb-49f583ee8b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:37.047232 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55ff93-f5ef-410f-affb-49f583ee8b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:37.075243 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55ff93-f5ef-410f-affb-49f583ee8b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:37.076979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55ff93-f5ef-410f-affb-49f583ee8b21 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:37.095819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1166/2324] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:49:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:49:37.166336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ace88817-2ea6-4566-a9b4-243b6ba7598d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '603b5c82602343a4975b065917058cd5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:37.242081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ace88817-2ea6-4566-a9b4-243b6ba7598d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '603b5c82602343a4975b065917058cd5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:37.244684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ace88817-2ea6-4566-a9b4-243b6ba7598d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '603b5c82602343a4975b065917058cd5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:37.260941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ace88817-2ea6-4566-a9b4-243b6ba7598d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '603b5c82602343a4975b065917058cd5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:37.262126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ace88817-2ea6-4566-a9b4-243b6ba7598d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '603b5c82602343a4975b065917058cd5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:37.308228 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1159/2325] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:49:36 2022] DELETE /identity/v3/users/603b5c82602343a4975b065917058cd5 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:37.711252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb65b0-76aa-47c5-81c9-1ea81d033a93 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:37.711615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb65b0-76aa-47c5-81c9-1ea81d033a93 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:37.711830 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb65b0-76aa-47c5-81c9-1ea81d033a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:37.738358 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-67fb65b0-76aa-47c5-81c9-1ea81d033a93 None None] MFA Rules not processed for user `4c1f857fbece4795a1f363022c40f549`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:37.740459 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-67fb65b0-76aa-47c5-81c9-1ea81d033a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:37.759706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:37.834081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace88817-2ea6-4566-a9b4-243b6ba7598d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:37.835207 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ace88817-2ea6-4566-a9b4-243b6ba7598d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:37.847331 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1167/2326] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:37.947294 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace88817-2ea6-4566-a9b4-243b6ba7598d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:37.953262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:37.954586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:37.954876 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:37.955286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] PATH_INFO: `/v3/projects/582f0ea88f8948808f78f31934eac393` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:37.956845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] RBAC: Authorizing `identity:delete_project(project_id=582f0ea88f8948808f78f31934eac393)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:37.959676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:37.983210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:38.150297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '582f0ea88f8948808f78f31934eac393', 'request_id': 'req-2179d227-e336-4698-b7b8-92b8d9f8659a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:38.225080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '582f0ea88f8948808f78f31934eac393', 'request_id': 'req-2179d227-e336-4698-b7b8-92b8d9f8659a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:38.232824 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '582f0ea88f8948808f78f31934eac393', 'request_id': 'req-2179d227-e336-4698-b7b8-92b8d9f8659a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:38.249868 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] The token cache is being invalidate because project 582f0ea88f8948808f78f31934eac393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:49:38.250194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:38.251095 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:38.252797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1160/2327] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:49:37 2022] DELETE /identity/v3/projects/582f0ea88f8948808f78f31934eac393 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:49:38.257401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb65b0-76aa-47c5-81c9-1ea81d033a93 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:38.273630 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb65b0-76aa-47c5-81c9-1ea81d033a93 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:38.389538 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d72716-2d15-405b-b19c-23f099af0485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:38.390725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d72716-2d15-405b-b19c-23f099af0485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:38.392945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d72716-2d15-405b-b19c-23f099af0485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:38.392945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d72716-2d15-405b-b19c-23f099af0485 admin admin] PATH_INFO: `/v3/users/37d02c424b2e4f2fb1bd2e42419e9ba0` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:38.392945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d72716-2d15-405b-b19c-23f099af0485 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d02c424b2e4f2fb1bd2e42419e9ba0)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:38.394973 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d72716-2d15-405b-b19c-23f099af0485 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:38.658495 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-71d72716-2d15-405b-b19c-23f099af0485 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d02c424b2e4f2fb1bd2e42419e9ba0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:38.659252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-71d72716-2d15-405b-b19c-23f099af0485 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d02c424b2e4f2fb1bd2e42419e9ba0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:38.663231 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-71d72716-2d15-405b-b19c-23f099af0485 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d02c424b2e4f2fb1bd2e42419e9ba0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:38.685809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-71d72716-2d15-405b-b19c-23f099af0485 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d02c424b2e4f2fb1bd2e42419e9ba0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:38.715838 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-71d72716-2d15-405b-b19c-23f099af0485 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d02c424b2e4f2fb1bd2e42419e9ba0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:38.824342 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1168/2328] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:49:38 2022] DELETE /identity/v3/users/37d02c424b2e4f2fb1bd2e42419e9ba0 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:39.190999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:39.193114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:39.222693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179d227-e336-4698-b7b8-92b8d9f8659a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:39.349676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:39.352213 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:39.352572 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:39.352934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] PATH_INFO: `/v3/projects/60e26bc44577472c98320b427a6c44d5` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:39.354652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=60e26bc44577472c98320b427a6c44d5)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:39.357692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:39.512385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60e26bc44577472c98320b427a6c44d5', 'request_id': 'req-395e4aca-5e6a-430b-af41-c4728df11d5e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:39.589544 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60e26bc44577472c98320b427a6c44d5', 'request_id': 'req-395e4aca-5e6a-430b-af41-c4728df11d5e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:39.597873 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60e26bc44577472c98320b427a6c44d5', 'request_id': 'req-395e4aca-5e6a-430b-af41-c4728df11d5e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:39.610363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] The token cache is being invalidate because project 60e26bc44577472c98320b427a6c44d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:49:39.610755 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:39.611439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:39.613469 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1161/2329] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:49:39 2022] DELETE /identity/v3/projects/60e26bc44577472c98320b427a6c44d5 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:43.208533 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84543b5-2311-441b-bcdd-19dd4bb38f99 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:43.209310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84543b5-2311-441b-bcdd-19dd4bb38f99 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:43.209310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84543b5-2311-441b-bcdd-19dd4bb38f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:43.229042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a84543b5-2311-441b-bcdd-19dd4bb38f99 None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:43.230515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a84543b5-2311-441b-bcdd-19dd4bb38f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:43.275365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:43.308136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1169/2330] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:49:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:43.321905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:43.324032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:43.366394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:43.450547 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e4aca-5e6a-430b-af41-c4728df11d5e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:43.455032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4085bf7-fcd4-43c7-9233-e0d9ee7081c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:43.455977 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4085bf7-fcd4-43c7-9233-e0d9ee7081c3 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:43.456464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4085bf7-fcd4-43c7-9233-e0d9ee7081c3 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:43.456925 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4085bf7-fcd4-43c7-9233-e0d9ee7081c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:43.491311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4085bf7-fcd4-43c7-9233-e0d9ee7081c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:43.495311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4085bf7-fcd4-43c7-9233-e0d9ee7081c3 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:43.508479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1162/2331] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:49:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:49:49.533381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84543b5-2311-441b-bcdd-19dd4bb38f99 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:49.534916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a84543b5-2311-441b-bcdd-19dd4bb38f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:49.702862 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84543b5-2311-441b-bcdd-19dd4bb38f99 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:49.714411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff744988-0b32-4521-bb53-80ca33da6c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:49.715509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff744988-0b32-4521-bb53-80ca33da6c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:49.715941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff744988-0b32-4521-bb53-80ca33da6c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:49.716764 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff744988-0b32-4521-bb53-80ca33da6c2c admin admin] PATH_INFO: `/v3/users/2025deb3a9534995a3148f7662211873` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:49.718671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff744988-0b32-4521-bb53-80ca33da6c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2025deb3a9534995a3148f7662211873)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:49.721106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff744988-0b32-4521-bb53-80ca33da6c2c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:50.184731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ff744988-0b32-4521-bb53-80ca33da6c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2025deb3a9534995a3148f7662211873'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:50.185585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ff744988-0b32-4521-bb53-80ca33da6c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2025deb3a9534995a3148f7662211873'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:50.186396 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ff744988-0b32-4521-bb53-80ca33da6c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2025deb3a9534995a3148f7662211873'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:50.203715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ff744988-0b32-4521-bb53-80ca33da6c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2025deb3a9534995a3148f7662211873'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:50.212906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ff744988-0b32-4521-bb53-80ca33da6c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2025deb3a9534995a3148f7662211873'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:50.323594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1170/2332] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:49:49 2022] DELETE /identity/v3/users/2025deb3a9534995a3148f7662211873 => generated 0 bytes in 791 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:50.328852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded0e3a-fe5d-43ef-a49c-160b70430198 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:50.329432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded0e3a-fe5d-43ef-a49c-160b70430198 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:50.329800 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded0e3a-fe5d-43ef-a49c-160b70430198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:50.373867 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4ded0e3a-fe5d-43ef-a49c-160b70430198 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:50.375983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4ded0e3a-fe5d-43ef-a49c-160b70430198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:50.501904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1163/2333] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:50.514809 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff744988-0b32-4521-bb53-80ca33da6c2c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:50.518744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ff744988-0b32-4521-bb53-80ca33da6c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:50.686755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff744988-0b32-4521-bb53-80ca33da6c2c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:50.696144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b6bb1-4aee-4aa1-b09e-d5d353b9e279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:50.697313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b6bb1-4aee-4aa1-b09e-d5d353b9e279 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:50.697890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b6bb1-4aee-4aa1-b09e-d5d353b9e279 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:50.698411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b6bb1-4aee-4aa1-b09e-d5d353b9e279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:50.710251 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b6bb1-4aee-4aa1-b09e-d5d353b9e279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:50.712129 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b6bb1-4aee-4aa1-b09e-d5d353b9e279 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:50.728241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1171/2334] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:49:51.433143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded0e3a-fe5d-43ef-a49c-160b70430198 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:51.434651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4ded0e3a-fe5d-43ef-a49c-160b70430198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:51.464004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded0e3a-fe5d-43ef-a49c-160b70430198 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:51.483361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:51.484276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:51.484511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:51.484819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] PATH_INFO: `/v3/projects/88f5b8dec52244dea1c8cd256cf0b805` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:51.486136 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] RBAC: Authorizing `identity:delete_project(project_id=88f5b8dec52244dea1c8cd256cf0b805)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:51.488220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:51.637100 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88f5b8dec52244dea1c8cd256cf0b805', 'request_id': 'req-71abba00-1721-42a2-aae3-f9a0c7e6892a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:51.686180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88f5b8dec52244dea1c8cd256cf0b805', 'request_id': 'req-71abba00-1721-42a2-aae3-f9a0c7e6892a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:51.697833 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88f5b8dec52244dea1c8cd256cf0b805', 'request_id': 'req-71abba00-1721-42a2-aae3-f9a0c7e6892a'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:51.716889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] The token cache is being invalidate because project 88f5b8dec52244dea1c8cd256cf0b805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:49:51.717243 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:51.718133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:51.725803 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1164/2335] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:49:51 2022] DELETE /identity/v3/projects/88f5b8dec52244dea1c8cd256cf0b805 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:53.816569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f7ded-af6b-4aba-a7ec-9e0c61043715 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:53.817900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f7ded-af6b-4aba-a7ec-9e0c61043715 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:53.817900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f7ded-af6b-4aba-a7ec-9e0c61043715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:53.827441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:53.844091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d74f7ded-af6b-4aba-a7ec-9e0c61043715 None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:53.844091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d74f7ded-af6b-4aba-a7ec-9e0c61043715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:53.924018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1172/2336] 10.222.0.83 () {58 vars in 967 bytes} [Wed Jul 20 22:49:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:53.947042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:53.948944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:54.023974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:54.059064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71abba00-1721-42a2-aae3-f9a0c7e6892a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:54.064794 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b0db9-eaca-4173-84cc-4d28afb65771 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:54.065570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b0db9-eaca-4173-84cc-4d28afb65771 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:54.066338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b0db9-eaca-4173-84cc-4d28afb65771 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:54.066338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b0db9-eaca-4173-84cc-4d28afb65771 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:54.081776 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b0db9-eaca-4173-84cc-4d28afb65771 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:54.083576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b0db9-eaca-4173-84cc-4d28afb65771 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:54.096460 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1165/2337] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:49:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:49:57.624766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f7ded-af6b-4aba-a7ec-9e0c61043715 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:57.626544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d74f7ded-af6b-4aba-a7ec-9e0c61043715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:57.694779 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f7ded-af6b-4aba-a7ec-9e0c61043715 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:57.699589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9a1f6b-d34c-4964-8426-149d10491c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:57.700464 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a1f6b-d34c-4964-8426-149d10491c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:57.700746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a1f6b-d34c-4964-8426-149d10491c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:57.701021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9a1f6b-d34c-4964-8426-149d10491c36 admin admin] PATH_INFO: `/v3/users/2ea1ada84a544d959a7a3954993fb6fb` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:57.702261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a1f6b-d34c-4964-8426-149d10491c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea1ada84a544d959a7a3954993fb6fb)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:57.704221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9a1f6b-d34c-4964-8426-149d10491c36 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:57.861473 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-db9a1f6b-d34c-4964-8426-149d10491c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea1ada84a544d959a7a3954993fb6fb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:57.862182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-db9a1f6b-d34c-4964-8426-149d10491c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea1ada84a544d959a7a3954993fb6fb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:57.862881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-db9a1f6b-d34c-4964-8426-149d10491c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea1ada84a544d959a7a3954993fb6fb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:57.876791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-db9a1f6b-d34c-4964-8426-149d10491c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea1ada84a544d959a7a3954993fb6fb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:57.884758 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-db9a1f6b-d34c-4964-8426-149d10491c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea1ada84a544d959a7a3954993fb6fb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:57.950586 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1173/2338] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:49:57 2022] DELETE /identity/v3/users/2ea1ada84a544d959a7a3954993fb6fb => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:58.203679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b0db9-eaca-4173-84cc-4d28afb65771 service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:58.216401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b0db9-eaca-4173-84cc-4d28afb65771 service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:58.283654 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf337b1-672a-474d-b956-a7b0f42cb274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:58.284618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf337b1-672a-474d-b956-a7b0f42cb274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:58.284903 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf337b1-672a-474d-b956-a7b0f42cb274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:58.285184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf337b1-672a-474d-b956-a7b0f42cb274 admin admin] PATH_INFO: `/v3/projects/7bd3d5b09a824139828e80d5f51eafb8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:58.287658 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf337b1-672a-474d-b956-a7b0f42cb274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd3d5b09a824139828e80d5f51eafb8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:58.291367 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf337b1-672a-474d-b956-a7b0f42cb274 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:58.417679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6bf337b1-672a-474d-b956-a7b0f42cb274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd3d5b09a824139828e80d5f51eafb8', 'request_id': 'req-6bf337b1-672a-474d-b956-a7b0f42cb274'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:58.515797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6bf337b1-672a-474d-b956-a7b0f42cb274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd3d5b09a824139828e80d5f51eafb8', 'request_id': 'req-6bf337b1-672a-474d-b956-a7b0f42cb274'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:58.526024 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6bf337b1-672a-474d-b956-a7b0f42cb274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd3d5b09a824139828e80d5f51eafb8', 'request_id': 'req-6bf337b1-672a-474d-b956-a7b0f42cb274'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:58.540353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6bf337b1-672a-474d-b956-a7b0f42cb274 admin admin] The token cache is being invalidate because project 7bd3d5b09a824139828e80d5f51eafb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:49:58.540703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6bf337b1-672a-474d-b956-a7b0f42cb274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:58.541392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-6bf337b1-672a-474d-b956-a7b0f42cb274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:49:58.543214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1166/2339] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:49:58 2022] DELETE /identity/v3/projects/7bd3d5b09a824139828e80d5f51eafb8 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:49:58.548978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0dc26-4784-44d5-a7bd-edaca76cdbdc None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:58.549305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0dc26-4784-44d5-a7bd-edaca76cdbdc None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:58.549592 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0dc26-4784-44d5-a7bd-edaca76cdbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:58.573129 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7ce0dc26-4784-44d5-a7bd-edaca76cdbdc None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:58.574508 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7ce0dc26-4784-44d5-a7bd-edaca76cdbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:58.602053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:58.639566 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1174/2340] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:58.651835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37850fe5-f80e-419a-abed-438f780a9d61 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:58.652205 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37850fe5-f80e-419a-abed-438f780a9d61 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:58.652490 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37850fe5-f80e-419a-abed-438f780a9d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:58.671173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-37850fe5-f80e-419a-abed-438f780a9d61 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:58.672395 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-37850fe5-f80e-419a-abed-438f780a9d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:58.681212 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1167/2341] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:58.685405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0dc26-4784-44d5-a7bd-edaca76cdbdc None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:58.695832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0dc26-4784-44d5-a7bd-edaca76cdbdc None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:58.701273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c5117-9dd9-44e9-a471-7d7db5f47696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:58.702021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c5117-9dd9-44e9-a471-7d7db5f47696 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:58.702308 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c5117-9dd9-44e9-a471-7d7db5f47696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:58.702587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c5117-9dd9-44e9-a471-7d7db5f47696 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:58.703318 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c5117-9dd9-44e9-a471-7d7db5f47696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:49:58.703633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c5117-9dd9-44e9-a471-7d7db5f47696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:58.705260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c5117-9dd9-44e9-a471-7d7db5f47696 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:58.717957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1175/2342] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:49:58.722335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37850fe5-f80e-419a-abed-438f780a9d61 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:58.731969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37850fe5-f80e-419a-abed-438f780a9d61 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:58.737064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd17022-96ce-4c83-a312-d46181f2919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:58.738195 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd17022-96ce-4c83-a312-d46181f2919d admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:58.738195 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd17022-96ce-4c83-a312-d46181f2919d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:58.738392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd17022-96ce-4c83-a312-d46181f2919d admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:58.739104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd17022-96ce-4c83-a312-d46181f2919d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:58.741027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd17022-96ce-4c83-a312-d46181f2919d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:58.882216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1168/2343] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:49:58 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:49:58.886271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c5117-9dd9-44e9-a471-7d7db5f47696 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:58.897200 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c5117-9dd9-44e9-a471-7d7db5f47696 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:58.953019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83e34-1954-45c6-9561-70f20a522488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:58.953732 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83e34-1954-45c6-9561-70f20a522488 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:58.954012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83e34-1954-45c6-9561-70f20a522488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:58.954289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c83e34-1954-45c6-9561-70f20a522488 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:58.954993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c83e34-1954-45c6-9561-70f20a522488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:58.956923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c83e34-1954-45c6-9561-70f20a522488 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:59.040280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1176/2344] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:49:58 2022] POST /identity/v3/users => generated 283 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:49:59.044514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd17022-96ce-4c83-a312-d46181f2919d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:59.055612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd17022-96ce-4c83-a312-d46181f2919d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:59.060159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911501a-2826-49ff-9fdc-5de235b054d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:59.060822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911501a-2826-49ff-9fdc-5de235b054d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:59.061111 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911501a-2826-49ff-9fdc-5de235b054d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:59.061393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911501a-2826-49ff-9fdc-5de235b054d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:59.062172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911501a-2826-49ff-9fdc-5de235b054d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:59.063798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0911501a-2826-49ff-9fdc-5de235b054d0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:59.079326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1169/2345] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:49:59.083845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83e34-1954-45c6-9561-70f20a522488 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:59.093925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c83e34-1954-45c6-9561-70f20a522488 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:59.098653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570cf9c4-e64f-475b-b7ce-e6c37f08d63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:59.099315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cf9c4-e64f-475b-b7ce-e6c37f08d63f admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:59.099606 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cf9c4-e64f-475b-b7ce-e6c37f08d63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:59.099889 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570cf9c4-e64f-475b-b7ce-e6c37f08d63f admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:59.100627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cf9c4-e64f-475b-b7ce-e6c37f08d63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:59.102268 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570cf9c4-e64f-475b-b7ce-e6c37f08d63f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:59.112027 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1177/2346] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:49:59.116651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911501a-2826-49ff-9fdc-5de235b054d0 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:59.126474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0911501a-2826-49ff-9fdc-5de235b054d0 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:59.132053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5026e-8514-42b3-9f80-2b992ead111e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:59.133049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5026e-8514-42b3-9f80-2b992ead111e admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:59.133272 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5026e-8514-42b3-9f80-2b992ead111e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:59.133549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5026e-8514-42b3-9f80-2b992ead111e admin admin] PATH_INFO: `/v3/projects/4b035bc5b92a4d038f21e1b839ef9d07/users/9935f04ff57c47fcad68db631cbeaed5/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:59.147958 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5026e-8514-42b3-9f80-2b992ead111e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b035bc5b92a4d038f21e1b839ef9d07, user_id=9935f04ff57c47fcad68db631cbeaed5, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:59.150657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5026e-8514-42b3-9f80-2b992ead111e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:59.217271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:49:59.222880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1170/2347] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:49:59 2022] PUT /identity/v3/projects/4b035bc5b92a4d038f21e1b839ef9d07/users/9935f04ff57c47fcad68db631cbeaed5/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:49:59.233768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3611e5-a311-4d6e-ad94-d6dc83ceb457 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:59.235313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3611e5-a311-4d6e-ad94-d6dc83ceb457 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:59.235313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3611e5-a311-4d6e-ad94-d6dc83ceb457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:59.262482 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-dd3611e5-a311-4d6e-ad94-d6dc83ceb457 None None] MFA Rules not processed for user `9935f04ff57c47fcad68db631cbeaed5`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:49:59.263731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dd3611e5-a311-4d6e-ad94-d6dc83ceb457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:59.329463 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1178/2348] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:49:59 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:49:59.341196 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5026e-8514-42b3-9f80-2b992ead111e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:49:59.342933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-14f5026e-8514-42b3-9f80-2b992ead111e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:49:59.401095 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5026e-8514-42b3-9f80-2b992ead111e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:49:59.404768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567726b-f9f9-4453-9f9c-d0144a42e448 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:49:59.405428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567726b-f9f9-4453-9f9c-d0144a42e448 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:49:59.405735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567726b-f9f9-4453-9f9c-d0144a42e448 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:49:59.406025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567726b-f9f9-4453-9f9c-d0144a42e448 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:49:59.415413 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567726b-f9f9-4453-9f9c-d0144a42e448 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:49:59.416863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567726b-f9f9-4453-9f9c-d0144a42e448 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:49:59.428284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1171/2349] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:49:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:50:04.875754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f22e1-a466-4fb9-a126-ae378ce15c04 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:04.876263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f22e1-a466-4fb9-a126-ae378ce15c04 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:04.876360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f22e1-a466-4fb9-a126-ae378ce15c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:04.895203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d37f22e1-a466-4fb9-a126-ae378ce15c04 None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:04.896412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d37f22e1-a466-4fb9-a126-ae378ce15c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:04.916891 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:04.972173 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1179/2350] 10.222.0.83 () {58 vars in 967 bytes} [Wed Jul 20 22:50:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:04.986585 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567726b-f9f9-4453-9f9c-d0144a42e448 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:04.987977 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7567726b-f9f9-4453-9f9c-d0144a42e448 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:05.065396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567726b-f9f9-4453-9f9c-d0144a42e448 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:05.077773 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d1fbe-26d1-4ada-8768-4e635dede92f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:05.078802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d1fbe-26d1-4ada-8768-4e635dede92f service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:05.079842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d1fbe-26d1-4ada-8768-4e635dede92f service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:05.080292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d1fbe-26d1-4ada-8768-4e635dede92f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:05.090548 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d1fbe-26d1-4ada-8768-4e635dede92f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:05.092349 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847d1fbe-26d1-4ada-8768-4e635dede92f service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:05.101648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1172/2351] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:50:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:50:12.050354 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f40b9d-f002-4bc3-af50-58f53341c8f7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:12.050897 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f40b9d-f002-4bc3-af50-58f53341c8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:12.050897 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f40b9d-f002-4bc3-af50-58f53341c8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:12.078058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d6f40b9d-f002-4bc3-af50-58f53341c8f7 None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:12.079352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d6f40b9d-f002-4bc3-af50-58f53341c8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:12.089962 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1180/2352] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:50:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:12.102883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d1fbe-26d1-4ada-8768-4e635dede92f service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:12.114516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d1fbe-26d1-4ada-8768-4e635dede92f service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:12.120011 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d027f9-0a6a-44e2-bbde-11336a38de77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:12.120604 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d027f9-0a6a-44e2-bbde-11336a38de77 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:12.120889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d027f9-0a6a-44e2-bbde-11336a38de77 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:12.121166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d027f9-0a6a-44e2-bbde-11336a38de77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:12.134042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d027f9-0a6a-44e2-bbde-11336a38de77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:12.134275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d027f9-0a6a-44e2-bbde-11336a38de77 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:12.156181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1173/2353] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:50:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:50:13.174488 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edfb76-ee62-4438-aaa2-edaba73da99f None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:13.174972 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edfb76-ee62-4438-aaa2-edaba73da99f None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:13.175067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edfb76-ee62-4438-aaa2-edaba73da99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:13.192696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-32edfb76-ee62-4438-aaa2-edaba73da99f None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:13.199870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-32edfb76-ee62-4438-aaa2-edaba73da99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:13.201621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1181/2354] 10.222.0.83 () {58 vars in 967 bytes} [Wed Jul 20 22:50:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:13.213687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d027f9-0a6a-44e2-bbde-11336a38de77 service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:13.224934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d027f9-0a6a-44e2-bbde-11336a38de77 service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:13.230523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8e83f-548b-4765-a2b9-81b738857272 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:13.231843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e83f-548b-4765-a2b9-81b738857272 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:13.232171 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e83f-548b-4765-a2b9-81b738857272 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:13.232452 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8e83f-548b-4765-a2b9-81b738857272 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:13.241210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8e83f-548b-4765-a2b9-81b738857272 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:13.242816 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8e83f-548b-4765-a2b9-81b738857272 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:13.251071 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1174/2355] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:50:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:50:13.971183 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20272dd-2e6a-438b-8456-c850ffb5872c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:13.982412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20272dd-2e6a-438b-8456-c850ffb5872c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:13.982412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20272dd-2e6a-438b-8456-c850ffb5872c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:13.989217 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b20272dd-2e6a-438b-8456-c850ffb5872c None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:13.990428 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b20272dd-2e6a-438b-8456-c850ffb5872c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:13.998029 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1182/2356] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:50:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:14.010173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8e83f-548b-4765-a2b9-81b738857272 service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:14.021489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8e83f-548b-4765-a2b9-81b738857272 service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:14.026617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ed1f7-4c53-4c0c-a517-8d29000c1950 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:14.027276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ed1f7-4c53-4c0c-a517-8d29000c1950 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:14.027693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ed1f7-4c53-4c0c-a517-8d29000c1950 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:14.028081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ed1f7-4c53-4c0c-a517-8d29000c1950 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:14.036558 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ed1f7-4c53-4c0c-a517-8d29000c1950 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:14.038292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818ed1f7-4c53-4c0c-a517-8d29000c1950 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:14.047240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1175/2357] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:50:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:50:14.658010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb0ede-f44d-4e45-9503-a700f09f8072 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:14.658887 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb0ede-f44d-4e45-9503-a700f09f8072 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:14.659239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb0ede-f44d-4e45-9503-a700f09f8072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:14.680457 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-78cb0ede-f44d-4e45-9503-a700f09f8072 None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:14.681577 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-78cb0ede-f44d-4e45-9503-a700f09f8072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:14.689641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1183/2358] 10.222.0.83 () {58 vars in 967 bytes} [Wed Jul 20 22:50:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:14.702293 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ed1f7-4c53-4c0c-a517-8d29000c1950 service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:14.713856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ed1f7-4c53-4c0c-a517-8d29000c1950 service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:14.719854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dd0615-532e-4479-97a4-5715f711336c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:14.720530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd0615-532e-4479-97a4-5715f711336c service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:14.720811 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd0615-532e-4479-97a4-5715f711336c service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:14.721093 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dd0615-532e-4479-97a4-5715f711336c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:14.729368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd0615-532e-4479-97a4-5715f711336c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:14.731979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dd0615-532e-4479-97a4-5715f711336c service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:14.740045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1176/2359] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:50:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:50:17.572445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb0ede-f44d-4e45-9503-a700f09f8072 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:17.574011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-78cb0ede-f44d-4e45-9503-a700f09f8072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:17.640249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb0ede-f44d-4e45-9503-a700f09f8072 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:17.644862 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e70ef-2ecc-4449-8a54-714cc8f2ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:17.645784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e70ef-2ecc-4449-8a54-714cc8f2ee3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:17.646073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e70ef-2ecc-4449-8a54-714cc8f2ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:17.646355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e70ef-2ecc-4449-8a54-714cc8f2ee3c admin admin] PATH_INFO: `/v3/users/4c1f857fbece4795a1f363022c40f549` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:17.647576 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e70ef-2ecc-4449-8a54-714cc8f2ee3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1f857fbece4795a1f363022c40f549)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:17.649531 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e70ef-2ecc-4449-8a54-714cc8f2ee3c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:17.872190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-da1e70ef-2ecc-4449-8a54-714cc8f2ee3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1f857fbece4795a1f363022c40f549'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:17.873252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-da1e70ef-2ecc-4449-8a54-714cc8f2ee3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1f857fbece4795a1f363022c40f549'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:17.873958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-da1e70ef-2ecc-4449-8a54-714cc8f2ee3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1f857fbece4795a1f363022c40f549'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:17.886830 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-da1e70ef-2ecc-4449-8a54-714cc8f2ee3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1f857fbece4795a1f363022c40f549'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:17.894685 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-da1e70ef-2ecc-4449-8a54-714cc8f2ee3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1f857fbece4795a1f363022c40f549'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:17.982746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1184/2360] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:50:17 2022] DELETE /identity/v3/users/4c1f857fbece4795a1f363022c40f549 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:50:17.987261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e2cc-6065-4b71-865e-436677a005be None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:17.987743 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e2cc-6065-4b71-865e-436677a005be None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:17.987870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474e2cc-6065-4b71-865e-436677a005be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:18.005471 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b474e2cc-6065-4b71-865e-436677a005be None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:18.006989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b474e2cc-6065-4b71-865e-436677a005be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:18.041165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:18.069324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1177/2361] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:18.079717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e70ef-2ecc-4449-8a54-714cc8f2ee3c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:18.081184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-da1e70ef-2ecc-4449-8a54-714cc8f2ee3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:18.111487 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:18.146544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e70ef-2ecc-4449-8a54-714cc8f2ee3c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:18.150206 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa07143-1519-4ded-8960-fc11716743d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:18.150875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa07143-1519-4ded-8960-fc11716743d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:18.151161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa07143-1519-4ded-8960-fc11716743d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:18.151437 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa07143-1519-4ded-8960-fc11716743d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:18.161799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa07143-1519-4ded-8960-fc11716743d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:18.163243 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa07143-1519-4ded-8960-fc11716743d3 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:18.176597 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1185/2362] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:50:18.436122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474e2cc-6065-4b71-865e-436677a005be None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:18.437552 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b474e2cc-6065-4b71-865e-436677a005be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:18.449298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474e2cc-6065-4b71-865e-436677a005be None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:18.454817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24548aff-fc73-48c7-86cb-7d7faa27f952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:18.455694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24548aff-fc73-48c7-86cb-7d7faa27f952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:18.456045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24548aff-fc73-48c7-86cb-7d7faa27f952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:18.456352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24548aff-fc73-48c7-86cb-7d7faa27f952 admin admin] PATH_INFO: `/v3/projects/fee872ff9c504e12a106c0ad30219d8e` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:18.457932 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24548aff-fc73-48c7-86cb-7d7faa27f952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fee872ff9c504e12a106c0ad30219d8e)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:18.459974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24548aff-fc73-48c7-86cb-7d7faa27f952 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:18.543593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-24548aff-fc73-48c7-86cb-7d7faa27f952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee872ff9c504e12a106c0ad30219d8e', 'request_id': 'req-24548aff-fc73-48c7-86cb-7d7faa27f952'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:18.594001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-24548aff-fc73-48c7-86cb-7d7faa27f952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee872ff9c504e12a106c0ad30219d8e', 'request_id': 'req-24548aff-fc73-48c7-86cb-7d7faa27f952'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:18.601164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-24548aff-fc73-48c7-86cb-7d7faa27f952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee872ff9c504e12a106c0ad30219d8e', 'request_id': 'req-24548aff-fc73-48c7-86cb-7d7faa27f952'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:18.613714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-24548aff-fc73-48c7-86cb-7d7faa27f952 admin admin] The token cache is being invalidate because project fee872ff9c504e12a106c0ad30219d8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:50:18.614170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-24548aff-fc73-48c7-86cb-7d7faa27f952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:18.614816 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-24548aff-fc73-48c7-86cb-7d7faa27f952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:18.616432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1178/2363] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:50:18 2022] DELETE /identity/v3/projects/fee872ff9c504e12a106c0ad30219d8e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:50:28.330766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=16 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:28.610053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=37,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:34.474261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa07143-1519-4ded-8960-fc11716743d3 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:34.475854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bfa07143-1519-4ded-8960-fc11716743d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:34.488586 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa07143-1519-4ded-8960-fc11716743d3 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:34.544360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c8e68-e158-4b4e-bd4a-5f5dad61edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:34.545230 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c8e68-e158-4b4e-bd4a-5f5dad61edf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:34.545517 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c8e68-e158-4b4e-bd4a-5f5dad61edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:34.545830 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c8e68-e158-4b4e-bd4a-5f5dad61edf1 admin admin] PATH_INFO: `/v3/users/9935f04ff57c47fcad68db631cbeaed5` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:34.547016 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c8e68-e158-4b4e-bd4a-5f5dad61edf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9935f04ff57c47fcad68db631cbeaed5)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:34.548949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c8e68-e158-4b4e-bd4a-5f5dad61edf1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:34.710816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-924c8e68-e158-4b4e-bd4a-5f5dad61edf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9935f04ff57c47fcad68db631cbeaed5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:34.711616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-924c8e68-e158-4b4e-bd4a-5f5dad61edf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9935f04ff57c47fcad68db631cbeaed5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:34.712365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-924c8e68-e158-4b4e-bd4a-5f5dad61edf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9935f04ff57c47fcad68db631cbeaed5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:34.726065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-924c8e68-e158-4b4e-bd4a-5f5dad61edf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9935f04ff57c47fcad68db631cbeaed5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:34.732841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-924c8e68-e158-4b4e-bd4a-5f5dad61edf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9935f04ff57c47fcad68db631cbeaed5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:34.809989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1186/2364] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:50:34 2022] DELETE /identity/v3/users/9935f04ff57c47fcad68db631cbeaed5 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:50:34.814549 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a001022-603a-4fd5-b6bd-2ea66f278920 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:34.815011 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a001022-603a-4fd5-b6bd-2ea66f278920 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:34.815107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a001022-603a-4fd5-b6bd-2ea66f278920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:34.833774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0a001022-603a-4fd5-b6bd-2ea66f278920 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:34.835044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0a001022-603a-4fd5-b6bd-2ea66f278920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:34.893232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1179/2365] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:50:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:34.903222 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c8e68-e158-4b4e-bd4a-5f5dad61edf1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:34.904634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-924c8e68-e158-4b4e-bd4a-5f5dad61edf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:34.961715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c8e68-e158-4b4e-bd4a-5f5dad61edf1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:34.965214 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1d957-59ff-46f7-8d0f-7407f7e66674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:34.965893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1d957-59ff-46f7-8d0f-7407f7e66674 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:34.966175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1d957-59ff-46f7-8d0f-7407f7e66674 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:34.966448 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1d957-59ff-46f7-8d0f-7407f7e66674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:34.976000 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1d957-59ff-46f7-8d0f-7407f7e66674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:34.977422 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1d957-59ff-46f7-8d0f-7407f7e66674 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:34.987922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1187/2366] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:50:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:50:35.492302 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a001022-603a-4fd5-b6bd-2ea66f278920 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:35.497628 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0a001022-603a-4fd5-b6bd-2ea66f278920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:35.507000 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a001022-603a-4fd5-b6bd-2ea66f278920 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:35.511991 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a04877-8574-420b-8cb9-a82cdfb1b9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:35.513038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a04877-8574-420b-8cb9-a82cdfb1b9bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:35.513329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a04877-8574-420b-8cb9-a82cdfb1b9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:35.513611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a04877-8574-420b-8cb9-a82cdfb1b9bd admin admin] PATH_INFO: `/v3/projects/4b035bc5b92a4d038f21e1b839ef9d07` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:35.514943 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a04877-8574-420b-8cb9-a82cdfb1b9bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b035bc5b92a4d038f21e1b839ef9d07)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:35.516882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a04877-8574-420b-8cb9-a82cdfb1b9bd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:35.634997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-79a04877-8574-420b-8cb9-a82cdfb1b9bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b035bc5b92a4d038f21e1b839ef9d07', 'request_id': 'req-79a04877-8574-420b-8cb9-a82cdfb1b9bd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:35.713037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-79a04877-8574-420b-8cb9-a82cdfb1b9bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b035bc5b92a4d038f21e1b839ef9d07', 'request_id': 'req-79a04877-8574-420b-8cb9-a82cdfb1b9bd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:35.720034 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-79a04877-8574-420b-8cb9-a82cdfb1b9bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b035bc5b92a4d038f21e1b839ef9d07', 'request_id': 'req-79a04877-8574-420b-8cb9-a82cdfb1b9bd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:35.730719 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-79a04877-8574-420b-8cb9-a82cdfb1b9bd admin admin] The token cache is being invalidate because project 4b035bc5b92a4d038f21e1b839ef9d07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:50:35.731011 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-79a04877-8574-420b-8cb9-a82cdfb1b9bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:35.731646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-79a04877-8574-420b-8cb9-a82cdfb1b9bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:35.733189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1180/2367] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:50:35 2022] DELETE /identity/v3/projects/4b035bc5b92a4d038f21e1b839ef9d07 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:50:35.738126 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb6acf-4a91-4ea1-b21d-59419cbb7124 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:35.738632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb6acf-4a91-4ea1-b21d-59419cbb7124 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:35.738772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb6acf-4a91-4ea1-b21d-59419cbb7124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:35.757019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-d3fb6acf-4a91-4ea1-b21d-59419cbb7124 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:35.758244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d3fb6acf-4a91-4ea1-b21d-59419cbb7124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:35.775418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:35.816372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1188/2368] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:35.824882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c950fd8-15fb-4f9e-8332-aadbfea3752c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:35.825373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c950fd8-15fb-4f9e-8332-aadbfea3752c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:35.825473 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c950fd8-15fb-4f9e-8332-aadbfea3752c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:35.844930 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-9c950fd8-15fb-4f9e-8332-aadbfea3752c None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:35.846169 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-9c950fd8-15fb-4f9e-8332-aadbfea3752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:35.854269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1181/2369] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:35.858435 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb6acf-4a91-4ea1-b21d-59419cbb7124 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:35.868587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb6acf-4a91-4ea1-b21d-59419cbb7124 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:35.873273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ada2a-3421-438b-ac19-d5539ab24b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:35.874148 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ada2a-3421-438b-ac19-d5539ab24b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:35.874440 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ada2a-3421-438b-ac19-d5539ab24b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:35.874724 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ada2a-3421-438b-ac19-d5539ab24b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:35.875462 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ada2a-3421-438b-ac19-d5539ab24b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:50:35.875780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ada2a-3421-438b-ac19-d5539ab24b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:35.877390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ada2a-3421-438b-ac19-d5539ab24b19 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:35.889700 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1189/2370] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:50:35.893917 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c950fd8-15fb-4f9e-8332-aadbfea3752c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:35.904254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c950fd8-15fb-4f9e-8332-aadbfea3752c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:35.908927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b4c4d-ea67-426b-92d1-bb678bb1c175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:35.909586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b4c4d-ea67-426b-92d1-bb678bb1c175 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:35.909905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b4c4d-ea67-426b-92d1-bb678bb1c175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:35.910184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b4c4d-ea67-426b-92d1-bb678bb1c175 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:35.910886 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b4c4d-ea67-426b-92d1-bb678bb1c175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:35.912840 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3b4c4d-ea67-426b-92d1-bb678bb1c175 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:35.994842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1182/2371] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:50:35 2022] POST /identity/v3/projects => generated 397 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:50:36.007892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ada2a-3421-438b-ac19-d5539ab24b19 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:36.018050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ada2a-3421-438b-ac19-d5539ab24b19 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:36.076223 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92f840-8fda-4d5f-92fb-cf8d68927736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:36.076904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92f840-8fda-4d5f-92fb-cf8d68927736 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:36.077189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92f840-8fda-4d5f-92fb-cf8d68927736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:36.077465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb92f840-8fda-4d5f-92fb-cf8d68927736 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:36.078207 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92f840-8fda-4d5f-92fb-cf8d68927736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:36.080146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb92f840-8fda-4d5f-92fb-cf8d68927736 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:36.194161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1190/2372] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:50:36 2022] POST /identity/v3/users => generated 299 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:50:36.198644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b4c4d-ea67-426b-92d1-bb678bb1c175 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:36.208984 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b4c4d-ea67-426b-92d1-bb678bb1c175 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:36.213613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276280af-403e-4855-8f79-43dceba2f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:36.214341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276280af-403e-4855-8f79-43dceba2f949 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:36.214633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276280af-403e-4855-8f79-43dceba2f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:36.214920 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276280af-403e-4855-8f79-43dceba2f949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:36.215657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276280af-403e-4855-8f79-43dceba2f949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:36.217293 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276280af-403e-4855-8f79-43dceba2f949 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:36.228192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1183/2373] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:50:36.232321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92f840-8fda-4d5f-92fb-cf8d68927736 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:36.243135 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb92f840-8fda-4d5f-92fb-cf8d68927736 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:36.247903 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258bdfa-1ef7-4b1f-822a-14b1e7647898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:36.248574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258bdfa-1ef7-4b1f-822a-14b1e7647898 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:36.248862 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258bdfa-1ef7-4b1f-822a-14b1e7647898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:36.249139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258bdfa-1ef7-4b1f-822a-14b1e7647898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:36.249915 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258bdfa-1ef7-4b1f-822a-14b1e7647898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:36.251513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258bdfa-1ef7-4b1f-822a-14b1e7647898 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:36.262944 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1191/2374] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:50:36.267056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276280af-403e-4855-8f79-43dceba2f949 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:36.277207 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276280af-403e-4855-8f79-43dceba2f949 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:36.281872 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6269a8-e78a-42f2-aae0-7b24681b94ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:36.282758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6269a8-e78a-42f2-aae0-7b24681b94ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:36.283043 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6269a8-e78a-42f2-aae0-7b24681b94ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:36.283321 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6269a8-e78a-42f2-aae0-7b24681b94ba admin admin] PATH_INFO: `/v3/projects/7dbde1c0ce714eaebceb624748aa391a/users/7c519ded46634fd7b3bd04d2eb183faf/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:36.299101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6269a8-e78a-42f2-aae0-7b24681b94ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbde1c0ce714eaebceb624748aa391a, user_id=7c519ded46634fd7b3bd04d2eb183faf, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:36.302433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6269a8-e78a-42f2-aae0-7b24681b94ba admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:36.770839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1184/2375] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:50:36 2022] PUT /identity/v3/projects/7dbde1c0ce714eaebceb624748aa391a/users/7c519ded46634fd7b3bd04d2eb183faf/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:50:36.783079 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13073a-a8d9-4756-87f0-342d07c21a5a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:36.783571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13073a-a8d9-4756-87f0-342d07c21a5a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:36.783675 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13073a-a8d9-4756-87f0-342d07c21a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:36.811408 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-2f13073a-a8d9-4756-87f0-342d07c21a5a None None] MFA Rules not processed for user `7c519ded46634fd7b3bd04d2eb183faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:36.812627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2f13073a-a8d9-4756-87f0-342d07c21a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:36.882158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1192/2376] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:50:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:36.893689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6269a8-e78a-42f2-aae0-7b24681b94ba admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:36.895462 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ae6269a8-e78a-42f2-aae0-7b24681b94ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:36.918143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:36.953529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6269a8-e78a-42f2-aae0-7b24681b94ba admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:36.957407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7326a3-5f4b-4617-bcb5-004f4540845d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:36.959640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7326a3-5f4b-4617-bcb5-004f4540845d service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:36.959640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7326a3-5f4b-4617-bcb5-004f4540845d service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:36.959640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7326a3-5f4b-4617-bcb5-004f4540845d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:36.968004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7326a3-5f4b-4617-bcb5-004f4540845d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:36.969438 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7326a3-5f4b-4617-bcb5-004f4540845d service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:36.978971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1185/2377] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:50:36 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:50:42.655852 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13073a-a8d9-4756-87f0-342d07c21a5a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:42.674243 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:42.717096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13073a-a8d9-4756-87f0-342d07c21a5a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:42.721739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b02ab-f055-48ea-aee8-7fcbb9696d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:42.722693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b02ab-f055-48ea-aee8-7fcbb9696d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:42.723004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b02ab-f055-48ea-aee8-7fcbb9696d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:42.723294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b02ab-f055-48ea-aee8-7fcbb9696d7d admin admin] PATH_INFO: `/v3/users/7c519ded46634fd7b3bd04d2eb183faf` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:42.724496 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b02ab-f055-48ea-aee8-7fcbb9696d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c519ded46634fd7b3bd04d2eb183faf)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:42.726744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b02ab-f055-48ea-aee8-7fcbb9696d7d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:42.857555 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9e1b02ab-f055-48ea-aee8-7fcbb9696d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c519ded46634fd7b3bd04d2eb183faf'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:42.858323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9e1b02ab-f055-48ea-aee8-7fcbb9696d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c519ded46634fd7b3bd04d2eb183faf'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:42.858928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9e1b02ab-f055-48ea-aee8-7fcbb9696d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c519ded46634fd7b3bd04d2eb183faf'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:42.871274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9e1b02ab-f055-48ea-aee8-7fcbb9696d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c519ded46634fd7b3bd04d2eb183faf'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:42.877906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9e1b02ab-f055-48ea-aee8-7fcbb9696d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c519ded46634fd7b3bd04d2eb183faf'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:42.936000 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1193/2378] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:50:42 2022] DELETE /identity/v3/users/7c519ded46634fd7b3bd04d2eb183faf => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:50:42.940687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa702c47-5c9b-4c21-8969-1663d00d05ef None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:42.941214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa702c47-5c9b-4c21-8969-1663d00d05ef None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:42.941313 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa702c47-5c9b-4c21-8969-1663d00d05ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:42.959354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-fa702c47-5c9b-4c21-8969-1663d00d05ef None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:42.960555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fa702c47-5c9b-4c21-8969-1663d00d05ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:43.019062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1186/2379] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:43.028683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b02ab-f055-48ea-aee8-7fcbb9696d7d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:43.030187 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9e1b02ab-f055-48ea-aee8-7fcbb9696d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:43.089289 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b02ab-f055-48ea-aee8-7fcbb9696d7d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:43.093096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb71441-af4d-462e-ac83-db309db36042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:43.093776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb71441-af4d-462e-ac83-db309db36042 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:43.094086 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb71441-af4d-462e-ac83-db309db36042 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:43.094360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb71441-af4d-462e-ac83-db309db36042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:43.104260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb71441-af4d-462e-ac83-db309db36042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:43.105746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb71441-af4d-462e-ac83-db309db36042 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:43.115346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1194/2380] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:50:43.554793 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa702c47-5c9b-4c21-8969-1663d00d05ef None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:43.556395 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fa702c47-5c9b-4c21-8969-1663d00d05ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:43.568765 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa702c47-5c9b-4c21-8969-1663d00d05ef None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:43.573577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:43.574489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:43.574803 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:43.575081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1 admin admin] PATH_INFO: `/v3/projects/7dbde1c0ce714eaebceb624748aa391a` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:43.576273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbde1c0ce714eaebceb624748aa391a)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:43.578242 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:43.680782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbde1c0ce714eaebceb624748aa391a', 'request_id': 'req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:43.776398 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbde1c0ce714eaebceb624748aa391a', 'request_id': 'req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:43.783137 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbde1c0ce714eaebceb624748aa391a', 'request_id': 'req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:43.794045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1 admin admin] The token cache is being invalidate because project 7dbde1c0ce714eaebceb624748aa391a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:50:43.794337 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:43.794968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3ae1035b-b4f8-46bb-be4d-28a08a79aae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:50:43.796516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1187/2381] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:50:43 2022] DELETE /identity/v3/projects/7dbde1c0ce714eaebceb624748aa391a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:50:43.805498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ac2fb-4d79-44ae-92b9-6a69008ecabf None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:43.806007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ac2fb-4d79-44ae-92b9-6a69008ecabf None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:43.806112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ac2fb-4d79-44ae-92b9-6a69008ecabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:43.823361 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-418ac2fb-4d79-44ae-92b9-6a69008ecabf None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:43.824610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-418ac2fb-4d79-44ae-92b9-6a69008ecabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:43.859786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:43.885385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1195/2382] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:43.893248 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175df4a1-2169-4a4f-80e6-a7069344754e None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:43.899277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175df4a1-2169-4a4f-80e6-a7069344754e None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:43.899277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175df4a1-2169-4a4f-80e6-a7069344754e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:43.912815 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-175df4a1-2169-4a4f-80e6-a7069344754e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:43.914130 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-175df4a1-2169-4a4f-80e6-a7069344754e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:43.922612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1188/2383] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:50:43.926913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ac2fb-4d79-44ae-92b9-6a69008ecabf None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:43.937011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ac2fb-4d79-44ae-92b9-6a69008ecabf None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:43.941901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a904472-5230-44d9-a54d-8e5ace1af197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:43.942596 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904472-5230-44d9-a54d-8e5ace1af197 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:43.942881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904472-5230-44d9-a54d-8e5ace1af197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:43.943159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a904472-5230-44d9-a54d-8e5ace1af197 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:43.943905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a904472-5230-44d9-a54d-8e5ace1af197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:50:43.944218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a904472-5230-44d9-a54d-8e5ace1af197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:43.946503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a904472-5230-44d9-a54d-8e5ace1af197 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:43.960835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1196/2384] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:50:43.966736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175df4a1-2169-4a4f-80e6-a7069344754e None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:43.977115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175df4a1-2169-4a4f-80e6-a7069344754e None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:43.982330 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae80eb-78fd-4332-a34d-970c802f9868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:43.983026 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae80eb-78fd-4332-a34d-970c802f9868 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:43.983310 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae80eb-78fd-4332-a34d-970c802f9868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:43.983586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae80eb-78fd-4332-a34d-970c802f9868 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:43.984296 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae80eb-78fd-4332-a34d-970c802f9868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:43.986405 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae80eb-78fd-4332-a34d-970c802f9868 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:44.082108 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1189/2385] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:50:43 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:50:44.086564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a904472-5230-44d9-a54d-8e5ace1af197 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:44.096970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a904472-5230-44d9-a54d-8e5ace1af197 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:44.152407 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cb499-6f92-4aca-89f2-dd159470581d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:44.153215 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb499-6f92-4aca-89f2-dd159470581d admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:44.153534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb499-6f92-4aca-89f2-dd159470581d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:44.153853 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cb499-6f92-4aca-89f2-dd159470581d admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:44.154548 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cb499-6f92-4aca-89f2-dd159470581d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:44.156473 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cb499-6f92-4aca-89f2-dd159470581d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:44.210305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1197/2386] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:50:44 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:50:44.214447 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae80eb-78fd-4332-a34d-970c802f9868 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:44.225122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae80eb-78fd-4332-a34d-970c802f9868 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:44.230201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1b5b5-1e44-4d39-8940-6aea4857e432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:44.230864 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b5b5-1e44-4d39-8940-6aea4857e432 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:44.231149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b5b5-1e44-4d39-8940-6aea4857e432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:44.231430 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1b5b5-1e44-4d39-8940-6aea4857e432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:44.232184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1b5b5-1e44-4d39-8940-6aea4857e432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:44.233831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad1b5b5-1e44-4d39-8940-6aea4857e432 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:44.244992 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1190/2387] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:50:44.248706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cb499-6f92-4aca-89f2-dd159470581d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:44.259534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cb499-6f92-4aca-89f2-dd159470581d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:44.264139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153d1aa-8eeb-45e5-a244-b8b94281989a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:44.264799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153d1aa-8eeb-45e5-a244-b8b94281989a admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:44.265084 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153d1aa-8eeb-45e5-a244-b8b94281989a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:44.265359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153d1aa-8eeb-45e5-a244-b8b94281989a admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:44.266135 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153d1aa-8eeb-45e5-a244-b8b94281989a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:44.267732 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153d1aa-8eeb-45e5-a244-b8b94281989a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:44.278761 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1198/2388] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:50:44.282691 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1b5b5-1e44-4d39-8940-6aea4857e432 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:44.292696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1b5b5-1e44-4d39-8940-6aea4857e432 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:44.297282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1abf5-2bac-46b9-9cbd-7babb36d4e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:44.298202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1abf5-2bac-46b9-9cbd-7babb36d4e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:44.298487 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1abf5-2bac-46b9-9cbd-7babb36d4e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:44.298768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e1abf5-2bac-46b9-9cbd-7babb36d4e65 admin admin] PATH_INFO: `/v3/projects/58ae50012f124c4590490792b97fe88e/users/5e35a47b246b4350be6a0d7804a3e7d4/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:44.301005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:44.314216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1abf5-2bac-46b9-9cbd-7babb36d4e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58ae50012f124c4590490792b97fe88e, user_id=5e35a47b246b4350be6a0d7804a3e7d4, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:44.316877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e1abf5-2bac-46b9-9cbd-7babb36d4e65 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:44.365054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1191/2389] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:50:44 2022] PUT /identity/v3/projects/58ae50012f124c4590490792b97fe88e/users/5e35a47b246b4350be6a0d7804a3e7d4/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:50:44.370774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da4694-db58-4bd9-8938-c8ecaa780577 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:44.371067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da4694-db58-4bd9-8938-c8ecaa780577 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:44.371352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da4694-db58-4bd9-8938-c8ecaa780577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:44.390433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-18da4694-db58-4bd9-8938-c8ecaa780577 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:44.391652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-18da4694-db58-4bd9-8938-c8ecaa780577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:44.453067 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1199/2390] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:44.465103 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1abf5-2bac-46b9-9cbd-7babb36d4e65 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:44.466896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-10e1abf5-2bac-46b9-9cbd-7babb36d4e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:44.524544 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e1abf5-2bac-46b9-9cbd-7babb36d4e65 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:44.528246 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301dd8b-efcb-484b-94f6-7881a2397140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:44.528905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301dd8b-efcb-484b-94f6-7881a2397140 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:44.529191 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301dd8b-efcb-484b-94f6-7881a2397140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:44.529473 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301dd8b-efcb-484b-94f6-7881a2397140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:44.539196 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301dd8b-efcb-484b-94f6-7881a2397140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:44.540731 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301dd8b-efcb-484b-94f6-7881a2397140 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:44.553394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1192/2391] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:50:47.021733 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e33c9-8f34-4e6d-89ab-974ee6821b0b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:47.022294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e33c9-8f34-4e6d-89ab-974ee6821b0b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:47.022294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e33c9-8f34-4e6d-89ab-974ee6821b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:47.043223 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-af2e33c9-8f34-4e6d-89ab-974ee6821b0b None None] MFA Rules not processed for user `26ef0b53b0254e3a96490839cd4dd85f`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:47.044636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-af2e33c9-8f34-4e6d-89ab-974ee6821b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:47.107637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:47.121915 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1200/2392] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:50:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:50.000228 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e96ce-10df-449f-8a80-5387040946c1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:50.000661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e96ce-10df-449f-8a80-5387040946c1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:50.000789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e96ce-10df-449f-8a80-5387040946c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:50.051466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-322e96ce-10df-449f-8a80-5387040946c1 None None] MFA Rules not processed for user `5e35a47b246b4350be6a0d7804a3e7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:50.052702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-322e96ce-10df-449f-8a80-5387040946c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:50.137818 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1193/2393] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:50:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:50.141290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e33c9-8f34-4e6d-89ab-974ee6821b0b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:50.154793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e33c9-8f34-4e6d-89ab-974ee6821b0b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:50.159826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804d864-c40b-489e-8203-6f89ab110b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:50.160689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d864-c40b-489e-8203-6f89ab110b59 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:50.160982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d864-c40b-489e-8203-6f89ab110b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:50.161267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804d864-c40b-489e-8203-6f89ab110b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:50.162077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804d864-c40b-489e-8203-6f89ab110b59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:50.164136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804d864-c40b-489e-8203-6f89ab110b59 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:50.276824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1201/2394] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:50:50 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:50:50.280921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e96ce-10df-449f-8a80-5387040946c1 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:50.293437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e96ce-10df-449f-8a80-5387040946c1 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:50.377355 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6fb36-0bf5-4789-be9c-5d6495e68542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:50.378205 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6fb36-0bf5-4789-be9c-5d6495e68542 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:50.390133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6fb36-0bf5-4789-be9c-5d6495e68542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:50.394144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6fb36-0bf5-4789-be9c-5d6495e68542 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:50.395078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6fb36-0bf5-4789-be9c-5d6495e68542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:50.397204 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6fb36-0bf5-4789-be9c-5d6495e68542 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:50.473699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1194/2395] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:50:50 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:50:50.478390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804d864-c40b-489e-8203-6f89ab110b59 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:50.489490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804d864-c40b-489e-8203-6f89ab110b59 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:50.494832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aa26c-c7b1-4c58-a21d-b1725e11a0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:50.495564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa26c-c7b1-4c58-a21d-b1725e11a0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:50.495855 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa26c-c7b1-4c58-a21d-b1725e11a0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:50.496139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19aa26c-c7b1-4c58-a21d-b1725e11a0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:50.496934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19aa26c-c7b1-4c58-a21d-b1725e11a0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:50.498595 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19aa26c-c7b1-4c58-a21d-b1725e11a0a5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:50.515650 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1202/2396] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:50:50.517010 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6fb36-0bf5-4789-be9c-5d6495e68542 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:50.525427 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:50.531673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6fb36-0bf5-4789-be9c-5d6495e68542 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:50.536689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dcb95-deea-46f4-a27a-dc686aa44864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:50.538044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dcb95-deea-46f4-a27a-dc686aa44864 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:50.538044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dcb95-deea-46f4-a27a-dc686aa44864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:50.538495 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dcb95-deea-46f4-a27a-dc686aa44864 admin admin] PATH_INFO: `/v3/projects/1d9ac36012bc40e49d8b4016059dbadd/users/4be2a06b4ded4c8d8598478d240161a2/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:50.556460 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dcb95-deea-46f4-a27a-dc686aa44864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9ac36012bc40e49d8b4016059dbadd, user_id=4be2a06b4ded4c8d8598478d240161a2, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:50.559208 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dcb95-deea-46f4-a27a-dc686aa44864 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:50.634112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1195/2397] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:50:50 2022] PUT /identity/v3/projects/1d9ac36012bc40e49d8b4016059dbadd/users/4be2a06b4ded4c8d8598478d240161a2/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:50:50.638059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aa26c-c7b1-4c58-a21d-b1725e11a0a5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:50.649265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19aa26c-c7b1-4c58-a21d-b1725e11a0a5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:50.713589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407f23a-e714-4764-9532-a2d70f986a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:50.715877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407f23a-e714-4764-9532-a2d70f986a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:50.715877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407f23a-e714-4764-9532-a2d70f986a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:50.715877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407f23a-e714-4764-9532-a2d70f986a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:50.715877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407f23a-e714-4764-9532-a2d70f986a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:50.717445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407f23a-e714-4764-9532-a2d70f986a46 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:50.733061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1203/2398] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:50:50.734662 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dcb95-deea-46f4-a27a-dc686aa44864 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:50.747064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dcb95-deea-46f4-a27a-dc686aa44864 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:50.751878 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d31f6-a481-4f6e-ab8f-4e95bd479b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:50.752784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d31f6-a481-4f6e-ab8f-4e95bd479b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:50.753072 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d31f6-a481-4f6e-ab8f-4e95bd479b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:50.753353 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d31f6-a481-4f6e-ab8f-4e95bd479b1c admin admin] PATH_INFO: `/v3/projects/1d9ac36012bc40e49d8b4016059dbadd/users/4be2a06b4ded4c8d8598478d240161a2/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:50.755536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d31f6-a481-4f6e-ab8f-4e95bd479b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d9ac36012bc40e49d8b4016059dbadd, user_id=4be2a06b4ded4c8d8598478d240161a2, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:50.758780 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d31f6-a481-4f6e-ab8f-4e95bd479b1c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:50.772220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1196/2399] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:50:50 2022] PUT /identity/v3/projects/1d9ac36012bc40e49d8b4016059dbadd/users/4be2a06b4ded4c8d8598478d240161a2/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:50:53.454663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407f23a-e714-4764-9532-a2d70f986a46 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:53.456451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e407f23a-e714-4764-9532-a2d70f986a46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:53.599153 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407f23a-e714-4764-9532-a2d70f986a46 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:53.687765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:50:53.702257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380a57e-b0fe-4a7a-aa12-4099c9467087 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c9898ccf874dce88f08bebdbae02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:53.702711 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a57e-b0fe-4a7a-aa12-4099c9467087 service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:53.703800 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a57e-b0fe-4a7a-aa12-4099c9467087 service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:53.703800 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a57e-b0fe-4a7a-aa12-4099c9467087 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:53.706560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1380a57e-b0fe-4a7a-aa12-4099c9467087 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:53.766641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380a57e-b0fe-4a7a-aa12-4099c9467087 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:50:53.768268 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380a57e-b0fe-4a7a-aa12-4099c9467087 service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:50:53.793885 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1204/2400] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:50:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:50:59.741174 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f19d3-dc44-471d-a5cb-8d6cdef21e90 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:59.742978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f19d3-dc44-471d-a5cb-8d6cdef21e90 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:59.743455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f19d3-dc44-471d-a5cb-8d6cdef21e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:50:59.777522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2c6f19d3-dc44-471d-a5cb-8d6cdef21e90 None None] MFA Rules not processed for user `4be2a06b4ded4c8d8598478d240161a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:50:59.778804 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2c6f19d3-dc44-471d-a5cb-8d6cdef21e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:59.854931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1197/2401] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:50:59 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:50:59.869087 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380a57e-b0fe-4a7a-aa12-4099c9467087 service placement] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:50:59.870804 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1380a57e-b0fe-4a7a-aa12-4099c9467087 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:50:59.962255 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380a57e-b0fe-4a7a-aa12-4099c9467087 service placement] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:50:59.968367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841095c-ff9d-4358-b07b-5d729b6054e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:50:59.969182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841095c-ff9d-4358-b07b-5d729b6054e5 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:50:59.969575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841095c-ff9d-4358-b07b-5d729b6054e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:50:59.970243 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841095c-ff9d-4358-b07b-5d729b6054e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:00.040639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841095c-ff9d-4358-b07b-5d729b6054e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:51:00.042252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841095c-ff9d-4358-b07b-5d729b6054e5 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:51:00.051438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1205/2402] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:50:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:51:00.259305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71e5ea-f8ef-4cab-bc68-ba3167c937aa None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:00.261888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71e5ea-f8ef-4cab-bc68-ba3167c937aa None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:00.261888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71e5ea-f8ef-4cab-bc68-ba3167c937aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:00.278934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-af71e5ea-f8ef-4cab-bc68-ba3167c937aa None None] MFA Rules not processed for user `f6a84e6c6706453cb3973dd89c2ea1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:51:00.280216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-af71e5ea-f8ef-4cab-bc68-ba3167c937aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:51:00.338379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1198/2403] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:51:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:51:03.279775 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a77386-e8a9-4b9b-bc98-9746e7f388f2 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:03.280316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a77386-e8a9-4b9b-bc98-9746e7f388f2 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:03.280316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a77386-e8a9-4b9b-bc98-9746e7f388f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:03.298554 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-73a77386-e8a9-4b9b-bc98-9746e7f388f2 None None] MFA Rules not processed for user `5e35a47b246b4350be6a0d7804a3e7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:51:03.299772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-73a77386-e8a9-4b9b-bc98-9746e7f388f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:51:03.307808 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1206/2404] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:51:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:51:10.330990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:13.293310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=65 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:32.256955 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71e5ea-f8ef-4cab-bc68-ba3167c937aa None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:51:32.312781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71e5ea-f8ef-4cab-bc68-ba3167c937aa None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:51:32.316395 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b24178-3574-4075-a541-441e28fe24e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:51:32.317041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b24178-3574-4075-a541-441e28fe24e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:32.317329 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b24178-3574-4075-a541-441e28fe24e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:32.317606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b24178-3574-4075-a541-441e28fe24e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:32.326647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b24178-3574-4075-a541-441e28fe24e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:51:32.328085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b24178-3574-4075-a541-441e28fe24e1 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:51:32.338614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1199/2405] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:51:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:51:42.333442 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=26 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:56.413613 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e7ee2-ad80-4dc3-8fe0-496456206063 None None] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:56.414200 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e7ee2-ad80-4dc3-8fe0-496456206063 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:56.414561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e7ee2-ad80-4dc3-8fe0-496456206063 None None] PATH_INFO: `/` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:56.416288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1207/2406] 10.222.0.83 () {54 vars in 921 bytes} [Wed Jul 20 22:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:51:56.448344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf4749-c2f3-449b-99a7-36b147dcf3ad None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:56.449202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf4749-c2f3-449b-99a7-36b147dcf3ad None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:56.449465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf4749-c2f3-449b-99a7-36b147dcf3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:56.468899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-08cf4749-c2f3-449b-99a7-36b147dcf3ad None None] MFA Rules not processed for user `65c9898ccf874dce88f08bebdbae02d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:51:56.473827 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-08cf4749-c2f3-449b-99a7-36b147dcf3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:51:56.479082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1200/2407] 10.222.0.83 () {58 vars in 1018 bytes} [Wed Jul 20 22:51:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:51:56.490058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e7ee2-ad80-4dc3-8fe0-496456206063 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:51:56.491784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4e1e7ee2-ad80-4dc3-8fe0-496456206063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:51:56.509080 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e7ee2-ad80-4dc3-8fe0-496456206063 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:51:56.514137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d76fd7-aeff-4c02-8c6e-bf0a416621b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c9898ccf874dce88f08bebdbae02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:51:56.515509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d76fd7-aeff-4c02-8c6e-bf0a416621b9 service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:56.515795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d76fd7-aeff-4c02-8c6e-bf0a416621b9 service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:56.516073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d76fd7-aeff-4c02-8c6e-bf0a416621b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:56.532904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d76fd7-aeff-4c02-8c6e-bf0a416621b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:51:56.532904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d76fd7-aeff-4c02-8c6e-bf0a416621b9 service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:51:56.534862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf4749-c2f3-449b-99a7-36b147dcf3ad None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:51:56.536584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-08cf4749-c2f3-449b-99a7-36b147dcf3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:51:56.550074 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1208/2408] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:51:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:51:56.603841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf4749-c2f3-449b-99a7-36b147dcf3ad None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:51:56.608474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046b725-2ab9-45e1-b2e1-1d92a7c3a7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:51:56.609448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b725-2ab9-45e1-b2e1-1d92a7c3a7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:56.609748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b725-2ab9-45e1-b2e1-1d92a7c3a7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:56.610030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046b725-2ab9-45e1-b2e1-1d92a7c3a7ad admin admin] PATH_INFO: `/v3/users/26ef0b53b0254e3a96490839cd4dd85f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:56.611224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046b725-2ab9-45e1-b2e1-1d92a7c3a7ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ef0b53b0254e3a96490839cd4dd85f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:51:56.613156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046b725-2ab9-45e1-b2e1-1d92a7c3a7ad admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:51:56.767579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1046b725-2ab9-45e1-b2e1-1d92a7c3a7ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ef0b53b0254e3a96490839cd4dd85f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:51:56.844072 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1046b725-2ab9-45e1-b2e1-1d92a7c3a7ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ef0b53b0254e3a96490839cd4dd85f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:51:56.844711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1046b725-2ab9-45e1-b2e1-1d92a7c3a7ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ef0b53b0254e3a96490839cd4dd85f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:51:56.852178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1046b725-2ab9-45e1-b2e1-1d92a7c3a7ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ef0b53b0254e3a96490839cd4dd85f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:51:56.852819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1046b725-2ab9-45e1-b2e1-1d92a7c3a7ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ef0b53b0254e3a96490839cd4dd85f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:51:56.870948 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1201/2409] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:51:56 2022] DELETE /identity/v3/users/26ef0b53b0254e3a96490839cd4dd85f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:51:57.124993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d76fd7-aeff-4c02-8c6e-bf0a416621b9 service placement] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:51:57.143615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d76fd7-aeff-4c02-8c6e-bf0a416621b9 service placement] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:51:57.207323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:51:57.208199 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:57.208484 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:57.208760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a admin admin] PATH_INFO: `/v3/projects/e28d823aff494d508bad80997d75b2e3` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:57.210007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28d823aff494d508bad80997d75b2e3)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:51:57.212058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:51:57.316267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28d823aff494d508bad80997d75b2e3', 'request_id': 'req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:51:57.395867 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28d823aff494d508bad80997d75b2e3', 'request_id': 'req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:51:57.401695 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28d823aff494d508bad80997d75b2e3', 'request_id': 'req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:51:57.414204 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a admin admin] The token cache is being invalidate because project e28d823aff494d508bad80997d75b2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:51:57.414774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:51:57.417280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8bc78f82-cac4-4f3d-a505-57f8e08c4f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:51:57.417280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1209/2410] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:51:57 2022] DELETE /identity/v3/projects/e28d823aff494d508bad80997d75b2e3 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:51:57.422791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7a7c3-ff88-4a00-b6da-61a6ba7091ee None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:57.423251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7a7c3-ff88-4a00-b6da-61a6ba7091ee None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:57.423554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7a7c3-ff88-4a00-b6da-61a6ba7091ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:57.443967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-17c7a7c3-ff88-4a00-b6da-61a6ba7091ee None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:51:57.446248 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-17c7a7c3-ff88-4a00-b6da-61a6ba7091ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:51:57.504597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1202/2411] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:51:57.512242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c533e2-227b-46e5-bdbe-c1ff037ac5d0 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:57.512533 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c533e2-227b-46e5-bdbe-c1ff037ac5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:57.512816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c533e2-227b-46e5-bdbe-c1ff037ac5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:57.531124 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-45c533e2-227b-46e5-bdbe-c1ff037ac5d0 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:51:57.532348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-45c533e2-227b-46e5-bdbe-c1ff037ac5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:51:57.540500 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1210/2412] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:51:57.544731 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7a7c3-ff88-4a00-b6da-61a6ba7091ee None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:51:57.555529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7a7c3-ff88-4a00-b6da-61a6ba7091ee None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:51:57.560056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0bb73-cc58-4ec2-8caf-233a4a2aac84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:51:57.560708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0bb73-cc58-4ec2-8caf-233a4a2aac84 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:57.560990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0bb73-cc58-4ec2-8caf-233a4a2aac84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:57.561537 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0bb73-cc58-4ec2-8caf-233a4a2aac84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:57.562441 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0bb73-cc58-4ec2-8caf-233a4a2aac84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:51:57.562764 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0bb73-cc58-4ec2-8caf-233a4a2aac84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:51:57.564386 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0bb73-cc58-4ec2-8caf-233a4a2aac84 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:51:57.573257 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:57.576577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1203/2413] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:51:57.581485 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c533e2-227b-46e5-bdbe-c1ff037ac5d0 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:51:57.590892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c533e2-227b-46e5-bdbe-c1ff037ac5d0 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:51:57.596333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ce110-4bf7-40f0-a1b5-03a229163033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:51:57.596987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce110-4bf7-40f0-a1b5-03a229163033 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:57.597270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce110-4bf7-40f0-a1b5-03a229163033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:57.597544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ce110-4bf7-40f0-a1b5-03a229163033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:57.598293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ce110-4bf7-40f0-a1b5-03a229163033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:51:57.600203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ce110-4bf7-40f0-a1b5-03a229163033 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:51:57.742317 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1211/2414] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:51:57 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:51:57.746687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0bb73-cc58-4ec2-8caf-233a4a2aac84 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:51:57.757126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0bb73-cc58-4ec2-8caf-233a4a2aac84 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:51:57.825442 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e4073-9dc8-4181-a78b-f736f1e1c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:51:57.826168 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4073-9dc8-4181-a78b-f736f1e1c79e admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:57.826458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4073-9dc8-4181-a78b-f736f1e1c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:57.826737 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e4073-9dc8-4181-a78b-f736f1e1c79e admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:57.827945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e4073-9dc8-4181-a78b-f736f1e1c79e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:51:57.829964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e4073-9dc8-4181-a78b-f736f1e1c79e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:51:58.010535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1204/2415] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:51:57 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:51:58.019384 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ce110-4bf7-40f0-a1b5-03a229163033 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:51:58.029564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ce110-4bf7-40f0-a1b5-03a229163033 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:51:58.034729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9def290-b0f7-464c-91d3-aacdd95d05c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:51:58.035383 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def290-b0f7-464c-91d3-aacdd95d05c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:58.035664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def290-b0f7-464c-91d3-aacdd95d05c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:58.035941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9def290-b0f7-464c-91d3-aacdd95d05c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:58.036717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9def290-b0f7-464c-91d3-aacdd95d05c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:51:58.038349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9def290-b0f7-464c-91d3-aacdd95d05c0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:51:58.048486 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1212/2416] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:51:58.052420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e4073-9dc8-4181-a78b-f736f1e1c79e admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:51:58.063060 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e4073-9dc8-4181-a78b-f736f1e1c79e admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:51:58.067835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6fa4b-6dfe-4121-8203-02ce75cb9e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:51:58.068498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6fa4b-6dfe-4121-8203-02ce75cb9e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:58.068784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6fa4b-6dfe-4121-8203-02ce75cb9e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:58.069063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6fa4b-6dfe-4121-8203-02ce75cb9e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:58.069828 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6fa4b-6dfe-4121-8203-02ce75cb9e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:51:58.071495 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6fa4b-6dfe-4121-8203-02ce75cb9e24 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:51:58.083298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1205/2417] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:51:58.087465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9def290-b0f7-464c-91d3-aacdd95d05c0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:51:58.098063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9def290-b0f7-464c-91d3-aacdd95d05c0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:51:58.102532 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c808dfb-0981-44f5-8ecd-c8099bcc93d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:51:58.103398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c808dfb-0981-44f5-8ecd-c8099bcc93d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:58.103675 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c808dfb-0981-44f5-8ecd-c8099bcc93d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:58.103949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c808dfb-0981-44f5-8ecd-c8099bcc93d2 admin admin] PATH_INFO: `/v3/projects/c878503c91e64c0a828910ae5e315c7f/users/d3e23e1c56394f1baf5d068aaa1d9e2c/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:58.118750 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c808dfb-0981-44f5-8ecd-c8099bcc93d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c878503c91e64c0a828910ae5e315c7f, user_id=d3e23e1c56394f1baf5d068aaa1d9e2c, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:51:58.121378 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c808dfb-0981-44f5-8ecd-c8099bcc93d2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:51:58.197425 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1213/2418] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:51:58 2022] PUT /identity/v3/projects/c878503c91e64c0a828910ae5e315c7f/users/d3e23e1c56394f1baf5d068aaa1d9e2c/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:51:58.203630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98515db-f37a-42c2-a5ad-324b787c404a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:58.203948 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98515db-f37a-42c2-a5ad-324b787c404a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:58.204223 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98515db-f37a-42c2-a5ad-324b787c404a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:58.222075 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c98515db-f37a-42c2-a5ad-324b787c404a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:51:58.223261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c98515db-f37a-42c2-a5ad-324b787c404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:51:58.283811 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1206/2419] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:51:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:51:58.293349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c808dfb-0981-44f5-8ecd-c8099bcc93d2 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:51:58.295048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7c808dfb-0981-44f5-8ecd-c8099bcc93d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:51:58.309941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:51:58.354538 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c808dfb-0981-44f5-8ecd-c8099bcc93d2 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:51:58.358828 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625557a-63d4-4fa9-b229-81f14a8cad19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:51:58.359509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625557a-63d4-4fa9-b229-81f14a8cad19 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:51:58.359788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625557a-63d4-4fa9-b229-81f14a8cad19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:51:58.360068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625557a-63d4-4fa9-b229-81f14a8cad19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:51:58.369847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625557a-63d4-4fa9-b229-81f14a8cad19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:51:58.371298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625557a-63d4-4fa9-b229-81f14a8cad19 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:51:58.382900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1214/2420] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:51:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:52:04.874188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62441507-5d5e-47ee-9697-b3f0393fdc1a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:04.874188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62441507-5d5e-47ee-9697-b3f0393fdc1a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:04.874188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62441507-5d5e-47ee-9697-b3f0393fdc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:04.904320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-62441507-5d5e-47ee-9697-b3f0393fdc1a None None] MFA Rules not processed for user `d3e23e1c56394f1baf5d068aaa1d9e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:52:04.905937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-62441507-5d5e-47ee-9697-b3f0393fdc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:04.995445 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1207/2421] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:52:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:52:05.007202 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625557a-63d4-4fa9-b229-81f14a8cad19 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:52:05.008871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d625557a-63d4-4fa9-b229-81f14a8cad19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:05.103460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625557a-63d4-4fa9-b229-81f14a8cad19 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:52:05.109376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa39c55-dab2-4f7d-a6dd-2497e247b29e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:52:05.110089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa39c55-dab2-4f7d-a6dd-2497e247b29e service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:05.110371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa39c55-dab2-4f7d-a6dd-2497e247b29e service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:05.110647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa39c55-dab2-4f7d-a6dd-2497e247b29e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:05.120518 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa39c55-dab2-4f7d-a6dd-2497e247b29e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:52:05.122263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa39c55-dab2-4f7d-a6dd-2497e247b29e service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:52:05.137939 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1215/2422] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:52:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:52:07.328131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2a41a-aecb-4689-860a-9a3a0d2eb58f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:07.328645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2a41a-aecb-4689-860a-9a3a0d2eb58f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:07.328957 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2a41a-aecb-4689-860a-9a3a0d2eb58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:07.348746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-16c2a41a-aecb-4689-860a-9a3a0d2eb58f None None] MFA Rules not processed for user `c6b2af58b8154f35bfe2c0cabb03c0b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:52:07.350010 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-16c2a41a-aecb-4689-860a-9a3a0d2eb58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:07.368899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:07.461330 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1208/2423] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:52:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:52:08.993431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76fd82-f545-4937-acfd-8b414663a4aa None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:08.993431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76fd82-f545-4937-acfd-8b414663a4aa None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:08.993431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76fd82-f545-4937-acfd-8b414663a4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:09.015125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-1b76fd82-f545-4937-acfd-8b414663a4aa None None] MFA Rules not processed for user `d3e23e1c56394f1baf5d068aaa1d9e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:52:09.016955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1b76fd82-f545-4937-acfd-8b414663a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:09.025632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1216/2424] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:52:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:52:09.306010 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2a41a-aecb-4689-860a-9a3a0d2eb58f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:52:09.309147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-16c2a41a-aecb-4689-860a-9a3a0d2eb58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:09.321659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2a41a-aecb-4689-860a-9a3a0d2eb58f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:52:09.325553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5582fea-1c4a-46b6-b762-57a66c89988a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:52:09.326346 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5582fea-1c4a-46b6-b762-57a66c89988a service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:09.326687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5582fea-1c4a-46b6-b762-57a66c89988a service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:09.327023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5582fea-1c4a-46b6-b762-57a66c89988a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:09.330239 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c5582fea-1c4a-46b6-b762-57a66c89988a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:09.344159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5582fea-1c4a-46b6-b762-57a66c89988a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:52:09.345802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5582fea-1c4a-46b6-b762-57a66c89988a service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:52:09.357354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1209/2425] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:52:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:52:11.888297 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76fd82-f545-4937-acfd-8b414663a4aa None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:52:11.899147 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76fd82-f545-4937-acfd-8b414663a4aa None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:52:11.903319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c5084-8d2d-4c14-811f-7dd26fbdd0bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:52:11.904231 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c5084-8d2d-4c14-811f-7dd26fbdd0bd service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:11.904725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c5084-8d2d-4c14-811f-7dd26fbdd0bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:11.905202 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c5084-8d2d-4c14-811f-7dd26fbdd0bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:11.907183 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b58c5084-8d2d-4c14-811f-7dd26fbdd0bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:11.922062 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c5084-8d2d-4c14-811f-7dd26fbdd0bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:52:11.924194 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c5084-8d2d-4c14-811f-7dd26fbdd0bd service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:52:11.937003 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1217/2426] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:52:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:52:17.620211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5582fea-1c4a-46b6-b762-57a66c89988a service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:52:17.632385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5582fea-1c4a-46b6-b762-57a66c89988a service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:52:17.637923 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee552fed-48f3-4188-8fc8-ed355a9fd9d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:52:17.638570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee552fed-48f3-4188-8fc8-ed355a9fd9d2 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:17.638856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee552fed-48f3-4188-8fc8-ed355a9fd9d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:17.639137 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee552fed-48f3-4188-8fc8-ed355a9fd9d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:17.640928 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ee552fed-48f3-4188-8fc8-ed355a9fd9d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:17.699691 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee552fed-48f3-4188-8fc8-ed355a9fd9d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:52:17.708309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee552fed-48f3-4188-8fc8-ed355a9fd9d2 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:52:17.711600 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1210/2427] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:52:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:52:17.907299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949a85-d770-4004-a8b4-f5ff845efc67 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:17.907764 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949a85-d770-4004-a8b4-f5ff845efc67 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:17.907853 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90949a85-d770-4004-a8b4-f5ff845efc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:17.926460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-90949a85-d770-4004-a8b4-f5ff845efc67 None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:52:17.927682 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-90949a85-d770-4004-a8b4-f5ff845efc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:17.992575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1218/2428] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:52:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:52:18.149940 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee552fed-48f3-4188-8fc8-ed355a9fd9d2 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:52:18.151364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ee552fed-48f3-4188-8fc8-ed355a9fd9d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:18.219326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee552fed-48f3-4188-8fc8-ed355a9fd9d2 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:52:18.224891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8d05e-8864-4491-b5d3-5e4cc9d87647 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:52:18.225539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8d05e-8864-4491-b5d3-5e4cc9d87647 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:18.225854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8d05e-8864-4491-b5d3-5e4cc9d87647 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:18.226139 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8d05e-8864-4491-b5d3-5e4cc9d87647 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:18.234298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8d05e-8864-4491-b5d3-5e4cc9d87647 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:52:18.236476 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8d05e-8864-4491-b5d3-5e4cc9d87647 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:52:18.244696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1211/2429] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:52:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 22:52:27.984666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=88 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:28.243709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=87 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:36.500353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90949a85-d770-4004-a8b4-f5ff845efc67 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:52:36.502413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-90949a85-d770-4004-a8b4-f5ff845efc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:36.570998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90949a85-d770-4004-a8b4-f5ff845efc67 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:52:36.576050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d644b1d-3510-483d-b6ba-ca73b6c04a5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c9898ccf874dce88f08bebdbae02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:52:36.576704 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d644b1d-3510-483d-b6ba-ca73b6c04a5f service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:36.576987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d644b1d-3510-483d-b6ba-ca73b6c04a5f service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:36.577271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d644b1d-3510-483d-b6ba-ca73b6c04a5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:36.579066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0d644b1d-3510-483d-b6ba-ca73b6c04a5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:36.591025 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d644b1d-3510-483d-b6ba-ca73b6c04a5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:52:36.592599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d644b1d-3510-483d-b6ba-ca73b6c04a5f service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:52:36.602678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1219/2430] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:52:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:52:37.981301 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8d05e-8864-4491-b5d3-5e4cc9d87647 service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:52:37.991314 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8d05e-8864-4491-b5d3-5e4cc9d87647 service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:52:37.994939 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dc749-0f8f-42f7-8650-ba117b1916db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:52:37.995609 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dc749-0f8f-42f7-8650-ba117b1916db service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:37.995897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dc749-0f8f-42f7-8650-ba117b1916db service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:37.996175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dc749-0f8f-42f7-8650-ba117b1916db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:37.997993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-886dc749-0f8f-42f7-8650-ba117b1916db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:38.008617 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dc749-0f8f-42f7-8650-ba117b1916db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:52:38.010072 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dc749-0f8f-42f7-8650-ba117b1916db service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:52:38.017949 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1212/2431] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:52:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:52:38.860331 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da13252-198a-446b-ae2d-f09ce91ca046 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:38.860808 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da13252-198a-446b-ae2d-f09ce91ca046 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:38.861006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da13252-198a-446b-ae2d-f09ce91ca046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:38.880384 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4da13252-198a-446b-ae2d-f09ce91ca046 None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:52:38.881566 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4da13252-198a-446b-ae2d-f09ce91ca046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:38.889053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1220/2432] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:52:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:52:38.900953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dc749-0f8f-42f7-8650-ba117b1916db service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:52:38.913258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dc749-0f8f-42f7-8650-ba117b1916db service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:52:38.918334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47982dc9-073f-422d-b1ae-753e7f85165e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:52:38.918912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982dc9-073f-422d-b1ae-753e7f85165e service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:38.919197 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982dc9-073f-422d-b1ae-753e7f85165e service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:38.919508 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47982dc9-073f-422d-b1ae-753e7f85165e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:38.928526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47982dc9-073f-422d-b1ae-753e7f85165e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:52:38.930186 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47982dc9-073f-422d-b1ae-753e7f85165e service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:52:38.938175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1213/2433] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:52:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:52:48.874102 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=35 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:48.934891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=12 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:52:54.305760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a333d51-87a2-467b-b3ad-9fa0ccda9c70 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:54.306222 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a333d51-87a2-467b-b3ad-9fa0ccda9c70 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:54.306332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a333d51-87a2-467b-b3ad-9fa0ccda9c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:54.323952 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4a333d51-87a2-467b-b3ad-9fa0ccda9c70 None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:52:54.325144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4a333d51-87a2-467b-b3ad-9fa0ccda9c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:52:54.332387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1221/2434] 10.222.0.83 () {58 vars in 967 bytes} [Wed Jul 20 22:52:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:52:54.344708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47982dc9-073f-422d-b1ae-753e7f85165e service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:52:54.355881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47982dc9-073f-422d-b1ae-753e7f85165e service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:52:54.360883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee7022-714e-425e-8f13-f828c39c6f16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:52:54.361516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee7022-714e-425e-8f13-f828c39c6f16 service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:52:54.361841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee7022-714e-425e-8f13-f828c39c6f16 service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:52:54.363044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee7022-714e-425e-8f13-f828c39c6f16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:52:54.370812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee7022-714e-425e-8f13-f828c39c6f16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:52:54.372388 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee7022-714e-425e-8f13-f828c39c6f16 service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:52:54.381174 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1214/2435] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:52:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:53:04.318838 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:04.377095 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:11.359381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83f956-3fbd-4b28-81b7-3e5c2f9c65b1 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:11.359802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83f956-3fbd-4b28-81b7-3e5c2f9c65b1 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:11.359802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83f956-3fbd-4b28-81b7-3e5c2f9c65b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:11.378274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3e83f956-3fbd-4b28-81b7-3e5c2f9c65b1 None None] MFA Rules not processed for user `d3e23e1c56394f1baf5d068aaa1d9e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:11.379498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3e83f956-3fbd-4b28-81b7-3e5c2f9c65b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:11.387046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1222/2436] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:53:11.698533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee7022-714e-425e-8f13-f828c39c6f16 service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:11.708315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee7022-714e-425e-8f13-f828c39c6f16 service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:11.712686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa77bc-1657-4e60-bcb1-12e5413fdfd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:11.713362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa77bc-1657-4e60-bcb1-12e5413fdfd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:11.713648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa77bc-1657-4e60-bcb1-12e5413fdfd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:11.713962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daa77bc-1657-4e60-bcb1-12e5413fdfd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:11.715889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5daa77bc-1657-4e60-bcb1-12e5413fdfd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:11.727051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa77bc-1657-4e60-bcb1-12e5413fdfd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:11.730097 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daa77bc-1657-4e60-bcb1-12e5413fdfd8 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:11.737210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1215/2437] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:16.933320 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83f956-3fbd-4b28-81b7-3e5c2f9c65b1 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:16.936496 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3e83f956-3fbd-4b28-81b7-3e5c2f9c65b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:16.958108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83f956-3fbd-4b28-81b7-3e5c2f9c65b1 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:16.964841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7bb54-d17b-4ac3-a2ec-929d7c506781 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:16.965895 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7bb54-d17b-4ac3-a2ec-929d7c506781 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:16.970225 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7bb54-d17b-4ac3-a2ec-929d7c506781 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:16.970225 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b7bb54-d17b-4ac3-a2ec-929d7c506781 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:16.970225 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-95b7bb54-d17b-4ac3-a2ec-929d7c506781 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:16.983080 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7bb54-d17b-4ac3-a2ec-929d7c506781 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:16.985096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b7bb54-d17b-4ac3-a2ec-929d7c506781 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:17.006778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1223/2438] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:21.733089 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:24.818351 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa77bc-1657-4e60-bcb1-12e5413fdfd8 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:24.832637 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daa77bc-1657-4e60-bcb1-12e5413fdfd8 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:24.839178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6ecdf-1ac8-4242-823e-525e0d184a97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:24.839837 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6ecdf-1ac8-4242-823e-525e0d184a97 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:24.840121 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6ecdf-1ac8-4242-823e-525e0d184a97 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:24.840399 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6ecdf-1ac8-4242-823e-525e0d184a97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:24.842600 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ded6ecdf-1ac8-4242-823e-525e0d184a97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:24.855726 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6ecdf-1ac8-4242-823e-525e0d184a97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:24.857441 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6ecdf-1ac8-4242-823e-525e0d184a97 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:24.868663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1216/2439] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:27.001664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=9 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:28.204937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7bb54-d17b-4ac3-a2ec-929d7c506781 service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:28.215431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b7bb54-d17b-4ac3-a2ec-929d7c506781 service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:28.219256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c76ae-5723-4349-ae43-0fc20275e347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:28.219908 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c76ae-5723-4349-ae43-0fc20275e347 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:28.220196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c76ae-5723-4349-ae43-0fc20275e347 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:28.220478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c76ae-5723-4349-ae43-0fc20275e347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:28.222325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4c9c76ae-5723-4349-ae43-0fc20275e347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:28.235476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c76ae-5723-4349-ae43-0fc20275e347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:28.236909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c76ae-5723-4349-ae43-0fc20275e347 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:28.247409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1224/2440] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:33.044177 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6ecdf-1ac8-4242-823e-525e0d184a97 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:33.058319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6ecdf-1ac8-4242-823e-525e0d184a97 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:33.103047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8de5a-ac01-4339-b55c-9ee49675f91b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c9898ccf874dce88f08bebdbae02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:33.104699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8de5a-ac01-4339-b55c-9ee49675f91b service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:33.105347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8de5a-ac01-4339-b55c-9ee49675f91b service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:33.105940 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e8de5a-ac01-4339-b55c-9ee49675f91b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:33.108873 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e0e8de5a-ac01-4339-b55c-9ee49675f91b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:33.127521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8de5a-ac01-4339-b55c-9ee49675f91b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:33.129482 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e8de5a-ac01-4339-b55c-9ee49675f91b service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:33.145150 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1217/2441] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:33.192113 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c76ae-5723-4349-ae43-0fc20275e347 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:33.193616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4c9c76ae-5723-4349-ae43-0fc20275e347 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:33.210099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c76ae-5723-4349-ae43-0fc20275e347 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:33.216945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d43e2e-88d9-48a6-aee9-e441ad655469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:33.218224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d43e2e-88d9-48a6-aee9-e441ad655469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:33.218579 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d43e2e-88d9-48a6-aee9-e441ad655469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:33.218937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d43e2e-88d9-48a6-aee9-e441ad655469 admin admin] PATH_INFO: `/v3/users/c6b2af58b8154f35bfe2c0cabb03c0b4` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:33.220277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d43e2e-88d9-48a6-aee9-e441ad655469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6b2af58b8154f35bfe2c0cabb03c0b4)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:33.222348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d43e2e-88d9-48a6-aee9-e441ad655469 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:33.429928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-39d43e2e-88d9-48a6-aee9-e441ad655469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6b2af58b8154f35bfe2c0cabb03c0b4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:33.430444 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-39d43e2e-88d9-48a6-aee9-e441ad655469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6b2af58b8154f35bfe2c0cabb03c0b4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:33.431063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-39d43e2e-88d9-48a6-aee9-e441ad655469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6b2af58b8154f35bfe2c0cabb03c0b4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:33.445018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-39d43e2e-88d9-48a6-aee9-e441ad655469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6b2af58b8154f35bfe2c0cabb03c0b4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:33.455043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-39d43e2e-88d9-48a6-aee9-e441ad655469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6b2af58b8154f35bfe2c0cabb03c0b4'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:33.549999 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1225/2442] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:53:33 2022] DELETE /identity/v3/users/c6b2af58b8154f35bfe2c0cabb03c0b4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:33.866843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8de5a-ac01-4339-b55c-9ee49675f91b service placement] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:33.879612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e8de5a-ac01-4339-b55c-9ee49675f91b service placement] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:33.951930 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea831521-ef4e-4baa-b896-d320f20e6098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:33.952819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea831521-ef4e-4baa-b896-d320f20e6098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:33.953101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea831521-ef4e-4baa-b896-d320f20e6098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:33.953382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea831521-ef4e-4baa-b896-d320f20e6098 admin admin] PATH_INFO: `/v3/projects/c664192f021d4c5da1b59cb6bd071745` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:33.954623 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea831521-ef4e-4baa-b896-d320f20e6098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c664192f021d4c5da1b59cb6bd071745)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:33.956551 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea831521-ef4e-4baa-b896-d320f20e6098 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:34.058943 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ea831521-ef4e-4baa-b896-d320f20e6098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c664192f021d4c5da1b59cb6bd071745', 'request_id': 'req-ea831521-ef4e-4baa-b896-d320f20e6098'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:34.127159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ea831521-ef4e-4baa-b896-d320f20e6098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c664192f021d4c5da1b59cb6bd071745', 'request_id': 'req-ea831521-ef4e-4baa-b896-d320f20e6098'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:34.134055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ea831521-ef4e-4baa-b896-d320f20e6098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c664192f021d4c5da1b59cb6bd071745', 'request_id': 'req-ea831521-ef4e-4baa-b896-d320f20e6098'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:34.144999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ea831521-ef4e-4baa-b896-d320f20e6098 admin admin] The token cache is being invalidate because project c664192f021d4c5da1b59cb6bd071745 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:53:34.145227 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ea831521-ef4e-4baa-b896-d320f20e6098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:34.145897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ea831521-ef4e-4baa-b896-d320f20e6098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:34.147439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1218/2443] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:33 2022] DELETE /identity/v3/projects/c664192f021d4c5da1b59cb6bd071745 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:34.152609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7645aec-ecf6-40f4-911a-02b8b09e2031 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:34.152911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7645aec-ecf6-40f4-911a-02b8b09e2031 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:34.153195 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7645aec-ecf6-40f4-911a-02b8b09e2031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:34.171070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e7645aec-ecf6-40f4-911a-02b8b09e2031 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:34.172279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e7645aec-ecf6-40f4-911a-02b8b09e2031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:34.233639 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1226/2444] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:34.241509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b18722-458c-41a0-8d93-b72f36e65026 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:34.241838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b18722-458c-41a0-8d93-b72f36e65026 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:34.242121 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b18722-458c-41a0-8d93-b72f36e65026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:34.261973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-37b18722-458c-41a0-8d93-b72f36e65026 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:34.263175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-37b18722-458c-41a0-8d93-b72f36e65026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:34.271281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1219/2445] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:34.275498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7645aec-ecf6-40f4-911a-02b8b09e2031 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:34.285619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7645aec-ecf6-40f4-911a-02b8b09e2031 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:34.290292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b886f-7b69-41b9-b4a1-b0b27e781477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:34.290951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b886f-7b69-41b9-b4a1-b0b27e781477 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:34.291236 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b886f-7b69-41b9-b4a1-b0b27e781477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:34.291564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b886f-7b69-41b9-b4a1-b0b27e781477 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:34.292327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b886f-7b69-41b9-b4a1-b0b27e781477 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:53:34.292651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b886f-7b69-41b9-b4a1-b0b27e781477 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:34.294281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b886f-7b69-41b9-b4a1-b0b27e781477 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:34.305762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1227/2446] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:53:34.310279 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b18722-458c-41a0-8d93-b72f36e65026 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:34.319658 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b18722-458c-41a0-8d93-b72f36e65026 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:34.330663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620609f6-fd0e-4cf1-a503-f622c86dee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:34.331372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620609f6-fd0e-4cf1-a503-f622c86dee8d admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:34.331772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620609f6-fd0e-4cf1-a503-f622c86dee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:34.332049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620609f6-fd0e-4cf1-a503-f622c86dee8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:34.332788 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620609f6-fd0e-4cf1-a503-f622c86dee8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:34.334774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620609f6-fd0e-4cf1-a503-f622c86dee8d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:34.418769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1220/2447] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:34 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:53:34.431095 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b886f-7b69-41b9-b4a1-b0b27e781477 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:34.431095 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b886f-7b69-41b9-b4a1-b0b27e781477 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:34.476137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:34.489466 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec5089-09d7-426d-a073-dae8a08a19a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:34.490170 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec5089-09d7-426d-a073-dae8a08a19a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:34.490456 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec5089-09d7-426d-a073-dae8a08a19a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:34.491684 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec5089-09d7-426d-a073-dae8a08a19a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:34.491684 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec5089-09d7-426d-a073-dae8a08a19a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:34.493607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec5089-09d7-426d-a073-dae8a08a19a1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:34.581795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1228/2448] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:53:34 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:53:34.586107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620609f6-fd0e-4cf1-a503-f622c86dee8d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:34.597082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620609f6-fd0e-4cf1-a503-f622c86dee8d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:34.602861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46996875-37f5-4363-a43d-a005bebaccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:34.603614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46996875-37f5-4363-a43d-a005bebaccb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:34.603971 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46996875-37f5-4363-a43d-a005bebaccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:34.604325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46996875-37f5-4363-a43d-a005bebaccb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:34.605535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46996875-37f5-4363-a43d-a005bebaccb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:34.606643 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46996875-37f5-4363-a43d-a005bebaccb7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:34.617937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1221/2449] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:34.622154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec5089-09d7-426d-a073-dae8a08a19a1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:34.633125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec5089-09d7-426d-a073-dae8a08a19a1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:34.639085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095d086-9111-4127-827c-f88abb1ba47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:34.639765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d086-9111-4127-827c-f88abb1ba47b admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:34.640052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d086-9111-4127-827c-f88abb1ba47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:34.640330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095d086-9111-4127-827c-f88abb1ba47b admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:34.641103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095d086-9111-4127-827c-f88abb1ba47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:34.642733 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095d086-9111-4127-827c-f88abb1ba47b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:34.655125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1229/2450] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:34.661313 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46996875-37f5-4363-a43d-a005bebaccb7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:34.672076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46996875-37f5-4363-a43d-a005bebaccb7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:34.676753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d5200-1837-4807-81c5-3c651a3e3994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:34.677649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d5200-1837-4807-81c5-3c651a3e3994 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:34.677964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d5200-1837-4807-81c5-3c651a3e3994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:34.678242 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d5200-1837-4807-81c5-3c651a3e3994 admin admin] PATH_INFO: `/v3/projects/8e1374464bfd47a39762318fc3e9d5b2/users/72bbfe1e16834641a5afd9585d502563/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:34.693784 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d5200-1837-4807-81c5-3c651a3e3994 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1374464bfd47a39762318fc3e9d5b2, user_id=72bbfe1e16834641a5afd9585d502563, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:34.696536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d5200-1837-4807-81c5-3c651a3e3994 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:34.806501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:34.812927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1222/2451] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:34 2022] PUT /identity/v3/projects/8e1374464bfd47a39762318fc3e9d5b2/users/72bbfe1e16834641a5afd9585d502563/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:34.825014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bc954-003e-4097-b046-c9c5e304979c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:34.825301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bc954-003e-4097-b046-c9c5e304979c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:34.825631 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bc954-003e-4097-b046-c9c5e304979c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:34.856821 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ed2bc954-003e-4097-b046-c9c5e304979c None None] MFA Rules not processed for user `72bbfe1e16834641a5afd9585d502563`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:34.858089 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ed2bc954-003e-4097-b046-c9c5e304979c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:34.930561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1230/2452] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:34.935394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d5200-1837-4807-81c5-3c651a3e3994 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:35.003438 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d5200-1837-4807-81c5-3c651a3e3994 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:35.008580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33f9e3-4934-4c17-9a75-db0fad98f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:35.009443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33f9e3-4934-4c17-9a75-db0fad98f92d admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:35.009760 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33f9e3-4934-4c17-9a75-db0fad98f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:35.010128 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33f9e3-4934-4c17-9a75-db0fad98f92d admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:35.010851 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33f9e3-4934-4c17-9a75-db0fad98f92d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:35.012825 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33f9e3-4934-4c17-9a75-db0fad98f92d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:35.129366 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1223/2453] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:34 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:35.134093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bc954-003e-4097-b046-c9c5e304979c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:35.146023 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bc954-003e-4097-b046-c9c5e304979c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:35.206985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c385a-8136-4e66-86cb-0c55cf5bda41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:35.207687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c385a-8136-4e66-86cb-0c55cf5bda41 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:35.207973 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c385a-8136-4e66-86cb-0c55cf5bda41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:35.208248 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c385a-8136-4e66-86cb-0c55cf5bda41 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:35.208932 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c385a-8136-4e66-86cb-0c55cf5bda41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:35.210965 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c385a-8136-4e66-86cb-0c55cf5bda41 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:35.314634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1231/2454] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:53:35 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:53:35.315824 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33f9e3-4934-4c17-9a75-db0fad98f92d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:35.326879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33f9e3-4934-4c17-9a75-db0fad98f92d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:35.332079 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f75ca-ff74-4272-a81a-278a97430a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:35.332295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f75ca-ff74-4272-a81a-278a97430a3a admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:35.332584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f75ca-ff74-4272-a81a-278a97430a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:35.332864 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f75ca-ff74-4272-a81a-278a97430a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:35.333763 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f75ca-ff74-4272-a81a-278a97430a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:35.335374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f75ca-ff74-4272-a81a-278a97430a3a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:35.346415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1224/2455] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:53:35.350671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c385a-8136-4e66-86cb-0c55cf5bda41 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:35.361269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c385a-8136-4e66-86cb-0c55cf5bda41 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:35.366257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103292b-08e9-4221-87cc-b17a8250f85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:35.367164 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103292b-08e9-4221-87cc-b17a8250f85e admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:35.367447 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103292b-08e9-4221-87cc-b17a8250f85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:35.367723 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103292b-08e9-4221-87cc-b17a8250f85e admin admin] PATH_INFO: `/v3/projects/e1b96bafa1004cbdad7b909a0db4bae8/users/8ca2eb22d90f41f3b068d8e7237d777d/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:35.383390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103292b-08e9-4221-87cc-b17a8250f85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b96bafa1004cbdad7b909a0db4bae8, user_id=8ca2eb22d90f41f3b068d8e7237d777d, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:35.387123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103292b-08e9-4221-87cc-b17a8250f85e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:35.451477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1232/2456] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:35 2022] PUT /identity/v3/projects/e1b96bafa1004cbdad7b909a0db4bae8/users/8ca2eb22d90f41f3b068d8e7237d777d/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:35.455616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f75ca-ff74-4272-a81a-278a97430a3a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:35.466510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f75ca-ff74-4272-a81a-278a97430a3a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:35.528539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf345e-5c18-4715-9d0b-ceca17babab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:35.529234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf345e-5c18-4715-9d0b-ceca17babab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:35.529522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf345e-5c18-4715-9d0b-ceca17babab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:35.529896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf345e-5c18-4715-9d0b-ceca17babab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:35.530636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf345e-5c18-4715-9d0b-ceca17babab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:35.532242 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf345e-5c18-4715-9d0b-ceca17babab4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:35.543437 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1225/2457] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:35.547737 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103292b-08e9-4221-87cc-b17a8250f85e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:35.559304 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103292b-08e9-4221-87cc-b17a8250f85e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:35.567731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f948f-fd86-4e57-aa2a-8243f75ada28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:35.568699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f948f-fd86-4e57-aa2a-8243f75ada28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:35.569105 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f948f-fd86-4e57-aa2a-8243f75ada28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:35.570042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f948f-fd86-4e57-aa2a-8243f75ada28 admin admin] PATH_INFO: `/v3/projects/e1b96bafa1004cbdad7b909a0db4bae8/users/8ca2eb22d90f41f3b068d8e7237d777d/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:35.572132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f948f-fd86-4e57-aa2a-8243f75ada28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b96bafa1004cbdad7b909a0db4bae8, user_id=8ca2eb22d90f41f3b068d8e7237d777d, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:35.575537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f948f-fd86-4e57-aa2a-8243f75ada28 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:35.587398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1233/2458] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:35 2022] PUT /identity/v3/projects/e1b96bafa1004cbdad7b909a0db4bae8/users/8ca2eb22d90f41f3b068d8e7237d777d/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:35.599731 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9459928-1e16-49cb-b2c6-d1ac5a2c9854 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:35.599731 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9459928-1e16-49cb-b2c6-d1ac5a2c9854 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:35.600058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9459928-1e16-49cb-b2c6-d1ac5a2c9854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:35.631599 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d9459928-1e16-49cb-b2c6-d1ac5a2c9854 None None] MFA Rules not processed for user `8ca2eb22d90f41f3b068d8e7237d777d`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:35.633147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d9459928-1e16-49cb-b2c6-d1ac5a2c9854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:35.695211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:35.704972 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1226/2459] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:35.717634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f948f-fd86-4e57-aa2a-8243f75ada28 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:35.719357 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-d11f948f-fd86-4e57-aa2a-8243f75ada28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:35.730219 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:35.781651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f948f-fd86-4e57-aa2a-8243f75ada28 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:35.785472 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d1abdf-22fa-4888-aad2-c288d9f0032c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:35.786153 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1abdf-22fa-4888-aad2-c288d9f0032c service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:35.786436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1abdf-22fa-4888-aad2-c288d9f0032c service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:35.786711 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d1abdf-22fa-4888-aad2-c288d9f0032c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:35.799020 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1abdf-22fa-4888-aad2-c288d9f0032c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:35.799020 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d1abdf-22fa-4888-aad2-c288d9f0032c service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:35.808069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1234/2460] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:36.770819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9459928-1e16-49cb-b2c6-d1ac5a2c9854 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:36.836092 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9459928-1e16-49cb-b2c6-d1ac5a2c9854 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:36.841198 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29592c9-86e5-4098-92cc-31556d65fed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:36.842097 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29592c9-86e5-4098-92cc-31556d65fed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:36.842372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29592c9-86e5-4098-92cc-31556d65fed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:36.842641 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29592c9-86e5-4098-92cc-31556d65fed4 admin admin] PATH_INFO: `/v3/users/72bbfe1e16834641a5afd9585d502563` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:36.843863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29592c9-86e5-4098-92cc-31556d65fed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72bbfe1e16834641a5afd9585d502563)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:36.845800 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29592c9-86e5-4098-92cc-31556d65fed4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:37.019251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e29592c9-86e5-4098-92cc-31556d65fed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72bbfe1e16834641a5afd9585d502563'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:37.110131 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e29592c9-86e5-4098-92cc-31556d65fed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72bbfe1e16834641a5afd9585d502563'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:37.110761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e29592c9-86e5-4098-92cc-31556d65fed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72bbfe1e16834641a5afd9585d502563'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:37.118359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e29592c9-86e5-4098-92cc-31556d65fed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72bbfe1e16834641a5afd9585d502563'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:37.119004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e29592c9-86e5-4098-92cc-31556d65fed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72bbfe1e16834641a5afd9585d502563'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:37.142578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1227/2461] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:53:36 2022] DELETE /identity/v3/users/72bbfe1e16834641a5afd9585d502563 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:37.147139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881682b-9376-47af-9b6e-1a2080c1e6de None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:37.147673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881682b-9376-47af-9b6e-1a2080c1e6de None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:37.147673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881682b-9376-47af-9b6e-1a2080c1e6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:37.164819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8881682b-9376-47af-9b6e-1a2080c1e6de None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:37.166137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8881682b-9376-47af-9b6e-1a2080c1e6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:37.227158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1235/2462] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:37.237047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29592c9-86e5-4098-92cc-31556d65fed4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:37.238517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e29592c9-86e5-4098-92cc-31556d65fed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:37.297599 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29592c9-86e5-4098-92cc-31556d65fed4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:37.301115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0fbfe-76c6-4e4a-b958-a78683fde119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:37.301787 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0fbfe-76c6-4e4a-b958-a78683fde119 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:37.302073 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0fbfe-76c6-4e4a-b958-a78683fde119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:37.302350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0fbfe-76c6-4e4a-b958-a78683fde119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:37.311682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0fbfe-76c6-4e4a-b958-a78683fde119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:37.313107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0fbfe-76c6-4e4a-b958-a78683fde119 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:37.322497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1228/2463] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:37.752765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881682b-9376-47af-9b6e-1a2080c1e6de None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:37.754243 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8881682b-9376-47af-9b6e-1a2080c1e6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:37.769238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881682b-9376-47af-9b6e-1a2080c1e6de None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:37.774540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:37.775418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:37.775756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:37.776012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] PATH_INFO: `/v3/projects/8e1374464bfd47a39762318fc3e9d5b2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:37.777526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1374464bfd47a39762318fc3e9d5b2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:37.784510 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:37.890550 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1374464bfd47a39762318fc3e9d5b2', 'request_id': 'req-67857055-fad6-4dae-af45-327286d85d2e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:37.967450 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1374464bfd47a39762318fc3e9d5b2', 'request_id': 'req-67857055-fad6-4dae-af45-327286d85d2e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:37.973824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1374464bfd47a39762318fc3e9d5b2', 'request_id': 'req-67857055-fad6-4dae-af45-327286d85d2e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:37.985385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] The token cache is being invalidate because project 8e1374464bfd47a39762318fc3e9d5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:53:37.985681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:37.986402 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:37.987968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1236/2464] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:37 2022] DELETE /identity/v3/projects/8e1374464bfd47a39762318fc3e9d5b2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:37.992664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0fbfe-76c6-4e4a-b958-a78683fde119 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:38.004193 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0fbfe-76c6-4e4a-b958-a78683fde119 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:38.021070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:38.067148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cc9b8-9c65-4151-bcd4-fd952610595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:38.068025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cc9b8-9c65-4151-bcd4-fd952610595a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:38.068306 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cc9b8-9c65-4151-bcd4-fd952610595a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:38.068579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cc9b8-9c65-4151-bcd4-fd952610595a admin admin] PATH_INFO: `/v3/users/8ca2eb22d90f41f3b068d8e7237d777d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:38.069792 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cc9b8-9c65-4151-bcd4-fd952610595a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca2eb22d90f41f3b068d8e7237d777d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:38.071795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cc9b8-9c65-4151-bcd4-fd952610595a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:38.283566 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ca9cc9b8-9c65-4151-bcd4-fd952610595a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca2eb22d90f41f3b068d8e7237d777d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:38.376363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ca9cc9b8-9c65-4151-bcd4-fd952610595a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca2eb22d90f41f3b068d8e7237d777d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:38.376899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ca9cc9b8-9c65-4151-bcd4-fd952610595a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca2eb22d90f41f3b068d8e7237d777d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:38.384557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ca9cc9b8-9c65-4151-bcd4-fd952610595a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca2eb22d90f41f3b068d8e7237d777d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:38.385692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-ca9cc9b8-9c65-4151-bcd4-fd952610595a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca2eb22d90f41f3b068d8e7237d777d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:38.403121 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1229/2465] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:53:37 2022] DELETE /identity/v3/users/8ca2eb22d90f41f3b068d8e7237d777d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:38.664248 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:38.665662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:38.706998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:38.729618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67857055-fad6-4dae-af45-327286d85d2e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:38.780631 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c366a6b-4da5-4208-854a-fd5361408b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:38.781330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366a6b-4da5-4208-854a-fd5361408b43 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:38.781680 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366a6b-4da5-4208-854a-fd5361408b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:38.781996 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c366a6b-4da5-4208-854a-fd5361408b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:38.783827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5c366a6b-4da5-4208-854a-fd5361408b43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:38.827772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cc9b8-9c65-4151-bcd4-fd952610595a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:38.829321 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ca9cc9b8-9c65-4151-bcd4-fd952610595a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:38.852525 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c366a6b-4da5-4208-854a-fd5361408b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:38.854438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c366a6b-4da5-4208-854a-fd5361408b43 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:38.865971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1237/2466] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:38.912814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cc9b8-9c65-4151-bcd4-fd952610595a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:38.918140 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e25cab-2d3e-4b34-ad5a-9047545d1085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:38.919421 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e25cab-2d3e-4b34-ad5a-9047545d1085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:38.919421 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e25cab-2d3e-4b34-ad5a-9047545d1085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:38.919622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e25cab-2d3e-4b34-ad5a-9047545d1085 admin admin] PATH_INFO: `/v3/projects/e1b96bafa1004cbdad7b909a0db4bae8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:38.920712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e25cab-2d3e-4b34-ad5a-9047545d1085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b96bafa1004cbdad7b909a0db4bae8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:38.922664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e25cab-2d3e-4b34-ad5a-9047545d1085 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:39.029116 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:39.037157 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d8e25cab-2d3e-4b34-ad5a-9047545d1085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b96bafa1004cbdad7b909a0db4bae8', 'request_id': 'req-d8e25cab-2d3e-4b34-ad5a-9047545d1085'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:39.113637 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d8e25cab-2d3e-4b34-ad5a-9047545d1085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b96bafa1004cbdad7b909a0db4bae8', 'request_id': 'req-d8e25cab-2d3e-4b34-ad5a-9047545d1085'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:39.120832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d8e25cab-2d3e-4b34-ad5a-9047545d1085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b96bafa1004cbdad7b909a0db4bae8', 'request_id': 'req-d8e25cab-2d3e-4b34-ad5a-9047545d1085'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:39.132750 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d8e25cab-2d3e-4b34-ad5a-9047545d1085 admin admin] The token cache is being invalidate because project e1b96bafa1004cbdad7b909a0db4bae8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:53:39.133041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d8e25cab-2d3e-4b34-ad5a-9047545d1085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:39.133906 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-d8e25cab-2d3e-4b34-ad5a-9047545d1085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:39.136079 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1230/2467] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:38 2022] DELETE /identity/v3/projects/e1b96bafa1004cbdad7b909a0db4bae8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:39.141258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4b9b6-956d-41ea-a6c3-7efec3364ea6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:39.141783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4b9b6-956d-41ea-a6c3-7efec3364ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:39.142137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4b9b6-956d-41ea-a6c3-7efec3364ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:39.160970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0cb4b9b6-956d-41ea-a6c3-7efec3364ea6 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:39.162239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0cb4b9b6-956d-41ea-a6c3-7efec3364ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:39.226436 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1238/2468] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:53:39.234410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd76b25-405a-4f52-a624-7a7a770db48c None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:39.234707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd76b25-405a-4f52-a624-7a7a770db48c None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:39.234989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd76b25-405a-4f52-a624-7a7a770db48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:39.262155 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0fd76b25-405a-4f52-a624-7a7a770db48c None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:39.263929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0fd76b25-405a-4f52-a624-7a7a770db48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:39.272058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1231/2469] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:39.276652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4b9b6-956d-41ea-a6c3-7efec3364ea6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:39.286651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4b9b6-956d-41ea-a6c3-7efec3364ea6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:39.291353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e024fc-ad73-449c-8531-a87b1567bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:39.292174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e024fc-ad73-449c-8531-a87b1567bb49 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:39.292459 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e024fc-ad73-449c-8531-a87b1567bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:39.292738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e024fc-ad73-449c-8531-a87b1567bb49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:39.293509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e024fc-ad73-449c-8531-a87b1567bb49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:53:39.293848 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e024fc-ad73-449c-8531-a87b1567bb49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:39.295470 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e024fc-ad73-449c-8531-a87b1567bb49 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:39.308077 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1239/2470] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:53:39.313004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd76b25-405a-4f52-a624-7a7a770db48c None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:39.322303 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd76b25-405a-4f52-a624-7a7a770db48c None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:39.328706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a59ea-c160-465b-a8c9-ff5acd7acd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:39.329373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a59ea-c160-465b-a8c9-ff5acd7acd6c admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:39.329653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a59ea-c160-465b-a8c9-ff5acd7acd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:39.329975 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a59ea-c160-465b-a8c9-ff5acd7acd6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:39.330670 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a59ea-c160-465b-a8c9-ff5acd7acd6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:39.332656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a59ea-c160-465b-a8c9-ff5acd7acd6c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:39.441500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1232/2471] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:39 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:53:39.445539 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e024fc-ad73-449c-8531-a87b1567bb49 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:39.457208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e024fc-ad73-449c-8531-a87b1567bb49 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:39.483908 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:39.517765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8ce35-cadc-4b8c-b8c4-72b67826fd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:39.518446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8ce35-cadc-4b8c-b8c4-72b67826fd24 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:39.518729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8ce35-cadc-4b8c-b8c4-72b67826fd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:39.519004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d8ce35-cadc-4b8c-b8c4-72b67826fd24 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:39.519706 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8ce35-cadc-4b8c-b8c4-72b67826fd24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:39.521616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d8ce35-cadc-4b8c-b8c4-72b67826fd24 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:39.628339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1240/2472] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:53:39 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:53:39.629625 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a59ea-c160-465b-a8c9-ff5acd7acd6c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:39.641440 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a59ea-c160-465b-a8c9-ff5acd7acd6c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:39.646194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dbc21-d690-40f2-b861-5012f1d2c5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:39.646861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dbc21-d690-40f2-b861-5012f1d2c5ab admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:39.647158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dbc21-d690-40f2-b861-5012f1d2c5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:39.647423 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dbc21-d690-40f2-b861-5012f1d2c5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:39.648151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dbc21-d690-40f2-b861-5012f1d2c5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:39.649793 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dbc21-d690-40f2-b861-5012f1d2c5ab admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:39.662436 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1233/2473] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:39.667768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8ce35-cadc-4b8c-b8c4-72b67826fd24 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:39.678118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d8ce35-cadc-4b8c-b8c4-72b67826fd24 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:39.684110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dfe2d6-89e1-45a3-b3af-14d3a733fa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:39.684774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe2d6-89e1-45a3-b3af-14d3a733fa05 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:39.685101 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe2d6-89e1-45a3-b3af-14d3a733fa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:39.685375 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dfe2d6-89e1-45a3-b3af-14d3a733fa05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:39.686142 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfe2d6-89e1-45a3-b3af-14d3a733fa05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:39.687739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dfe2d6-89e1-45a3-b3af-14d3a733fa05 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:39.702915 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1241/2474] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:39.703238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dbc21-d690-40f2-b861-5012f1d2c5ab admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:39.713805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dbc21-d690-40f2-b861-5012f1d2c5ab admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:39.718139 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753260b-8ad4-4219-9048-047c1b9e3aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:39.719030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753260b-8ad4-4219-9048-047c1b9e3aee admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:39.719314 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753260b-8ad4-4219-9048-047c1b9e3aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:39.719594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753260b-8ad4-4219-9048-047c1b9e3aee admin admin] PATH_INFO: `/v3/projects/e7cff6941f67410e877a13a83fcaca2e/users/2127c2f5b62d48aa8d52f5bc6935f4c1/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:39.735852 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753260b-8ad4-4219-9048-047c1b9e3aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7cff6941f67410e877a13a83fcaca2e, user_id=2127c2f5b62d48aa8d52f5bc6935f4c1, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:39.738580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753260b-8ad4-4219-9048-047c1b9e3aee admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:39.837063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1234/2475] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:39 2022] PUT /identity/v3/projects/e7cff6941f67410e877a13a83fcaca2e/users/2127c2f5b62d48aa8d52f5bc6935f4c1/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:39.847598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa59f-16ca-42f0-99cd-c9a6b2fa394e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:39.847893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa59f-16ca-42f0-99cd-c9a6b2fa394e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:39.848176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455fa59f-16ca-42f0-99cd-c9a6b2fa394e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:39.876633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-455fa59f-16ca-42f0-99cd-c9a6b2fa394e None None] MFA Rules not processed for user `2127c2f5b62d48aa8d52f5bc6935f4c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:39.877890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-455fa59f-16ca-42f0-99cd-c9a6b2fa394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:39.954299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1242/2476] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:39.955572 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753260b-8ad4-4219-9048-047c1b9e3aee admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:40.027386 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753260b-8ad4-4219-9048-047c1b9e3aee admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:40.032285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050301e2-1461-4148-94c8-d094c3764292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:40.033031 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050301e2-1461-4148-94c8-d094c3764292 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:40.033385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050301e2-1461-4148-94c8-d094c3764292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:40.033763 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050301e2-1461-4148-94c8-d094c3764292 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:40.034522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050301e2-1461-4148-94c8-d094c3764292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:40.036514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050301e2-1461-4148-94c8-d094c3764292 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:40.130993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1235/2477] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:39 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:53:40.132679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fa59f-16ca-42f0-99cd-c9a6b2fa394e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:40.144483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455fa59f-16ca-42f0-99cd-c9a6b2fa394e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:40.204451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adaed2-7f08-4529-baed-e9b1ad4591ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:40.205021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adaed2-7f08-4529-baed-e9b1ad4591ec admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:40.205300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adaed2-7f08-4529-baed-e9b1ad4591ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:40.205572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92adaed2-7f08-4529-baed-e9b1ad4591ec admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:40.206302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adaed2-7f08-4529-baed-e9b1ad4591ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:40.208256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92adaed2-7f08-4529-baed-e9b1ad4591ec admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:40.284451 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1243/2478] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:53:40 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:53:40.285776 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050301e2-1461-4148-94c8-d094c3764292 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:40.297841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050301e2-1461-4148-94c8-d094c3764292 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:40.304245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50161a-be2a-4732-a722-b9152a2f932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:40.305905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50161a-be2a-4732-a722-b9152a2f932c admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:40.305905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50161a-be2a-4732-a722-b9152a2f932c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:40.305905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50161a-be2a-4732-a722-b9152a2f932c admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:40.306211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50161a-be2a-4732-a722-b9152a2f932c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:40.308211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a50161a-be2a-4732-a722-b9152a2f932c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:40.324078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1236/2479] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:40.324738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adaed2-7f08-4529-baed-e9b1ad4591ec admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:40.335332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92adaed2-7f08-4529-baed-e9b1ad4591ec admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:40.340290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a823b8-1d88-42c7-bcb4-b0a4d0d9f5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:40.341196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a823b8-1d88-42c7-bcb4-b0a4d0d9f5ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:40.341480 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a823b8-1d88-42c7-bcb4-b0a4d0d9f5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:40.341917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a823b8-1d88-42c7-bcb4-b0a4d0d9f5ca admin admin] PATH_INFO: `/v3/projects/338e1e714f264ff59d3bddc7d11f0e1d/users/ee4c6af253b74c2eb7dfa9389b27bf20/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:40.358962 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a823b8-1d88-42c7-bcb4-b0a4d0d9f5ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=338e1e714f264ff59d3bddc7d11f0e1d, user_id=ee4c6af253b74c2eb7dfa9389b27bf20, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:40.360971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a823b8-1d88-42c7-bcb4-b0a4d0d9f5ca admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:40.455756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:40.461694 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1244/2480] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:40 2022] PUT /identity/v3/projects/338e1e714f264ff59d3bddc7d11f0e1d/users/ee4c6af253b74c2eb7dfa9389b27bf20/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:40.471320 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50161a-be2a-4732-a722-b9152a2f932c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:40.483665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50161a-be2a-4732-a722-b9152a2f932c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:40.523683 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:40.551222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6691c97-670c-4a18-9b41-e522eb98c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:40.552015 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691c97-670c-4a18-9b41-e522eb98c947 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:40.552496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691c97-670c-4a18-9b41-e522eb98c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:40.552849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6691c97-670c-4a18-9b41-e522eb98c947 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:40.553659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6691c97-670c-4a18-9b41-e522eb98c947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:40.555486 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6691c97-670c-4a18-9b41-e522eb98c947 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:40.569053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1237/2481] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:40.572610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a823b8-1d88-42c7-bcb4-b0a4d0d9f5ca admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:40.587144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a823b8-1d88-42c7-bcb4-b0a4d0d9f5ca admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:40.594562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834e9da-f84f-4406-84d3-75353090652d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:40.595836 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834e9da-f84f-4406-84d3-75353090652d admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:40.597542 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834e9da-f84f-4406-84d3-75353090652d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:40.598016 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834e9da-f84f-4406-84d3-75353090652d admin admin] PATH_INFO: `/v3/projects/338e1e714f264ff59d3bddc7d11f0e1d/users/ee4c6af253b74c2eb7dfa9389b27bf20/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:40.600406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834e9da-f84f-4406-84d3-75353090652d admin admin] RBAC: Authorizing `identity:create_grant(project_id=338e1e714f264ff59d3bddc7d11f0e1d, user_id=ee4c6af253b74c2eb7dfa9389b27bf20, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:40.603293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834e9da-f84f-4406-84d3-75353090652d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:40.616570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1245/2482] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:40 2022] PUT /identity/v3/projects/338e1e714f264ff59d3bddc7d11f0e1d/users/ee4c6af253b74c2eb7dfa9389b27bf20/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:40.629149 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cb158-be28-4b58-8b84-f9f189bdc2e4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:40.629436 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cb158-be28-4b58-8b84-f9f189bdc2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:40.629735 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cb158-be28-4b58-8b84-f9f189bdc2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:40.659394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a97cb158-be28-4b58-8b84-f9f189bdc2e4 None None] MFA Rules not processed for user `ee4c6af253b74c2eb7dfa9389b27bf20`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:40.660729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a97cb158-be28-4b58-8b84-f9f189bdc2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:40.748286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1238/2483] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:40.755652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834e9da-f84f-4406-84d3-75353090652d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:40.757903 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7834e9da-f84f-4406-84d3-75353090652d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:40.825946 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834e9da-f84f-4406-84d3-75353090652d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:40.830042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8a233-9f21-45fb-9380-9ca9a91c3bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:40.830867 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8a233-9f21-45fb-9380-9ca9a91c3bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:40.831281 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8a233-9f21-45fb-9380-9ca9a91c3bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:40.831662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8a233-9f21-45fb-9380-9ca9a91c3bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:40.843032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8a233-9f21-45fb-9380-9ca9a91c3bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:40.844710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8a233-9f21-45fb-9380-9ca9a91c3bd2 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:40.856664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1246/2484] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:41.773832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cb158-be28-4b58-8b84-f9f189bdc2e4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:41.784134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cb158-be28-4b58-8b84-f9f189bdc2e4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:41.788795 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca0c3-9b24-484a-ad9c-8d8d23f2b0ae tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee4c6af253b74c2eb7dfa9389b27bf20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338e1e714f264ff59d3bddc7d11f0e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:41.789458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca0c3-9b24-484a-ad9c-8d8d23f2b0ae tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:41.789774 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca0c3-9b24-484a-ad9c-8d8d23f2b0ae tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:41.790066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ca0c3-9b24-484a-ad9c-8d8d23f2b0ae tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:41.790824 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ca0c3-9b24-484a-ad9c-8d8d23f2b0ae tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:53:41.792118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ca0c3-9b24-484a-ad9c-8d8d23f2b0ae tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:41.793758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ca0c3-9b24-484a-ad9c-8d8d23f2b0ae tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:41.805596 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1239/2485] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:53:41.810385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8a233-9f21-45fb-9380-9ca9a91c3bd2 service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:41.821956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8a233-9f21-45fb-9380-9ca9a91c3bd2 service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:41.834029 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67df74-18a6-47ec-b41b-9271e913074e tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee4c6af253b74c2eb7dfa9389b27bf20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338e1e714f264ff59d3bddc7d11f0e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:41.834029 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67df74-18a6-47ec-b41b-9271e913074e tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:41.834029 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67df74-18a6-47ec-b41b-9271e913074e tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:41.834296 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67df74-18a6-47ec-b41b-9271e913074e tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:41.834296 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67df74-18a6-47ec-b41b-9271e913074e tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:41.834296 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67df74-18a6-47ec-b41b-9271e913074e tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:41.920679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1247/2486] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:41 2022] POST /identity/v3/projects => generated 355 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:41.923564 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca0c3-9b24-484a-ad9c-8d8d23f2b0ae tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:41.939873 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ca0c3-9b24-484a-ad9c-8d8d23f2b0ae tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:42.025042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183fbb0-783f-4900-a4b5-107ab614c527 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee4c6af253b74c2eb7dfa9389b27bf20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338e1e714f264ff59d3bddc7d11f0e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:42.025911 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183fbb0-783f-4900-a4b5-107ab614c527 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:42.026271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183fbb0-783f-4900-a4b5-107ab614c527 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:42.026496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e183fbb0-783f-4900-a4b5-107ab614c527 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:42.027241 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183fbb0-783f-4900-a4b5-107ab614c527 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:53:42.027577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183fbb0-783f-4900-a4b5-107ab614c527 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:42.029175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e183fbb0-783f-4900-a4b5-107ab614c527 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:42.049897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1240/2487] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:53:42.090964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67df74-18a6-47ec-b41b-9271e913074e tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:42.102106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67df74-18a6-47ec-b41b-9271e913074e tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:42.108051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee4c6af253b74c2eb7dfa9389b27bf20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338e1e714f264ff59d3bddc7d11f0e1d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:42.108931 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:42.109221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:42.109502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] PATH_INFO: `/v3/projects/5dd221e67d374fb49552190edaf08ef6` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:42.110816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5dd221e67d374fb49552190edaf08ef6)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:42.112742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:42.231385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dd221e67d374fb49552190edaf08ef6', 'request_id': 'req-81930ba9-bad2-4151-9391-e637f8c63cd0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:42.306285 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dd221e67d374fb49552190edaf08ef6', 'request_id': 'req-81930ba9-bad2-4151-9391-e637f8c63cd0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:42.318912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dd221e67d374fb49552190edaf08ef6', 'request_id': 'req-81930ba9-bad2-4151-9391-e637f8c63cd0'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:42.347336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] The token cache is being invalidate because project 5dd221e67d374fb49552190edaf08ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:53:42.347336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:42.347336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:42.347336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1248/2488] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:42 2022] DELETE /identity/v3/projects/5dd221e67d374fb49552190edaf08ef6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:43.002509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183fbb0-783f-4900-a4b5-107ab614c527 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:43.004422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e183fbb0-783f-4900-a4b5-107ab614c527 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:43.042302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:43.043836 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:43.052717 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=100 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:43.075736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e183fbb0-783f-4900-a4b5-107ab614c527 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:43.105326 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:43.119108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81930ba9-bad2-4151-9391-e637f8c63cd0 tempest-VolumeQuotaClassesTest-1726211762 tempest-VolumeQuotaClassesTest-1726211762-project-admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:43.125150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa6b5a-13d2-40f7-bf3c-2073688c4962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:43.126076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa6b5a-13d2-40f7-bf3c-2073688c4962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:43.127125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa6b5a-13d2-40f7-bf3c-2073688c4962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:43.127125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa6b5a-13d2-40f7-bf3c-2073688c4962 admin admin] PATH_INFO: `/v3/users/2127c2f5b62d48aa8d52f5bc6935f4c1` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:43.127884 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa6b5a-13d2-40f7-bf3c-2073688c4962 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2127c2f5b62d48aa8d52f5bc6935f4c1)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:43.129857 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa6b5a-13d2-40f7-bf3c-2073688c4962 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:43.132103 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec3d80-cdd3-4272-9761-7c137cffc191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:43.133276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec3d80-cdd3-4272-9761-7c137cffc191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:43.133554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec3d80-cdd3-4272-9761-7c137cffc191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:43.133870 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec3d80-cdd3-4272-9761-7c137cffc191 admin admin] PATH_INFO: `/v3/users/f6a84e6c6706453cb3973dd89c2ea1e1` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:43.136261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec3d80-cdd3-4272-9761-7c137cffc191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a84e6c6706453cb3973dd89c2ea1e1)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:43.138325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec3d80-cdd3-4272-9761-7c137cffc191 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:43.310091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-75fa6b5a-13d2-40f7-bf3c-2073688c4962 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2127c2f5b62d48aa8d52f5bc6935f4c1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:43.310657 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-75fa6b5a-13d2-40f7-bf3c-2073688c4962 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2127c2f5b62d48aa8d52f5bc6935f4c1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:43.311254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-75fa6b5a-13d2-40f7-bf3c-2073688c4962 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2127c2f5b62d48aa8d52f5bc6935f4c1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:43.323950 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-75fa6b5a-13d2-40f7-bf3c-2073688c4962 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2127c2f5b62d48aa8d52f5bc6935f4c1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:43.330690 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-75fa6b5a-13d2-40f7-bf3c-2073688c4962 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2127c2f5b62d48aa8d52f5bc6935f4c1'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:43.333583 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-37ec3d80-cdd3-4272-9761-7c137cffc191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a84e6c6706453cb3973dd89c2ea1e1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:43.410110 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1249/2489] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:53:43 2022] DELETE /identity/v3/users/2127c2f5b62d48aa8d52f5bc6935f4c1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:43.414469 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7847ce3-7286-431c-a016-3570c5b37336 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:43.414766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7847ce3-7286-431c-a016-3570c5b37336 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:43.415053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7847ce3-7286-431c-a016-3570c5b37336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:43.432650 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a7847ce3-7286-431c-a016-3570c5b37336 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:43.433929 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a7847ce3-7286-431c-a016-3570c5b37336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:43.456194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-37ec3d80-cdd3-4272-9761-7c137cffc191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a84e6c6706453cb3973dd89c2ea1e1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:43.456904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-37ec3d80-cdd3-4272-9761-7c137cffc191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a84e6c6706453cb3973dd89c2ea1e1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:43.465023 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-37ec3d80-cdd3-4272-9761-7c137cffc191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a84e6c6706453cb3973dd89c2ea1e1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:43.465696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-37ec3d80-cdd3-4272-9761-7c137cffc191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a84e6c6706453cb3973dd89c2ea1e1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:43.485209 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1241/2490] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:53:43 2022] DELETE /identity/v3/users/f6a84e6c6706453cb3973dd89c2ea1e1 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:43.491938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1250/2491] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:53:43.504465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec3d80-cdd3-4272-9761-7c137cffc191 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:43.505972 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-37ec3d80-cdd3-4272-9761-7c137cffc191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:43.569664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec3d80-cdd3-4272-9761-7c137cffc191 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:43.574385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3038970-a62b-4c87-b63f-ad95e010ff23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:43.575053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3038970-a62b-4c87-b63f-ad95e010ff23 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:43.575434 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3038970-a62b-4c87-b63f-ad95e010ff23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:43.575697 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3038970-a62b-4c87-b63f-ad95e010ff23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:43.595622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:43.640703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3038970-a62b-4c87-b63f-ad95e010ff23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:43.642227 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3038970-a62b-4c87-b63f-ad95e010ff23 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:43.652804 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1242/2492] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:43.749663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7847ce3-7286-431c-a016-3570c5b37336 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:43.749663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a7847ce3-7286-431c-a016-3570c5b37336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:43.762433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7847ce3-7286-431c-a016-3570c5b37336 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:43.767106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:43.767989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:43.768278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:43.768559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] PATH_INFO: `/v3/projects/c037542d907a458fa792a3d55759c787` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:43.770135 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c037542d907a458fa792a3d55759c787)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:43.772070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:43.907477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c037542d907a458fa792a3d55759c787', 'request_id': 'req-ae1d88d5-672f-47f0-8b09-e91e3efed14a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.021811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c037542d907a458fa792a3d55759c787', 'request_id': 'req-ae1d88d5-672f-47f0-8b09-e91e3efed14a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.028385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c037542d907a458fa792a3d55759c787', 'request_id': 'req-ae1d88d5-672f-47f0-8b09-e91e3efed14a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.029503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:44.040796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] The token cache is being invalidate because project c037542d907a458fa792a3d55759c787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:53:44.041120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.041822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.043479 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1251/2493] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:43 2022] DELETE /identity/v3/projects/c037542d907a458fa792a3d55759c787 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:44.048394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43be414-419b-4b13-ae2b-06e5dc57f9ca None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:44.048839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43be414-419b-4b13-ae2b-06e5dc57f9ca None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:44.048957 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43be414-419b-4b13-ae2b-06e5dc57f9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:44.068502 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a43be414-419b-4b13-ae2b-06e5dc57f9ca None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:44.070021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a43be414-419b-4b13-ae2b-06e5dc57f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:44.129502 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:44.137693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:44.151944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1243/2494] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:44.159747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff946a-7550-4ef8-8598-048478103f04 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:44.160087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff946a-7550-4ef8-8598-048478103f04 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:44.160414 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff946a-7550-4ef8-8598-048478103f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:44.179683 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f9ff946a-7550-4ef8-8598-048478103f04 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:44.181564 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f9ff946a-7550-4ef8-8598-048478103f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:44.190016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1244/2495] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:44.193940 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff946a-7550-4ef8-8598-048478103f04 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:44.203450 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff946a-7550-4ef8-8598-048478103f04 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:44.208822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2f272-802e-4fdf-8685-09a4fcbb16ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:44.209527 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2f272-802e-4fdf-8685-09a4fcbb16ca admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:44.209921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2f272-802e-4fdf-8685-09a4fcbb16ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:44.210261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf2f272-802e-4fdf-8685-09a4fcbb16ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:44.211056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2f272-802e-4fdf-8685-09a4fcbb16ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:53:44.211550 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2f272-802e-4fdf-8685-09a4fcbb16ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:44.214069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf2f272-802e-4fdf-8685-09a4fcbb16ca admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:44.217882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d88d5-672f-47f0-8b09-e91e3efed14a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:44.223556 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:44.224614 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:44.225063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:44.225339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] PATH_INFO: `/v3/projects/e7cff6941f67410e877a13a83fcaca2e` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:44.226596 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7cff6941f67410e877a13a83fcaca2e)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:44.231978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1245/2496] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:53:44.232130 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:44.234123 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2f272-802e-4fdf-8685-09a4fcbb16ca admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:44.243824 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf2f272-802e-4fdf-8685-09a4fcbb16ca admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:44.252658 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4ed9-c70b-42f2-8821-ddec3c2cfe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:44.253327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4ed9-c70b-42f2-8821-ddec3c2cfe6d admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:44.253610 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4ed9-c70b-42f2-8821-ddec3c2cfe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:44.253916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4ed9-c70b-42f2-8821-ddec3c2cfe6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:44.254613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc4ed9-c70b-42f2-8821-ddec3c2cfe6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:44.256546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc4ed9-c70b-42f2-8821-ddec3c2cfe6d admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:44.340583 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1246/2497] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:44 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:53:44.344664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4ed9-c70b-42f2-8821-ddec3c2cfe6d admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:44.351432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7cff6941f67410e877a13a83fcaca2e', 'request_id': 'req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.407791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4ed9-c70b-42f2-8821-ddec3c2cfe6d admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:44.413569 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e5b81-98bf-4764-88f7-c9c30d51c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:44.414286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e5b81-98bf-4764-88f7-c9c30d51c7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:44.414570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e5b81-98bf-4764-88f7-c9c30d51c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:44.414845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e5b81-98bf-4764-88f7-c9c30d51c7d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:44.415613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e5b81-98bf-4764-88f7-c9c30d51c7d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:44.418256 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e5b81-98bf-4764-88f7-c9c30d51c7d8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:44.450565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7cff6941f67410e877a13a83fcaca2e', 'request_id': 'req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.457465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7cff6941f67410e877a13a83fcaca2e', 'request_id': 'req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.468763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] The token cache is being invalidate because project e7cff6941f67410e877a13a83fcaca2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:53:44.469322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.470190 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.472056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1252/2498] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:44 2022] DELETE /identity/v3/projects/e7cff6941f67410e877a13a83fcaca2e => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:44.476197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:44.477577 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:44.539627 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1247/2499] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:53:44 2022] POST /identity/v3/users => generated 303 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:44.540729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e5b81-98bf-4764-88f7-c9c30d51c7d8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:44.542411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41f79b-70ee-4110-b84d-b39a0ac6ee23 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:44.543077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f07e5b81-98bf-4764-88f7-c9c30d51c7d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:44.547126 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8d225-3dcc-4e6c-9b5c-6578a436fa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:44.548030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d225-3dcc-4e6c-9b5c-6578a436fa2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:44.548317 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d225-3dcc-4e6c-9b5c-6578a436fa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:44.548683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8d225-3dcc-4e6c-9b5c-6578a436fa2b admin admin] PATH_INFO: `/v3/users/ee4c6af253b74c2eb7dfa9389b27bf20` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:44.549892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8d225-3dcc-4e6c-9b5c-6578a436fa2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4c6af253b74c2eb7dfa9389b27bf20)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:44.551722 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:44.551901 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8d225-3dcc-4e6c-9b5c-6578a436fa2b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:44.555864 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e5b81-98bf-4764-88f7-c9c30d51c7d8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:44.561968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3216df-9331-411d-be22-97948e9d5c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:44.562641 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3216df-9331-411d-be22-97948e9d5c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:44.562924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3216df-9331-411d-be22-97948e9d5c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:44.563203 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3216df-9331-411d-be22-97948e9d5c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:44.563935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3216df-9331-411d-be22-97948e9d5c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:44.566183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3216df-9331-411d-be22-97948e9d5c49 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:44.576611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1248/2500] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:53:44.580367 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3216df-9331-411d-be22-97948e9d5c49 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:44.590837 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3216df-9331-411d-be22-97948e9d5c49 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:44.596036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda5705-b992-46ad-83cc-0eb762ec6110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:44.596788 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda5705-b992-46ad-83cc-0eb762ec6110 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:44.597079 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda5705-b992-46ad-83cc-0eb762ec6110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:44.597857 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda5705-b992-46ad-83cc-0eb762ec6110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:44.598283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda5705-b992-46ad-83cc-0eb762ec6110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:44.599893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda5705-b992-46ad-83cc-0eb762ec6110 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:44.611500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1249/2501] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:53:44.615599 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda5705-b992-46ad-83cc-0eb762ec6110 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:44.625012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda5705-b992-46ad-83cc-0eb762ec6110 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:44.630255 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0102de8-db7c-4b4d-b415-b52d6691b404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:44.631125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0102de8-db7c-4b4d-b415-b52d6691b404 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:44.631409 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0102de8-db7c-4b4d-b415-b52d6691b404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:44.631877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0102de8-db7c-4b4d-b415-b52d6691b404 admin admin] PATH_INFO: `/v3/projects/9437b9eea8424cedbdc0c0eec61a9809/users/b43de90ef31c4a44abd78b5132e3a118/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:44.647812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0102de8-db7c-4b4d-b415-b52d6691b404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9437b9eea8424cedbdc0c0eec61a9809, user_id=b43de90ef31c4a44abd78b5132e3a118, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:44.651058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0102de8-db7c-4b4d-b415-b52d6691b404 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:44.683053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:44.773919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1250/2502] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:44 2022] PUT /identity/v3/projects/9437b9eea8424cedbdc0c0eec61a9809/users/b43de90ef31c4a44abd78b5132e3a118/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:44.784311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14683cee-f0f6-4865-ac27-6fe65807d66b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:44.784601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14683cee-f0f6-4865-ac27-6fe65807d66b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:44.784878 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14683cee-f0f6-4865-ac27-6fe65807d66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:44.811196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5bf8d225-3dcc-4e6c-9b5c-6578a436fa2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4c6af253b74c2eb7dfa9389b27bf20'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.811851 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5bf8d225-3dcc-4e6c-9b5c-6578a436fa2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4c6af253b74c2eb7dfa9389b27bf20'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.812476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5bf8d225-3dcc-4e6c-9b5c-6578a436fa2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4c6af253b74c2eb7dfa9389b27bf20'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.813164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-14683cee-f0f6-4865-ac27-6fe65807d66b None None] MFA Rules not processed for user `b43de90ef31c4a44abd78b5132e3a118`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:44.814404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-14683cee-f0f6-4865-ac27-6fe65807d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:44.824579 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5bf8d225-3dcc-4e6c-9b5c-6578a436fa2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4c6af253b74c2eb7dfa9389b27bf20'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.831664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5bf8d225-3dcc-4e6c-9b5c-6578a436fa2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4c6af253b74c2eb7dfa9389b27bf20'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:44.879744 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1251/2503] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:44 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:53:44.884236 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14683cee-f0f6-4865-ac27-6fe65807d66b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:44.886126 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-14683cee-f0f6-4865-ac27-6fe65807d66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:44.912245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1253/2504] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:53:44 2022] DELETE /identity/v3/users/ee4c6af253b74c2eb7dfa9389b27bf20 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:44.960854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14683cee-f0f6-4865-ac27-6fe65807d66b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:45.015000 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:45.021968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ad021-9178-4ac3-b092-8edb16def4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:45.022638 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ad021-9178-4ac3-b092-8edb16def4db admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:45.022924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ad021-9178-4ac3-b092-8edb16def4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:45.023202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ad021-9178-4ac3-b092-8edb16def4db admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:45.023898 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ad021-9178-4ac3-b092-8edb16def4db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:45.026626 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ad021-9178-4ac3-b092-8edb16def4db admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:45.115863 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1252/2505] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:44 2022] POST /identity/v3/projects => generated 405 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:45.119959 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8d225-3dcc-4e6c-9b5c-6578a436fa2b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:45.130844 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8d225-3dcc-4e6c-9b5c-6578a436fa2b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:45.216106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced14d16-8a4d-4953-bfae-9fe5a7eb0ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:45.216987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced14d16-8a4d-4953-bfae-9fe5a7eb0ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:45.217489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced14d16-8a4d-4953-bfae-9fe5a7eb0ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:45.217913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced14d16-8a4d-4953-bfae-9fe5a7eb0ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:45.218736 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced14d16-8a4d-4953-bfae-9fe5a7eb0ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:45.220808 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced14d16-8a4d-4953-bfae-9fe5a7eb0ff8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:45.304812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1254/2506] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:53:45 2022] POST /identity/v3/users => generated 309 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:45.309224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ad021-9178-4ac3-b092-8edb16def4db admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:45.319898 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ad021-9178-4ac3-b092-8edb16def4db admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:45.326424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90236d37-a85a-493a-8217-3bb3f6c441e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:45.326669 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236d37-a85a-493a-8217-3bb3f6c441e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:45.326951 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236d37-a85a-493a-8217-3bb3f6c441e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:45.327232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90236d37-a85a-493a-8217-3bb3f6c441e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:45.328122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90236d37-a85a-493a-8217-3bb3f6c441e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:45.329896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90236d37-a85a-493a-8217-3bb3f6c441e8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:45.341273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1253/2507] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:45.345500 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced14d16-8a4d-4953-bfae-9fe5a7eb0ff8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:45.355756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced14d16-8a4d-4953-bfae-9fe5a7eb0ff8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:45.360656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11920026-fa4c-4ce3-ba80-ff197f407c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:45.361543 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11920026-fa4c-4ce3-ba80-ff197f407c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:45.361867 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11920026-fa4c-4ce3-ba80-ff197f407c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:45.362141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11920026-fa4c-4ce3-ba80-ff197f407c39 admin admin] PATH_INFO: `/v3/projects/935bf94f16354e498a169d5d47fb7baf/users/e3829f65cf18494486aa2a772b4af150/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:45.380620 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90236d37-a85a-493a-8217-3bb3f6c441e8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:45.382625 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11920026-fa4c-4ce3-ba80-ff197f407c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935bf94f16354e498a169d5d47fb7baf, user_id=e3829f65cf18494486aa2a772b4af150, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:45.382839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-90236d37-a85a-493a-8217-3bb3f6c441e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:45.386372 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11920026-fa4c-4ce3-ba80-ff197f407c39 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:45.404922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90236d37-a85a-493a-8217-3bb3f6c441e8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:45.409825 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:45.410781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:45.410949 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:45.411274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3 admin admin] PATH_INFO: `/v3/projects/338e1e714f264ff59d3bddc7d11f0e1d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:45.412461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=338e1e714f264ff59d3bddc7d11f0e1d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:45.414459 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:45.459343 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1255/2508] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:45 2022] PUT /identity/v3/projects/935bf94f16354e498a169d5d47fb7baf/users/e3829f65cf18494486aa2a772b4af150/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:45.463364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11920026-fa4c-4ce3-ba80-ff197f407c39 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:45.526806 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11920026-fa4c-4ce3-ba80-ff197f407c39 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:45.531797 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681c22e-0a53-40b4-b988-9bbedd0fef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:45.532464 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681c22e-0a53-40b4-b988-9bbedd0fef9d admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:45.532751 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681c22e-0a53-40b4-b988-9bbedd0fef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:45.533061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5681c22e-0a53-40b4-b988-9bbedd0fef9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:45.533827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681c22e-0a53-40b4-b988-9bbedd0fef9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:45.535434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5681c22e-0a53-40b4-b988-9bbedd0fef9d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:45.545601 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1256/2509] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:45.549802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681c22e-0a53-40b4-b988-9bbedd0fef9d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:45.555913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:45.561032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '338e1e714f264ff59d3bddc7d11f0e1d', 'request_id': 'req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:45.561228 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5681c22e-0a53-40b4-b988-9bbedd0fef9d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:45.627658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67126af4-ba78-4855-96af-8027fc452076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:45.629257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67126af4-ba78-4855-96af-8027fc452076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:45.629890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67126af4-ba78-4855-96af-8027fc452076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:45.630174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67126af4-ba78-4855-96af-8027fc452076 admin admin] PATH_INFO: `/v3/projects/935bf94f16354e498a169d5d47fb7baf/users/e3829f65cf18494486aa2a772b4af150/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:45.632605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67126af4-ba78-4855-96af-8027fc452076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935bf94f16354e498a169d5d47fb7baf, user_id=e3829f65cf18494486aa2a772b4af150, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:45.636134 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67126af4-ba78-4855-96af-8027fc452076 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:45.647579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '338e1e714f264ff59d3bddc7d11f0e1d', 'request_id': 'req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:45.656064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '338e1e714f264ff59d3bddc7d11f0e1d', 'request_id': 'req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:45.656254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1257/2510] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:45 2022] PUT /identity/v3/projects/935bf94f16354e498a169d5d47fb7baf/users/e3829f65cf18494486aa2a772b4af150/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:45.667151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3 admin admin] The token cache is being invalidate because project 338e1e714f264ff59d3bddc7d11f0e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:53:45.667449 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:45.668151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-52d7e54d-3b5d-4803-96bc-fc6ce48553b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:45.673196 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1254/2511] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:45 2022] DELETE /identity/v3/projects/338e1e714f264ff59d3bddc7d11f0e1d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:45.676452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c75c-cb86-4d77-ba11-4850d32f9490 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:45.677128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c75c-cb86-4d77-ba11-4850d32f9490 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:45.677512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8c75c-cb86-4d77-ba11-4850d32f9490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:45.683757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61704f-e62d-4508-8a68-6805fe8c5ee7 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:45.685810 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61704f-e62d-4508-8a68-6805fe8c5ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:45.686165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de61704f-e62d-4508-8a68-6805fe8c5ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:45.708049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-86c8c75c-cb86-4d77-ba11-4850d32f9490 None None] MFA Rules not processed for user `e3829f65cf18494486aa2a772b4af150`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:45.709280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-86c8c75c-cb86-4d77-ba11-4850d32f9490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:45.711599 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-de61704f-e62d-4508-8a68-6805fe8c5ee7 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:45.712787 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-de61704f-e62d-4508-8a68-6805fe8c5ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:45.788818 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1255/2512] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:45.796392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1258/2513] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:45 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:45.797178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5a8d0-51fe-4101-bdac-317f28b5d9be None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:45.797513 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5a8d0-51fe-4101-bdac-317f28b5d9be None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:45.807632 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d5a8d0-51fe-4101-bdac-317f28b5d9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:45.816389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c6d5a8d0-51fe-4101-bdac-317f28b5d9be None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:45.817541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c6d5a8d0-51fe-4101-bdac-317f28b5d9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:45.817825 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8c75c-cb86-4d77-ba11-4850d32f9490 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:45.820118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-86c8c75c-cb86-4d77-ba11-4850d32f9490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:45.826252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1256/2514] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:45.830191 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5a8d0-51fe-4101-bdac-317f28b5d9be None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:45.842914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d5a8d0-51fe-4101-bdac-317f28b5d9be None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:45.854875 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ded84-2fcd-4d17-bad9-d700efc0d16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:45.855389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ded84-2fcd-4d17-bad9-d700efc0d16b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:45.855632 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ded84-2fcd-4d17-bad9-d700efc0d16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:45.855916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ded84-2fcd-4d17-bad9-d700efc0d16b admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:45.856668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ded84-2fcd-4d17-bad9-d700efc0d16b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:53:45.856983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ded84-2fcd-4d17-bad9-d700efc0d16b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:45.858680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ded84-2fcd-4d17-bad9-d700efc0d16b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:45.876938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1257/2515] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:53:45.881237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ded84-2fcd-4d17-bad9-d700efc0d16b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:45.894170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ded84-2fcd-4d17-bad9-d700efc0d16b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:45.900055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d77670-6b5b-4c79-b2c9-7e74d002cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:45.901464 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d77670-6b5b-4c79-b2c9-7e74d002cab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:45.901779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d77670-6b5b-4c79-b2c9-7e74d002cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:45.902183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d77670-6b5b-4c79-b2c9-7e74d002cab4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:45.902890 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d77670-6b5b-4c79-b2c9-7e74d002cab4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:45.905599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8c75c-cb86-4d77-ba11-4850d32f9490 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:45.905842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d77670-6b5b-4c79-b2c9-7e74d002cab4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:45.909492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab5db-1f8e-4c4e-b3a0-29b21ea1a79f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:45.910184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab5db-1f8e-4c4e-b3a0-29b21ea1a79f service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:45.910473 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab5db-1f8e-4c4e-b3a0-29b21ea1a79f service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:45.910759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab5db-1f8e-4c4e-b3a0-29b21ea1a79f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:45.922091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab5db-1f8e-4c4e-b3a0-29b21ea1a79f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:45.923760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab5db-1f8e-4c4e-b3a0-29b21ea1a79f service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:45.935678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1259/2516] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:45 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:46.034968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1258/2517] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:45 2022] POST /identity/v3/projects => generated 401 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:46.039380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab5db-1f8e-4c4e-b3a0-29b21ea1a79f service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:46.052300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab5db-1f8e-4c4e-b3a0-29b21ea1a79f service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:46.086623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:46.093232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d77670-6b5b-4c79-b2c9-7e74d002cab4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:46.095173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-75d77670-6b5b-4c79-b2c9-7e74d002cab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:46.108978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:46.121609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38ed5d-89fe-4a28-9e29-bfd8ed120e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:46.122394 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38ed5d-89fe-4a28-9e29-bfd8ed120e15 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:46.122679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38ed5d-89fe-4a28-9e29-bfd8ed120e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:46.123007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38ed5d-89fe-4a28-9e29-bfd8ed120e15 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:46.123854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38ed5d-89fe-4a28-9e29-bfd8ed120e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:46.125823 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38ed5d-89fe-4a28-9e29-bfd8ed120e15 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:46.161219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d77670-6b5b-4c79-b2c9-7e74d002cab4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:46.165769 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488b7fd-3c95-425b-b059-6c71d4919860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:46.167211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488b7fd-3c95-425b-b059-6c71d4919860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:46.167492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488b7fd-3c95-425b-b059-6c71d4919860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:46.167768 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488b7fd-3c95-425b-b059-6c71d4919860 admin admin] PATH_INFO: `/v3/users/b43de90ef31c4a44abd78b5132e3a118` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:46.168986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488b7fd-3c95-425b-b059-6c71d4919860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b43de90ef31c4a44abd78b5132e3a118)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:46.170954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488b7fd-3c95-425b-b059-6c71d4919860 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:46.231165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1260/2518] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:53:46 2022] POST /identity/v3/users => generated 301 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:53:46.235137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38ed5d-89fe-4a28-9e29-bfd8ed120e15 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:46.244521 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38ed5d-89fe-4a28-9e29-bfd8ed120e15 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:46.249435 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c80ff0-8133-41f0-b86f-5f1a817a1721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:46.250114 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80ff0-8133-41f0-b86f-5f1a817a1721 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:46.250400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80ff0-8133-41f0-b86f-5f1a817a1721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:46.250678 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80ff0-8133-41f0-b86f-5f1a817a1721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:46.251400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c80ff0-8133-41f0-b86f-5f1a817a1721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:46.252984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c80ff0-8133-41f0-b86f-5f1a817a1721 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:46.263304 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1261/2519] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:53:46.267220 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c80ff0-8133-41f0-b86f-5f1a817a1721 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:46.277582 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c80ff0-8133-41f0-b86f-5f1a817a1721 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:46.282353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349c92f-39e7-4257-8b55-e65bcf062535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:46.282978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349c92f-39e7-4257-8b55-e65bcf062535 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:46.283263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349c92f-39e7-4257-8b55-e65bcf062535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:46.283541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349c92f-39e7-4257-8b55-e65bcf062535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:46.284270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349c92f-39e7-4257-8b55-e65bcf062535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:46.285940 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349c92f-39e7-4257-8b55-e65bcf062535 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:46.298318 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1262/2520] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:46.302155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349c92f-39e7-4257-8b55-e65bcf062535 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:46.311583 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349c92f-39e7-4257-8b55-e65bcf062535 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:46.316145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd78d2-08f4-40b1-8863-441b9fba3e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:46.316981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd78d2-08f4-40b1-8863-441b9fba3e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:46.317261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd78d2-08f4-40b1-8863-441b9fba3e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:46.317537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd78d2-08f4-40b1-8863-441b9fba3e55 admin admin] PATH_INFO: `/v3/projects/fd93eb9527a14c7c83441c4240d17d13/users/b6ddd20ed48e4bf390b0c261ef887d4b/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:46.334574 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd78d2-08f4-40b1-8863-441b9fba3e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd93eb9527a14c7c83441c4240d17d13, user_id=b6ddd20ed48e4bf390b0c261ef887d4b, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:46.337340 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd78d2-08f4-40b1-8863-441b9fba3e55 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:46.573916 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e488b7fd-3c95-425b-b059-6c71d4919860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b43de90ef31c4a44abd78b5132e3a118'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:46.642313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1263/2521] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:46 2022] PUT /identity/v3/projects/fd93eb9527a14c7c83441c4240d17d13/users/b6ddd20ed48e4bf390b0c261ef887d4b/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:46.652729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f59cc-b5dd-4f8b-a77a-b3202a586d88 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:46.653134 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f59cc-b5dd-4f8b-a77a-b3202a586d88 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:46.653423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f59cc-b5dd-4f8b-a77a-b3202a586d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:46.676240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e488b7fd-3c95-425b-b059-6c71d4919860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b43de90ef31c4a44abd78b5132e3a118'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:46.677576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e488b7fd-3c95-425b-b059-6c71d4919860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b43de90ef31c4a44abd78b5132e3a118'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:46.684803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-e53f59cc-b5dd-4f8b-a77a-b3202a586d88 None None] MFA Rules not processed for user `b6ddd20ed48e4bf390b0c261ef887d4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:46.698274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e53f59cc-b5dd-4f8b-a77a-b3202a586d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:46.698430 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e488b7fd-3c95-425b-b059-6c71d4919860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b43de90ef31c4a44abd78b5132e3a118'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:46.698430 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-e488b7fd-3c95-425b-b059-6c71d4919860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b43de90ef31c4a44abd78b5132e3a118'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:46.709539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1259/2522] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:53:46 2022] DELETE /identity/v3/users/b43de90ef31c4a44abd78b5132e3a118 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:46.715342 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80dac-e3b3-460a-9e1a-a883c6eda1ac None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:46.715634 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80dac-e3b3-460a-9e1a-a883c6eda1ac None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:46.715918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a80dac-e3b3-460a-9e1a-a883c6eda1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:46.733945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d3a80dac-e3b3-460a-9e1a-a883c6eda1ac None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:46.735191 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d3a80dac-e3b3-460a-9e1a-a883c6eda1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:46.754331 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1264/2523] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:53:46.759111 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f59cc-b5dd-4f8b-a77a-b3202a586d88 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:46.760609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e53f59cc-b5dd-4f8b-a77a-b3202a586d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:46.798888 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1260/2524] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:46.813881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a80dac-e3b3-460a-9e1a-a883c6eda1ac None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:46.815532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d3a80dac-e3b3-460a-9e1a-a883c6eda1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:46.833663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f59cc-b5dd-4f8b-a77a-b3202a586d88 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:46.840746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd1e56-12f1-4fe8-ae64-1b31999a59b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:46.841328 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd1e56-12f1-4fe8-ae64-1b31999a59b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:46.841676 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd1e56-12f1-4fe8-ae64-1b31999a59b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:46.841982 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd1e56-12f1-4fe8-ae64-1b31999a59b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:46.842681 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd1e56-12f1-4fe8-ae64-1b31999a59b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:46.845035 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd1e56-12f1-4fe8-ae64-1b31999a59b3 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:46.849083 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:46.855372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:46.880783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a80dac-e3b3-460a-9e1a-a883c6eda1ac None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:46.884840 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45ed7-e18a-4ad4-bc39-294b39f8c621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:46.897356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45ed7-e18a-4ad4-bc39-294b39f8c621 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:46.897356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45ed7-e18a-4ad4-bc39-294b39f8c621 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:46.897356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d45ed7-e18a-4ad4-bc39-294b39f8c621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:46.897356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d45ed7-e18a-4ad4-bc39-294b39f8c621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:46.897356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d45ed7-e18a-4ad4-bc39-294b39f8c621 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:46.908262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1261/2525] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:46.992458 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1265/2526] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:46 2022] POST /identity/v3/projects => generated 401 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:53:46.997087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45ed7-e18a-4ad4-bc39-294b39f8c621 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:47.012235 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d45ed7-e18a-4ad4-bc39-294b39f8c621 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:47.075891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641bb4-6dee-4453-995b-2e124474fc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:47.076494 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641bb4-6dee-4453-995b-2e124474fc39 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:47.076783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641bb4-6dee-4453-995b-2e124474fc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:47.077065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641bb4-6dee-4453-995b-2e124474fc39 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:47.077813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92641bb4-6dee-4453-995b-2e124474fc39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:47.087277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92641bb4-6dee-4453-995b-2e124474fc39 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:47.171806 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1262/2527] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:53:46 2022] POST /identity/v3/users => generated 307 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:53:47.173216 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd1e56-12f1-4fe8-ae64-1b31999a59b3 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:47.185807 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd1e56-12f1-4fe8-ae64-1b31999a59b3 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:47.191409 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513b8d8-0c2f-4779-ad73-3ad9e01756cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:47.192171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513b8d8-0c2f-4779-ad73-3ad9e01756cd admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:47.192529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513b8d8-0c2f-4779-ad73-3ad9e01756cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:47.192880 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513b8d8-0c2f-4779-ad73-3ad9e01756cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:47.193850 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513b8d8-0c2f-4779-ad73-3ad9e01756cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:47.195519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513b8d8-0c2f-4779-ad73-3ad9e01756cd admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:47.208127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1266/2528] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:47.212761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641bb4-6dee-4453-995b-2e124474fc39 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:47.224747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641bb4-6dee-4453-995b-2e124474fc39 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:47.230657 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d902fc9-fc8f-4e11-97c7-c2dc51303316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:47.231575 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d902fc9-fc8f-4e11-97c7-c2dc51303316 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:47.231853 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d902fc9-fc8f-4e11-97c7-c2dc51303316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:47.232125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d902fc9-fc8f-4e11-97c7-c2dc51303316 admin admin] PATH_INFO: `/v3/projects/1776db6f214f42b98f87b1d024016bb2/users/20ca41184b684224962c4b4a0622dbc9/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:47.249130 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d902fc9-fc8f-4e11-97c7-c2dc51303316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1776db6f214f42b98f87b1d024016bb2, user_id=20ca41184b684224962c4b4a0622dbc9, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:47.251866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d902fc9-fc8f-4e11-97c7-c2dc51303316 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:47.355391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1263/2529] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:47 2022] PUT /identity/v3/projects/1776db6f214f42b98f87b1d024016bb2/users/20ca41184b684224962c4b4a0622dbc9/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:47.359637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513b8d8-0c2f-4779-ad73-3ad9e01756cd admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:47.370607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513b8d8-0c2f-4779-ad73-3ad9e01756cd admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:47.401424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d902fc9-fc8f-4e11-97c7-c2dc51303316 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:47.403311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1d902fc9-fc8f-4e11-97c7-c2dc51303316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:47.451547 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5f4c9-8af2-4eef-b725-543008fb6604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:47.452496 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5f4c9-8af2-4eef-b725-543008fb6604 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:47.452877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5f4c9-8af2-4eef-b725-543008fb6604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:47.453384 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b5f4c9-8af2-4eef-b725-543008fb6604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:47.454251 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5f4c9-8af2-4eef-b725-543008fb6604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:47.455983 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b5f4c9-8af2-4eef-b725-543008fb6604 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:47.468015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1267/2530] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:47.473306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5f4c9-8af2-4eef-b725-543008fb6604 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:47.485025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d902fc9-fc8f-4e11-97c7-c2dc51303316 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:47.485236 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b5f4c9-8af2-4eef-b725-543008fb6604 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:47.489958 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:47.490193 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22430eca-d7fb-4588-9fbb-1c823b1b231b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:47.490819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:47.491102 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:47.491347 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22430eca-d7fb-4588-9fbb-1c823b1b231b admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:47.491456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] PATH_INFO: `/v3/projects/9437b9eea8424cedbdc0c0eec61a9809` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:47.491785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22430eca-d7fb-4588-9fbb-1c823b1b231b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:47.492246 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22430eca-d7fb-4588-9fbb-1c823b1b231b admin admin] PATH_INFO: `/v3/projects/1776db6f214f42b98f87b1d024016bb2/users/20ca41184b684224962c4b4a0622dbc9/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:47.492759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9437b9eea8424cedbdc0c0eec61a9809)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:47.495344 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:47.496013 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22430eca-d7fb-4588-9fbb-1c823b1b231b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1776db6f214f42b98f87b1d024016bb2, user_id=20ca41184b684224962c4b4a0622dbc9, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:47.499108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22430eca-d7fb-4588-9fbb-1c823b1b231b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:47.511483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1268/2531] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:47 2022] PUT /identity/v3/projects/1776db6f214f42b98f87b1d024016bb2/users/20ca41184b684224962c4b4a0622dbc9/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:47.522803 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f85f3e-26b8-4a38-a600-7e596c8c4977 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:47.523093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f85f3e-26b8-4a38-a600-7e596c8c4977 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:47.530452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f85f3e-26b8-4a38-a600-7e596c8c4977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:47.551184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-54f85f3e-26b8-4a38-a600-7e596c8c4977 None None] MFA Rules not processed for user `20ca41184b684224962c4b4a0622dbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:47.552430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-54f85f3e-26b8-4a38-a600-7e596c8c4977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:47.599943 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:47.606172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9437b9eea8424cedbdc0c0eec61a9809', 'request_id': 'req-cc033cbc-cfd5-4658-a998-b2deb0482fba'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:47.625871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1269/2532] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:47 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:53:47.638161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f85f3e-26b8-4a38-a600-7e596c8c4977 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:47.639562 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-54f85f3e-26b8-4a38-a600-7e596c8c4977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:47.686031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:47.698453 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f85f3e-26b8-4a38-a600-7e596c8c4977 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:47.713369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9437b9eea8424cedbdc0c0eec61a9809', 'request_id': 'req-cc033cbc-cfd5-4658-a998-b2deb0482fba'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:47.720842 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9437b9eea8424cedbdc0c0eec61a9809', 'request_id': 'req-cc033cbc-cfd5-4658-a998-b2deb0482fba'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:47.734806 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] The token cache is being invalidate because project 9437b9eea8424cedbdc0c0eec61a9809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:53:47.735250 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:47.735955 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:47.737521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1264/2533] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:47 2022] DELETE /identity/v3/projects/9437b9eea8424cedbdc0c0eec61a9809 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:47.742850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:47.744992 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:47.749397 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3970e67-1310-4d57-b198-a8730819497c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:47.756796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3970e67-1310-4d57-b198-a8730819497c service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:47.756796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3970e67-1310-4d57-b198-a8730819497c service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:47.756796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3970e67-1310-4d57-b198-a8730819497c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:47.756796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c3970e67-1310-4d57-b198-a8730819497c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:47.812678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc033cbc-cfd5-4658-a998-b2deb0482fba admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:47.818536 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfca94c-2356-4bee-85e0-0ef2a34ad41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:47.819546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfca94c-2356-4bee-85e0-0ef2a34ad41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:47.819828 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfca94c-2356-4bee-85e0-0ef2a34ad41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:47.820110 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfca94c-2356-4bee-85e0-0ef2a34ad41e admin admin] PATH_INFO: `/v3/users/e3829f65cf18494486aa2a772b4af150` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:47.821309 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3970e67-1310-4d57-b198-a8730819497c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:47.821493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfca94c-2356-4bee-85e0-0ef2a34ad41e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3829f65cf18494486aa2a772b4af150)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:47.823454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3970e67-1310-4d57-b198-a8730819497c service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:47.831851 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfca94c-2356-4bee-85e0-0ef2a34ad41e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:47.833609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1270/2534] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:47 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:53:48.080385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3970e67-1310-4d57-b198-a8730819497c service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:48.083598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c3970e67-1310-4d57-b198-a8730819497c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:48.086862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9cfca94c-2356-4bee-85e0-0ef2a34ad41e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3829f65cf18494486aa2a772b4af150'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:48.095839 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3970e67-1310-4d57-b198-a8730819497c service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:48.099254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dc74d-9f01-4e81-97ec-b767808147ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:48.099905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dc74d-9f01-4e81-97ec-b767808147ff service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:48.100184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dc74d-9f01-4e81-97ec-b767808147ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:48.100457 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1dc74d-9f01-4e81-97ec-b767808147ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:48.102258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6f1dc74d-9f01-4e81-97ec-b767808147ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:48.166497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dc74d-9f01-4e81-97ec-b767808147ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:48.168105 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1dc74d-9f01-4e81-97ec-b767808147ff service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:48.173255 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9cfca94c-2356-4bee-85e0-0ef2a34ad41e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3829f65cf18494486aa2a772b4af150'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:48.173986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9cfca94c-2356-4bee-85e0-0ef2a34ad41e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3829f65cf18494486aa2a772b4af150'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:48.179634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1271/2535] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:48 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:53:48.186271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9cfca94c-2356-4bee-85e0-0ef2a34ad41e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3829f65cf18494486aa2a772b4af150'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:48.187698 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-9cfca94c-2356-4bee-85e0-0ef2a34ad41e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3829f65cf18494486aa2a772b4af150'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:48.209183 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1265/2536] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:53:47 2022] DELETE /identity/v3/users/e3829f65cf18494486aa2a772b4af150 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:48.827674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dc74d-9f01-4e81-97ec-b767808147ff service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:48.838998 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1dc74d-9f01-4e81-97ec-b767808147ff service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:48.911702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:48.930171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732ad1ab-4463-4b68-8e38-6e8545f56a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:48.930171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad1ab-4463-4b68-8e38-6e8545f56a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:48.930171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad1ab-4463-4b68-8e38-6e8545f56a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:48.930171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732ad1ab-4463-4b68-8e38-6e8545f56a40 admin admin] PATH_INFO: `/v3/projects/935bf94f16354e498a169d5d47fb7baf` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:48.930789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ad1ab-4463-4b68-8e38-6e8545f56a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935bf94f16354e498a169d5d47fb7baf)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:48.934525 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732ad1ab-4463-4b68-8e38-6e8545f56a40 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:49.039107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-732ad1ab-4463-4b68-8e38-6e8545f56a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935bf94f16354e498a169d5d47fb7baf', 'request_id': 'req-732ad1ab-4463-4b68-8e38-6e8545f56a40'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:49.105134 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-732ad1ab-4463-4b68-8e38-6e8545f56a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935bf94f16354e498a169d5d47fb7baf', 'request_id': 'req-732ad1ab-4463-4b68-8e38-6e8545f56a40'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:49.111224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-732ad1ab-4463-4b68-8e38-6e8545f56a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935bf94f16354e498a169d5d47fb7baf', 'request_id': 'req-732ad1ab-4463-4b68-8e38-6e8545f56a40'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:49.124431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-732ad1ab-4463-4b68-8e38-6e8545f56a40 admin admin] The token cache is being invalidate because project 935bf94f16354e498a169d5d47fb7baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:53:49.124722 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-732ad1ab-4463-4b68-8e38-6e8545f56a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:49.125410 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-732ad1ab-4463-4b68-8e38-6e8545f56a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:49.127478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1272/2537] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:48 2022] DELETE /identity/v3/projects/935bf94f16354e498a169d5d47fb7baf => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:49.132709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c20da-c1c3-49a2-8d1e-5eef13b9719d None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:49.133032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c20da-c1c3-49a2-8d1e-5eef13b9719d None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:49.133323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c20da-c1c3-49a2-8d1e-5eef13b9719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:49.152280 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4c0c20da-c1c3-49a2-8d1e-5eef13b9719d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:49.153483 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4c0c20da-c1c3-49a2-8d1e-5eef13b9719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:49.199101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:49.214557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1266/2538] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:49.227957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572b353-ec41-4687-a93f-46bb4249381d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:49.228471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572b353-ec41-4687-a93f-46bb4249381d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:49.228625 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572b353-ec41-4687-a93f-46bb4249381d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:49.248118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-4572b353-ec41-4687-a93f-46bb4249381d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:49.249416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4572b353-ec41-4687-a93f-46bb4249381d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:49.258122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1273/2539] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:49.263002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c20da-c1c3-49a2-8d1e-5eef13b9719d None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:49.272849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c20da-c1c3-49a2-8d1e-5eef13b9719d None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:49.277814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73417a26-cb47-4f50-bdfd-e7e9d3838ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:49.278472 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73417a26-cb47-4f50-bdfd-e7e9d3838ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:49.278778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73417a26-cb47-4f50-bdfd-e7e9d3838ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:49.279039 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73417a26-cb47-4f50-bdfd-e7e9d3838ae6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:49.279805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73417a26-cb47-4f50-bdfd-e7e9d3838ae6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:53:49.280118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73417a26-cb47-4f50-bdfd-e7e9d3838ae6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:49.281757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73417a26-cb47-4f50-bdfd-e7e9d3838ae6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:49.293584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1267/2540] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:53:49.298083 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572b353-ec41-4687-a93f-46bb4249381d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:49.308244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572b353-ec41-4687-a93f-46bb4249381d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:49.313172 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308e394-34a6-4dca-bdcd-18f571e06760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:49.313864 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e394-34a6-4dca-bdcd-18f571e06760 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:49.314151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e394-34a6-4dca-bdcd-18f571e06760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:49.314428 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308e394-34a6-4dca-bdcd-18f571e06760 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:49.315138 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308e394-34a6-4dca-bdcd-18f571e06760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:49.317042 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308e394-34a6-4dca-bdcd-18f571e06760 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:49.453187 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1274/2541] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:49 2022] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:53:49.457154 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73417a26-cb47-4f50-bdfd-e7e9d3838ae6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:49.467301 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73417a26-cb47-4f50-bdfd-e7e9d3838ae6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:49.524229 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08b3e7-946c-4b73-9d30-2d92f146e0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:49.524837 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08b3e7-946c-4b73-9d30-2d92f146e0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:49.525120 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08b3e7-946c-4b73-9d30-2d92f146e0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:49.525781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08b3e7-946c-4b73-9d30-2d92f146e0b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:49.526292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08b3e7-946c-4b73-9d30-2d92f146e0b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:49.528241 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08b3e7-946c-4b73-9d30-2d92f146e0b7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:49.664676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1268/2542] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:53:49 2022] POST /identity/v3/users => generated 284 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:49.666949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308e394-34a6-4dca-bdcd-18f571e06760 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:49.677239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308e394-34a6-4dca-bdcd-18f571e06760 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:49.682815 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69c66b-a5e3-45e9-a66f-ec1c28a8786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:49.683535 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69c66b-a5e3-45e9-a66f-ec1c28a8786f admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:49.683852 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69c66b-a5e3-45e9-a66f-ec1c28a8786f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:49.684304 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69c66b-a5e3-45e9-a66f-ec1c28a8786f admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:49.685130 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69c66b-a5e3-45e9-a66f-ec1c28a8786f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:49.686854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69c66b-a5e3-45e9-a66f-ec1c28a8786f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:49.697622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1275/2543] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:49.701977 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08b3e7-946c-4b73-9d30-2d92f146e0b7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:49.712146 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08b3e7-946c-4b73-9d30-2d92f146e0b7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:49.716880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3476d22-38e5-4b1a-b359-aa4a05989b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:49.717546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3476d22-38e5-4b1a-b359-aa4a05989b4b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:49.717879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3476d22-38e5-4b1a-b359-aa4a05989b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:49.718161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3476d22-38e5-4b1a-b359-aa4a05989b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:49.718921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3476d22-38e5-4b1a-b359-aa4a05989b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:49.720577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3476d22-38e5-4b1a-b359-aa4a05989b4b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:49.731493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1269/2544] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:49.735596 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69c66b-a5e3-45e9-a66f-ec1c28a8786f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:49.746344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69c66b-a5e3-45e9-a66f-ec1c28a8786f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:49.750864 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4777519-4af3-40fe-b575-82cf738dd145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:49.751738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4777519-4af3-40fe-b575-82cf738dd145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:49.752021 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4777519-4af3-40fe-b575-82cf738dd145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:49.752300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4777519-4af3-40fe-b575-82cf738dd145 admin admin] PATH_INFO: `/v3/projects/f1b118d7ce534b28aea148a8fa718627/users/5d406b6b86404c7eaafe581aec5c38fd/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:49.767208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4777519-4af3-40fe-b575-82cf738dd145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1b118d7ce534b28aea148a8fa718627, user_id=5d406b6b86404c7eaafe581aec5c38fd, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:49.769923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4777519-4af3-40fe-b575-82cf738dd145 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:49.846508 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1276/2545] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:49 2022] PUT /identity/v3/projects/f1b118d7ce534b28aea148a8fa718627/users/5d406b6b86404c7eaafe581aec5c38fd/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:49.857454 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adcce1-9c07-40ae-a174-6e3ea18d19b4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:49.857778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adcce1-9c07-40ae-a174-6e3ea18d19b4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:49.858065 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2adcce1-9c07-40ae-a174-6e3ea18d19b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:49.885692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-c2adcce1-9c07-40ae-a174-6e3ea18d19b4 None None] MFA Rules not processed for user `5d406b6b86404c7eaafe581aec5c38fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:49.887025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-c2adcce1-9c07-40ae-a174-6e3ea18d19b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:49.955323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1270/2546] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:49.959802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4777519-4af3-40fe-b575-82cf738dd145 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:50.027017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4777519-4af3-40fe-b575-82cf738dd145 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:50.031660 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bc382-5d13-43b8-af0e-be772b79bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:50.032321 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bc382-5d13-43b8-af0e-be772b79bcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:50.032607 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bc382-5d13-43b8-af0e-be772b79bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:50.032912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691bc382-5d13-43b8-af0e-be772b79bcb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:50.033616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bc382-5d13-43b8-af0e-be772b79bcb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:50.035559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691bc382-5d13-43b8-af0e-be772b79bcb1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:50.153603 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:50.160867 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1277/2547] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:49 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:50.164992 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adcce1-9c07-40ae-a174-6e3ea18d19b4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:50.176104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2adcce1-9c07-40ae-a174-6e3ea18d19b4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:50.219139 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:50.234610 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43162147-7b7d-4370-a35c-61847e3cbe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:50.235327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43162147-7b7d-4370-a35c-61847e3cbe9f admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:50.235618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43162147-7b7d-4370-a35c-61847e3cbe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:50.235900 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43162147-7b7d-4370-a35c-61847e3cbe9f admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:50.236599 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43162147-7b7d-4370-a35c-61847e3cbe9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:50.238634 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43162147-7b7d-4370-a35c-61847e3cbe9f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:50.350707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1271/2548] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:53:50 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:53:50.352052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bc382-5d13-43b8-af0e-be772b79bcb1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:50.364951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691bc382-5d13-43b8-af0e-be772b79bcb1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:50.371044 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceab67-57fa-4018-8453-9c08975b75d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:50.371847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceab67-57fa-4018-8453-9c08975b75d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:50.372208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceab67-57fa-4018-8453-9c08975b75d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:50.372534 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ceab67-57fa-4018-8453-9c08975b75d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:50.373426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ceab67-57fa-4018-8453-9c08975b75d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:50.375223 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ceab67-57fa-4018-8453-9c08975b75d0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:50.388566 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1278/2549] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:50.393012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43162147-7b7d-4370-a35c-61847e3cbe9f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:50.405318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43162147-7b7d-4370-a35c-61847e3cbe9f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:50.410106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e977d00-2019-4cdf-8068-0cb5b43cb730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:50.410995 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e977d00-2019-4cdf-8068-0cb5b43cb730 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:50.411308 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e977d00-2019-4cdf-8068-0cb5b43cb730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:50.411584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e977d00-2019-4cdf-8068-0cb5b43cb730 admin admin] PATH_INFO: `/v3/projects/c75116dc78444b4a82f08c8d90ec0abf/users/e6471b45ce4a4ff1852fe1eb5075e418/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:50.428133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e977d00-2019-4cdf-8068-0cb5b43cb730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75116dc78444b4a82f08c8d90ec0abf, user_id=e6471b45ce4a4ff1852fe1eb5075e418, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:50.431156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e977d00-2019-4cdf-8068-0cb5b43cb730 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:50.530479 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1272/2550] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:50 2022] PUT /identity/v3/projects/c75116dc78444b4a82f08c8d90ec0abf/users/e6471b45ce4a4ff1852fe1eb5075e418/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:50.536413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceab67-57fa-4018-8453-9c08975b75d0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:50.547506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ceab67-57fa-4018-8453-9c08975b75d0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:50.604927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1514b-2061-4a40-9c0e-5096b80c93ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:50.605518 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1514b-2061-4a40-9c0e-5096b80c93ec admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:50.605838 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1514b-2061-4a40-9c0e-5096b80c93ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:50.606135 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1514b-2061-4a40-9c0e-5096b80c93ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:50.606866 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1514b-2061-4a40-9c0e-5096b80c93ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:50.608507 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1514b-2061-4a40-9c0e-5096b80c93ec admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:50.621376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1279/2551] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:50.623564 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e977d00-2019-4cdf-8068-0cb5b43cb730 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:50.634285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e977d00-2019-4cdf-8068-0cb5b43cb730 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:50.639147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0ee68-8078-4727-9d47-faa04cd4cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:50.640037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0ee68-8078-4727-9d47-faa04cd4cdc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:50.640323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0ee68-8078-4727-9d47-faa04cd4cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:50.641297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0ee68-8078-4727-9d47-faa04cd4cdc5 admin admin] PATH_INFO: `/v3/projects/c75116dc78444b4a82f08c8d90ec0abf/users/e6471b45ce4a4ff1852fe1eb5075e418/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:50.643820 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0ee68-8078-4727-9d47-faa04cd4cdc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75116dc78444b4a82f08c8d90ec0abf, user_id=e6471b45ce4a4ff1852fe1eb5075e418, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:50.646274 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed0ee68-8078-4727-9d47-faa04cd4cdc5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:50.658477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1273/2552] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:50 2022] PUT /identity/v3/projects/c75116dc78444b4a82f08c8d90ec0abf/users/e6471b45ce4a4ff1852fe1eb5075e418/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:50.670394 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58879d6d-e2c6-4339-8c33-e208ce64774c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:50.670692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58879d6d-e2c6-4339-8c33-e208ce64774c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:50.671000 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58879d6d-e2c6-4339-8c33-e208ce64774c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:50.698931 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-58879d6d-e2c6-4339-8c33-e208ce64774c None None] MFA Rules not processed for user `e6471b45ce4a4ff1852fe1eb5075e418`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:50.700300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-58879d6d-e2c6-4339-8c33-e208ce64774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:50.777073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1280/2553] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:50 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:50.788522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0ee68-8078-4727-9d47-faa04cd4cdc5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:50.790370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8ed0ee68-8078-4727-9d47-faa04cd4cdc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:50.855245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0ee68-8078-4727-9d47-faa04cd4cdc5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:50.858849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46afdb-f41f-49a5-852c-16d426808513 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:50.859500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46afdb-f41f-49a5-852c-16d426808513 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:50.859785 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46afdb-f41f-49a5-852c-16d426808513 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:50.860069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46afdb-f41f-49a5-852c-16d426808513 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:50.869648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46afdb-f41f-49a5-852c-16d426808513 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:50.871720 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46afdb-f41f-49a5-852c-16d426808513 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:50.880678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1274/2554] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:50 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:53.315673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58879d6d-e2c6-4339-8c33-e208ce64774c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:53.317056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-58879d6d-e2c6-4339-8c33-e208ce64774c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:53.381608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58879d6d-e2c6-4339-8c33-e208ce64774c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:53.387263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ea601-0ba2-49bb-a18c-55de7de604b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:53.388149 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea601-0ba2-49bb-a18c-55de7de604b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:53.388511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea601-0ba2-49bb-a18c-55de7de604b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:53.388704 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604ea601-0ba2-49bb-a18c-55de7de604b8 admin admin] PATH_INFO: `/v3/users/b6ddd20ed48e4bf390b0c261ef887d4b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:53.390076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ea601-0ba2-49bb-a18c-55de7de604b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ddd20ed48e4bf390b0c261ef887d4b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:53.392019 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604ea601-0ba2-49bb-a18c-55de7de604b8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:53.406783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:53.588511 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-604ea601-0ba2-49bb-a18c-55de7de604b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ddd20ed48e4bf390b0c261ef887d4b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:53.589091 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-604ea601-0ba2-49bb-a18c-55de7de604b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ddd20ed48e4bf390b0c261ef887d4b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:53.589698 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-604ea601-0ba2-49bb-a18c-55de7de604b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ddd20ed48e4bf390b0c261ef887d4b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:53.601218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-604ea601-0ba2-49bb-a18c-55de7de604b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ddd20ed48e4bf390b0c261ef887d4b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:53.608656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-604ea601-0ba2-49bb-a18c-55de7de604b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ddd20ed48e4bf390b0c261ef887d4b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:53.678672 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1281/2555] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:53:53 2022] DELETE /identity/v3/users/b6ddd20ed48e4bf390b0c261ef887d4b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:53.686157 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16383-c6cf-4400-badc-1b2c8e4c0156 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:53.686640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16383-c6cf-4400-badc-1b2c8e4c0156 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:53.686851 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe16383-c6cf-4400-badc-1b2c8e4c0156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:53.704566 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-cfe16383-c6cf-4400-badc-1b2c8e4c0156 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:53.706077 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cfe16383-c6cf-4400-badc-1b2c8e4c0156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:53.763987 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1275/2556] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:53:53.773660 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ea601-0ba2-49bb-a18c-55de7de604b8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:53.775072 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-604ea601-0ba2-49bb-a18c-55de7de604b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:53.822480 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe16383-c6cf-4400-badc-1b2c8e4c0156 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:53.823954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cfe16383-c6cf-4400-badc-1b2c8e4c0156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:53.835953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe16383-c6cf-4400-badc-1b2c8e4c0156 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:53.838407 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604ea601-0ba2-49bb-a18c-55de7de604b8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:53.841632 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51b7e9-1bc6-45b2-96eb-7ac1971bd70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:53.854167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2920ae43-88e2-4294-aa46-08ebdfff924d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:53.854387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b7e9-1bc6-45b2-96eb-7ac1971bd70f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:53.854387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b7e9-1bc6-45b2-96eb-7ac1971bd70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:53.854545 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920ae43-88e2-4294-aa46-08ebdfff924d service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:53.854626 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51b7e9-1bc6-45b2-96eb-7ac1971bd70f admin admin] PATH_INFO: `/v3/users/5d406b6b86404c7eaafe581aec5c38fd` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:53.854705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920ae43-88e2-4294-aa46-08ebdfff924d service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:53.854705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2920ae43-88e2-4294-aa46-08ebdfff924d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:53.854893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51b7e9-1bc6-45b2-96eb-7ac1971bd70f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d406b6b86404c7eaafe581aec5c38fd)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:53.854893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51b7e9-1bc6-45b2-96eb-7ac1971bd70f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:53.855045 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920ae43-88e2-4294-aa46-08ebdfff924d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:53.855805 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2920ae43-88e2-4294-aa46-08ebdfff924d service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:53.869868 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1282/2557] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:54.024029 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:54.034389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0e51b7e9-1bc6-45b2-96eb-7ac1971bd70f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d406b6b86404c7eaafe581aec5c38fd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.104929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0e51b7e9-1bc6-45b2-96eb-7ac1971bd70f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d406b6b86404c7eaafe581aec5c38fd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.105598 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0e51b7e9-1bc6-45b2-96eb-7ac1971bd70f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d406b6b86404c7eaafe581aec5c38fd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.113434 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0e51b7e9-1bc6-45b2-96eb-7ac1971bd70f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d406b6b86404c7eaafe581aec5c38fd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.115343 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-0e51b7e9-1bc6-45b2-96eb-7ac1971bd70f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d406b6b86404c7eaafe581aec5c38fd'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.133283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1276/2558] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:53:53 2022] DELETE /identity/v3/users/5d406b6b86404c7eaafe581aec5c38fd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:54.138432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff46a14-6f4c-4d35-b413-344d34302c52 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:54.144007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff46a14-6f4c-4d35-b413-344d34302c52 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:54.144007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff46a14-6f4c-4d35-b413-344d34302c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:54.157055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-bff46a14-6f4c-4d35-b413-344d34302c52 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:54.158314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bff46a14-6f4c-4d35-b413-344d34302c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:54.219169 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1283/2559] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:54.230039 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51b7e9-1bc6-45b2-96eb-7ac1971bd70f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:54.231484 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0e51b7e9-1bc6-45b2-96eb-7ac1971bd70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:54.270650 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff46a14-6f4c-4d35-b413-344d34302c52 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:54.272111 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bff46a14-6f4c-4d35-b413-344d34302c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:54.290416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff46a14-6f4c-4d35-b413-344d34302c52 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:54.296335 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:54.298258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:54.298947 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:54.299265 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] PATH_INFO: `/v3/projects/fd93eb9527a14c7c83441c4240d17d13` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:54.300649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd93eb9527a14c7c83441c4240d17d13)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:54.301456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51b7e9-1bc6-45b2-96eb-7ac1971bd70f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:54.302677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:54.306930 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a404e8c-a40c-452e-b22f-e8c7143a2453 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:54.308647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a404e8c-a40c-452e-b22f-e8c7143a2453 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:54.308941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a404e8c-a40c-452e-b22f-e8c7143a2453 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:54.309216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a404e8c-a40c-452e-b22f-e8c7143a2453 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:54.323579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a404e8c-a40c-452e-b22f-e8c7143a2453 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:54.325393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a404e8c-a40c-452e-b22f-e8c7143a2453 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:54.339196 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1277/2560] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:53:54.394060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:54.414471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd93eb9527a14c7c83441c4240d17d13', 'request_id': 'req-47a867cb-8c3d-4443-857f-e3cc59bd743a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.498638 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd93eb9527a14c7c83441c4240d17d13', 'request_id': 'req-47a867cb-8c3d-4443-857f-e3cc59bd743a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.505034 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd93eb9527a14c7c83441c4240d17d13', 'request_id': 'req-47a867cb-8c3d-4443-857f-e3cc59bd743a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.517578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] The token cache is being invalidate because project fd93eb9527a14c7c83441c4240d17d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:53:54.518008 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.518689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.520276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1284/2561] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:54 2022] DELETE /identity/v3/projects/fd93eb9527a14c7c83441c4240d17d13 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:54.524359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a404e8c-a40c-452e-b22f-e8c7143a2453 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:54.535417 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a404e8c-a40c-452e-b22f-e8c7143a2453 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:54.597879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0c4ca-33b2-43bc-94d4-9f3fc22e7feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:54.598798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0c4ca-33b2-43bc-94d4-9f3fc22e7feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:54.599010 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0c4ca-33b2-43bc-94d4-9f3fc22e7feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:54.599284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0c4ca-33b2-43bc-94d4-9f3fc22e7feb admin admin] PATH_INFO: `/v3/users/20ca41184b684224962c4b4a0622dbc9` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:54.600749 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0c4ca-33b2-43bc-94d4-9f3fc22e7feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ca41184b684224962c4b4a0622dbc9)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:54.602526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb0c4ca-33b2-43bc-94d4-9f3fc22e7feb admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:54.737333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:54.738827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:54.754569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a867cb-8c3d-4443-857f-e3cc59bd743a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:54.761267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:54.765229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:54.765229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:54.765229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] PATH_INFO: `/v3/projects/f1b118d7ce534b28aea148a8fa718627` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:54.765229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1b118d7ce534b28aea148a8fa718627)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:54.766137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:54.883508 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3cb0c4ca-33b2-43bc-94d4-9f3fc22e7feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ca41184b684224962c4b4a0622dbc9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.910923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1b118d7ce534b28aea148a8fa718627', 'request_id': 'req-04cd0514-f893-4223-9011-e0891216647b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.973403 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3cb0c4ca-33b2-43bc-94d4-9f3fc22e7feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ca41184b684224962c4b4a0622dbc9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.974057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3cb0c4ca-33b2-43bc-94d4-9f3fc22e7feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ca41184b684224962c4b4a0622dbc9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.976393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:54.982616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3cb0c4ca-33b2-43bc-94d4-9f3fc22e7feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ca41184b684224962c4b4a0622dbc9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:54.983196 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3cb0c4ca-33b2-43bc-94d4-9f3fc22e7feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ca41184b684224962c4b4a0622dbc9'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.001601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1278/2562] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:53:54 2022] DELETE /identity/v3/users/20ca41184b684224962c4b4a0622dbc9 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:55.047389 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1b118d7ce534b28aea148a8fa718627', 'request_id': 'req-04cd0514-f893-4223-9011-e0891216647b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.053896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1b118d7ce534b28aea148a8fa718627', 'request_id': 'req-04cd0514-f893-4223-9011-e0891216647b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.066250 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] The token cache is being invalidate because project f1b118d7ce534b28aea148a8fa718627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:53:55.066860 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.067384 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.073823 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1285/2563] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:54 2022] DELETE /identity/v3/projects/f1b118d7ce534b28aea148a8fa718627 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:55.078029 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0c4ca-33b2-43bc-94d4-9f3fc22e7feb admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:55.079530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-3cb0c4ca-33b2-43bc-94d4-9f3fc22e7feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:55.146383 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb0c4ca-33b2-43bc-94d4-9f3fc22e7feb admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:55.151736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0b83b-8b8e-419d-8d6a-4f8176271b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:55.152618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0b83b-8b8e-419d-8d6a-4f8176271b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:55.152905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0b83b-8b8e-419d-8d6a-4f8176271b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:55.153211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0b83b-8b8e-419d-8d6a-4f8176271b68 admin admin] PATH_INFO: `/v3/users/e6471b45ce4a4ff1852fe1eb5075e418` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:55.154452 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0b83b-8b8e-419d-8d6a-4f8176271b68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6471b45ce4a4ff1852fe1eb5075e418)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:55.156384 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0b83b-8b8e-419d-8d6a-4f8176271b68 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:55.341849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-56f0b83b-8b8e-419d-8d6a-4f8176271b68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6471b45ce4a4ff1852fe1eb5075e418'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.414427 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:55.417050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:55.435710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-56f0b83b-8b8e-419d-8d6a-4f8176271b68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6471b45ce4a4ff1852fe1eb5075e418'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.437156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-56f0b83b-8b8e-419d-8d6a-4f8176271b68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6471b45ce4a4ff1852fe1eb5075e418'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.445894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-56f0b83b-8b8e-419d-8d6a-4f8176271b68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6471b45ce4a4ff1852fe1eb5075e418'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.446616 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-56f0b83b-8b8e-419d-8d6a-4f8176271b68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6471b45ce4a4ff1852fe1eb5075e418'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.464610 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1279/2564] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:53:55 2022] DELETE /identity/v3/users/e6471b45ce4a4ff1852fe1eb5075e418 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:55.487812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd0514-f893-4223-9011-e0891216647b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:55.535130 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:55.549957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:55.550825 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:55.551104 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:55.551376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] PATH_INFO: `/v3/projects/1776db6f214f42b98f87b1d024016bb2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:55.552556 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1776db6f214f42b98f87b1d024016bb2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:55.554498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:55.683951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1776db6f214f42b98f87b1d024016bb2', 'request_id': 'req-ea751dc6-90b2-47af-bc89-e3ce544e0d40'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.773186 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1776db6f214f42b98f87b1d024016bb2', 'request_id': 'req-ea751dc6-90b2-47af-bc89-e3ce544e0d40'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.780282 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1776db6f214f42b98f87b1d024016bb2', 'request_id': 'req-ea751dc6-90b2-47af-bc89-e3ce544e0d40'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.792185 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] The token cache is being invalidate because project 1776db6f214f42b98f87b1d024016bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:53:55.792401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.793058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:55.794666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1286/2565] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:55 2022] DELETE /identity/v3/projects/1776db6f214f42b98f87b1d024016bb2 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:55.799825 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520890-0099-4207-b4ec-d53dbab66abf None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:55.800194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520890-0099-4207-b4ec-d53dbab66abf None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:55.800545 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a520890-0099-4207-b4ec-d53dbab66abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:55.818754 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2a520890-0099-4207-b4ec-d53dbab66abf None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:55.819959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2a520890-0099-4207-b4ec-d53dbab66abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:55.866127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:55.867633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:55.871951 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:55.886545 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1280/2566] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:55.894387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d2083-b867-4b49-9779-ede3f8afe2a6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:55.898637 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d2083-b867-4b49-9779-ede3f8afe2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:55.898637 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d2083-b867-4b49-9779-ede3f8afe2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:55.914685 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4f9d2083-b867-4b49-9779-ede3f8afe2a6 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:55.916579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4f9d2083-b867-4b49-9779-ede3f8afe2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:55.924647 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1281/2567] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:53:55.929002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d2083-b867-4b49-9779-ede3f8afe2a6 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:55.939009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d2083-b867-4b49-9779-ede3f8afe2a6 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:55.943594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea751dc6-90b2-47af-bc89-e3ce544e0d40 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:55.944382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a14b3a-1651-44c8-8890-95249e8c9d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:55.945251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a14b3a-1651-44c8-8890-95249e8c9d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:55.945359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a14b3a-1651-44c8-8890-95249e8c9d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:55.945634 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a14b3a-1651-44c8-8890-95249e8c9d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:55.946448 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a14b3a-1651-44c8-8890-95249e8c9d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:53:55.946713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a14b3a-1651-44c8-8890-95249e8c9d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:55.949678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a14b3a-1651-44c8-8890-95249e8c9d67 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:55.950642 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bce247-3835-4834-9b0c-d0726bdba9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:55.951572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bce247-3835-4834-9b0c-d0726bdba9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:55.957503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bce247-3835-4834-9b0c-d0726bdba9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:55.957503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bce247-3835-4834-9b0c-d0726bdba9ea admin admin] PATH_INFO: `/v3/projects/c75116dc78444b4a82f08c8d90ec0abf` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:55.957503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bce247-3835-4834-9b0c-d0726bdba9ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=c75116dc78444b4a82f08c8d90ec0abf)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:55.957503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bce247-3835-4834-9b0c-d0726bdba9ea admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:55.962076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1282/2568] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:53:55.966806 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a14b3a-1651-44c8-8890-95249e8c9d67 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:55.976843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a14b3a-1651-44c8-8890-95249e8c9d67 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:55.982457 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7a9e9-a9f7-4667-8a7c-f55e8e9424ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:55.983112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7a9e9-a9f7-4667-8a7c-f55e8e9424ca admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:55.983390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7a9e9-a9f7-4667-8a7c-f55e8e9424ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:55.986203 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f7a9e9-a9f7-4667-8a7c-f55e8e9424ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:55.986203 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7a9e9-a9f7-4667-8a7c-f55e8e9424ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:55.986428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f7a9e9-a9f7-4667-8a7c-f55e8e9424ca admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:56.041799 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-90bce247-3835-4834-9b0c-d0726bdba9ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75116dc78444b4a82f08c8d90ec0abf', 'request_id': 'req-90bce247-3835-4834-9b0c-d0726bdba9ea'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:56.103021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1283/2569] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:55 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:56.104891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7a9e9-a9f7-4667-8a7c-f55e8e9424ca admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:56.114076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-90bce247-3835-4834-9b0c-d0726bdba9ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75116dc78444b4a82f08c8d90ec0abf', 'request_id': 'req-90bce247-3835-4834-9b0c-d0726bdba9ea'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:56.121143 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-90bce247-3835-4834-9b0c-d0726bdba9ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75116dc78444b4a82f08c8d90ec0abf', 'request_id': 'req-90bce247-3835-4834-9b0c-d0726bdba9ea'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:56.132611 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-90bce247-3835-4834-9b0c-d0726bdba9ea admin admin] The token cache is being invalidate because project c75116dc78444b4a82f08c8d90ec0abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:53:56.132909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-90bce247-3835-4834-9b0c-d0726bdba9ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:56.133583 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-90bce247-3835-4834-9b0c-d0726bdba9ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:56.136069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1287/2570] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:55 2022] DELETE /identity/v3/projects/c75116dc78444b4a82f08c8d90ec0abf => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:56.140872 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771a1d7-52ff-4826-9224-b4cc265ce1e5 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.141161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771a1d7-52ff-4826-9224-b4cc265ce1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.141443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771a1d7-52ff-4826-9224-b4cc265ce1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.148658 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:56.159304 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b771a1d7-52ff-4826-9224-b4cc265ce1e5 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:56.160524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b771a1d7-52ff-4826-9224-b4cc265ce1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:56.169349 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1288/2571] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:56.171098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f7a9e9-a9f7-4667-8a7c-f55e8e9424ca admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:56.176053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4a94e-aca2-4497-a62b-3c84e777cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:56.176730 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4a94e-aca2-4497-a62b-3c84e777cac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.176864 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43499216-0f7e-4e57-8d73-f6d07849059d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.177017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43499216-0f7e-4e57-8d73-f6d07849059d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.177128 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4a94e-aca2-4497-a62b-3c84e777cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.177297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4a94e-aca2-4497-a62b-3c84e777cac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.177396 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43499216-0f7e-4e57-8d73-f6d07849059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.178022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4a94e-aca2-4497-a62b-3c84e777cac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:56.180105 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4a94e-aca2-4497-a62b-3c84e777cac6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:56.196329 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-43499216-0f7e-4e57-8d73-f6d07849059d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:56.197886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-43499216-0f7e-4e57-8d73-f6d07849059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:56.206055 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1289/2572] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:53:56.212069 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43499216-0f7e-4e57-8d73-f6d07849059d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:56.219266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43499216-0f7e-4e57-8d73-f6d07849059d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:56.224018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eef60d-8001-4130-8a3d-75bf95d42f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:56.224686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eef60d-8001-4130-8a3d-75bf95d42f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.224968 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eef60d-8001-4130-8a3d-75bf95d42f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.225243 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eef60d-8001-4130-8a3d-75bf95d42f24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.225993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eef60d-8001-4130-8a3d-75bf95d42f24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:53:56.226301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eef60d-8001-4130-8a3d-75bf95d42f24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:56.227890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eef60d-8001-4130-8a3d-75bf95d42f24 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:56.240004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1290/2573] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:53:56.248659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eef60d-8001-4130-8a3d-75bf95d42f24 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:56.258411 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eef60d-8001-4130-8a3d-75bf95d42f24 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:56.263623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885d80a-ec79-4931-89f2-0f40429d5866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:56.264244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885d80a-ec79-4931-89f2-0f40429d5866 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.264529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885d80a-ec79-4931-89f2-0f40429d5866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.264929 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885d80a-ec79-4931-89f2-0f40429d5866 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.265620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885d80a-ec79-4931-89f2-0f40429d5866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:56.267533 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885d80a-ec79-4931-89f2-0f40429d5866 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:56.270378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1284/2574] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:53:56 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:56.278750 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4a94e-aca2-4497-a62b-3c84e777cac6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:56.280666 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f3d4a94e-aca2-4497-a62b-3c84e777cac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:56.293452 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4a94e-aca2-4497-a62b-3c84e777cac6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:56.298154 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932feb0-1fa9-4781-8539-5f74d173c871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:56.298826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932feb0-1fa9-4781-8539-5f74d173c871 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.299108 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932feb0-1fa9-4781-8539-5f74d173c871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.299387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932feb0-1fa9-4781-8539-5f74d173c871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.300125 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932feb0-1fa9-4781-8539-5f74d173c871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:56.301759 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932feb0-1fa9-4781-8539-5f74d173c871 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:56.312350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1285/2575] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:53:56.316044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932feb0-1fa9-4781-8539-5f74d173c871 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:56.325968 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932feb0-1fa9-4781-8539-5f74d173c871 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:56.330567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a790bc5-bd67-4add-bfad-ad45762dbbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:56.331180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a790bc5-bd67-4add-bfad-ad45762dbbb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.331543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a790bc5-bd67-4add-bfad-ad45762dbbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.331749 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a790bc5-bd67-4add-bfad-ad45762dbbb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.332500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a790bc5-bd67-4add-bfad-ad45762dbbb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:56.334161 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a790bc5-bd67-4add-bfad-ad45762dbbb5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:56.341443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1291/2576] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:56 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:56.348040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1286/2577] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:53:56.348174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885d80a-ec79-4931-89f2-0f40429d5866 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:56.348894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a790bc5-bd67-4add-bfad-ad45762dbbb5 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:56.358928 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a790bc5-bd67-4add-bfad-ad45762dbbb5 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:56.407056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885d80a-ec79-4931-89f2-0f40429d5866 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:56.411826 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a09e2-ee55-4696-bd80-024e07ae41bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:56.412499 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a09e2-ee55-4696-bd80-024e07ae41bc admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.412784 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a09e2-ee55-4696-bd80-024e07ae41bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.413061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a09e2-ee55-4696-bd80-024e07ae41bc admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.413782 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a09e2-ee55-4696-bd80-024e07ae41bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:56.415741 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a09e2-ee55-4696-bd80-024e07ae41bc admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:56.416373 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a83b9-1bf6-4318-9332-c0a031406f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:56.417143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a83b9-1bf6-4318-9332-c0a031406f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.417431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a83b9-1bf6-4318-9332-c0a031406f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.417708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a83b9-1bf6-4318-9332-c0a031406f46 admin admin] PATH_INFO: `/v3/projects/0aacd4947457464980f0a67da87aeddc/users/f4a3f58287844487a4b028eb4fd8b34c/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.432468 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a83b9-1bf6-4318-9332-c0a031406f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aacd4947457464980f0a67da87aeddc, user_id=f4a3f58287844487a4b028eb4fd8b34c, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:56.435148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a83b9-1bf6-4318-9332-c0a031406f46 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:56.536298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1292/2578] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:53:56 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:56.540316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a09e2-ee55-4696-bd80-024e07ae41bc admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:56.550778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a09e2-ee55-4696-bd80-024e07ae41bc admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:56.555441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcbe20b-5136-41db-8bc5-e1986b9047e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:56.556095 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbe20b-5136-41db-8bc5-e1986b9047e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.556571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbe20b-5136-41db-8bc5-e1986b9047e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.556862 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcbe20b-5136-41db-8bc5-e1986b9047e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.557644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbe20b-5136-41db-8bc5-e1986b9047e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:56.559306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcbe20b-5136-41db-8bc5-e1986b9047e0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:56.566054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1287/2579] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:56 2022] PUT /identity/v3/projects/0aacd4947457464980f0a67da87aeddc/users/f4a3f58287844487a4b028eb4fd8b34c/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:56.573492 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1293/2580] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:53:56.574456 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a83b9-1bf6-4318-9332-c0a031406f46 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:56.577526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e54dc1-d22e-46f6-9c39-7339ce45577a None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.577850 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e54dc1-d22e-46f6-9c39-7339ce45577a None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.578133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e54dc1-d22e-46f6-9c39-7339ce45577a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.578748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:56.604938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-60e54dc1-d22e-46f6-9c39-7339ce45577a None None] MFA Rules not processed for user `f4a3f58287844487a4b028eb4fd8b34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:56.606144 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-60e54dc1-d22e-46f6-9c39-7339ce45577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:56.637291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a83b9-1bf6-4318-9332-c0a031406f46 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:56.642238 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3645be4-b874-4568-97e8-e6700116c1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:56.642974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3645be4-b874-4568-97e8-e6700116c1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.643258 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3645be4-b874-4568-97e8-e6700116c1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.643533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3645be4-b874-4568-97e8-e6700116c1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.644261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3645be4-b874-4568-97e8-e6700116c1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:56.645878 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3645be4-b874-4568-97e8-e6700116c1c6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:56.659390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1288/2581] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:53:56.660454 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3645be4-b874-4568-97e8-e6700116c1c6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:56.670786 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3645be4-b874-4568-97e8-e6700116c1c6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:56.673859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1294/2582] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:53:56.675363 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e54dc1-d22e-46f6-9c39-7339ce45577a None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:56.675885 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f151ea3-fbc8-47b4-aa1b-69ccd37d1845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:56.676706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f151ea3-fbc8-47b4-aa1b-69ccd37d1845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.676995 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f151ea3-fbc8-47b4-aa1b-69ccd37d1845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.677277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f151ea3-fbc8-47b4-aa1b-69ccd37d1845 admin admin] PATH_INFO: `/v3/projects/cd6f90490e5a4bf8bab4b6ddc686d441/users/ed28bf81e7eb4bc489bce4b95609366b/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.686063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e54dc1-d22e-46f6-9c39-7339ce45577a None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:56.690927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62d5a6-004d-4ae3-830a-f82908e0781c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:56.691662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62d5a6-004d-4ae3-830a-f82908e0781c admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.691977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62d5a6-004d-4ae3-830a-f82908e0781c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.692254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62d5a6-004d-4ae3-830a-f82908e0781c admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.692433 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f151ea3-fbc8-47b4-aa1b-69ccd37d1845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6f90490e5a4bf8bab4b6ddc686d441, user_id=ed28bf81e7eb4bc489bce4b95609366b, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:56.692949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62d5a6-004d-4ae3-830a-f82908e0781c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:56.694917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee62d5a6-004d-4ae3-830a-f82908e0781c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:56.695145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f151ea3-fbc8-47b4-aa1b-69ccd37d1845 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:56.767084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1289/2583] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:56 2022] PUT /identity/v3/projects/cd6f90490e5a4bf8bab4b6ddc686d441/users/ed28bf81e7eb4bc489bce4b95609366b/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:56.779047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d975494-1938-4a09-ba9d-f03b55b1a115 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.779341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d975494-1938-4a09-ba9d-f03b55b1a115 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.779624 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d975494-1938-4a09-ba9d-f03b55b1a115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.792293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1295/2584] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:56 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:56.796267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62d5a6-004d-4ae3-830a-f82908e0781c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:56.806572 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6d975494-1938-4a09-ba9d-f03b55b1a115 None None] MFA Rules not processed for user `ed28bf81e7eb4bc489bce4b95609366b`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:56.807798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6d975494-1938-4a09-ba9d-f03b55b1a115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:56.857833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62d5a6-004d-4ae3-830a-f82908e0781c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:56.862429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d572d-1a4f-4837-910a-e167d6dde391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:56.863106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d572d-1a4f-4837-910a-e167d6dde391 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.863394 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d572d-1a4f-4837-910a-e167d6dde391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.863674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d572d-1a4f-4837-910a-e167d6dde391 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.864371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d572d-1a4f-4837-910a-e167d6dde391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:56.866358 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d572d-1a4f-4837-910a-e167d6dde391 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:56.871145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:56.872482 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1290/2585] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:53:56.877051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d975494-1938-4a09-ba9d-f03b55b1a115 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:56.888571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d975494-1938-4a09-ba9d-f03b55b1a115 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:56.893209 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f83fc-abfa-4f79-b193-186209e41081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:56.893890 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f83fc-abfa-4f79-b193-186209e41081 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:56.894177 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f83fc-abfa-4f79-b193-186209e41081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:56.894451 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f83fc-abfa-4f79-b193-186209e41081 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:56.895138 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f83fc-abfa-4f79-b193-186209e41081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:56.897044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f83fc-abfa-4f79-b193-186209e41081 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:56.985156 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1296/2586] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:53:56 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:56.989018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d572d-1a4f-4837-910a-e167d6dde391 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:56.999073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d572d-1a4f-4837-910a-e167d6dde391 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:57.004166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01b351-39eb-4d95-b439-8da054c4a995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:57.008846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01b351-39eb-4d95-b439-8da054c4a995 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.008846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01b351-39eb-4d95-b439-8da054c4a995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.008846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb01b351-39eb-4d95-b439-8da054c4a995 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.008846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01b351-39eb-4d95-b439-8da054c4a995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:57.008846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb01b351-39eb-4d95-b439-8da054c4a995 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:57.012707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1291/2587] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:53:56 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:53:57.016639 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f83fc-abfa-4f79-b193-186209e41081 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:57.020989 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1297/2588] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:53:57.022971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01b351-39eb-4d95-b439-8da054c4a995 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:57.034434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb01b351-39eb-4d95-b439-8da054c4a995 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:57.062889 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:57.082221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f83fc-abfa-4f79-b193-186209e41081 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:57.088537 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc6a56-3e67-411b-94ba-05cec89c0a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:57.089360 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc6a56-3e67-411b-94ba-05cec89c0a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.089677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc6a56-3e67-411b-94ba-05cec89c0a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.089992 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc6a56-3e67-411b-94ba-05cec89c0a58 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.090694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc6a56-3e67-411b-94ba-05cec89c0a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:57.092656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc6a56-3e67-411b-94ba-05cec89c0a58 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:57.094494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727af521-ac92-4806-9eac-f79518f17d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:57.095418 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727af521-ac92-4806-9eac-f79518f17d8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.095714 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727af521-ac92-4806-9eac-f79518f17d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.095975 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727af521-ac92-4806-9eac-f79518f17d8f admin admin] PATH_INFO: `/v3/projects/cb92eda4fe1f48d6a627c92f6deb1a53/users/8e20c52b031d49f18d63e69cb1c07591/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.116356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727af521-ac92-4806-9eac-f79518f17d8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb92eda4fe1f48d6a627c92f6deb1a53, user_id=8e20c52b031d49f18d63e69cb1c07591, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:57.116356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727af521-ac92-4806-9eac-f79518f17d8f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:57.199051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1292/2589] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:53:57 2022] POST /identity/v3/users => generated 299 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:53:57.202849 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc6a56-3e67-411b-94ba-05cec89c0a58 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:57.211667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1298/2590] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:57 2022] PUT /identity/v3/projects/cb92eda4fe1f48d6a627c92f6deb1a53/users/8e20c52b031d49f18d63e69cb1c07591/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:57.212926 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc6a56-3e67-411b-94ba-05cec89c0a58 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:57.216868 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727af521-ac92-4806-9eac-f79518f17d8f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:57.270603 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cec284-7a4b-4719-a70f-64c914daf0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:57.271283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cec284-7a4b-4719-a70f-64c914daf0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.271571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cec284-7a4b-4719-a70f-64c914daf0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.271850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cec284-7a4b-4719-a70f-64c914daf0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.272589 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cec284-7a4b-4719-a70f-64c914daf0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:57.274270 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cec284-7a4b-4719-a70f-64c914daf0a3 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:57.280327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727af521-ac92-4806-9eac-f79518f17d8f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:57.284351 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1293/2591] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:53:57.285171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cead79-31d1-4417-a5f0-582c77029053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:57.285875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cead79-31d1-4417-a5f0-582c77029053 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.286167 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cead79-31d1-4417-a5f0-582c77029053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.286446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cead79-31d1-4417-a5f0-582c77029053 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.287220 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cead79-31d1-4417-a5f0-582c77029053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:57.288404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cec284-7a4b-4719-a70f-64c914daf0a3 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:57.288882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cead79-31d1-4417-a5f0-582c77029053 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:57.294419 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:57.298370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cec284-7a4b-4719-a70f-64c914daf0a3 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:57.303242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1299/2592] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:53:57.303414 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1de93-f7e0-43a2-aca8-5f5f8d7673e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:57.308353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cead79-31d1-4417-a5f0-582c77029053 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:57.308463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1de93-f7e0-43a2-aca8-5f5f8d7673e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.308463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1de93-f7e0-43a2-aca8-5f5f8d7673e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.308463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1de93-f7e0-43a2-aca8-5f5f8d7673e9 admin admin] PATH_INFO: `/v3/projects/b35a0921ea0f4b758ca448d85a8e55d8/users/808a5e0d8a2a4d0791a756d59333118a/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.314271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cead79-31d1-4417-a5f0-582c77029053 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:57.318928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbc772-286e-4926-a030-8d4f9148015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:57.319827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbc772-286e-4926-a030-8d4f9148015f admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.320114 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbc772-286e-4926-a030-8d4f9148015f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.320399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbc772-286e-4926-a030-8d4f9148015f admin admin] PATH_INFO: `/v3/projects/cb92eda4fe1f48d6a627c92f6deb1a53/users/8e20c52b031d49f18d63e69cb1c07591/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.320500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1de93-f7e0-43a2-aca8-5f5f8d7673e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35a0921ea0f4b758ca448d85a8e55d8, user_id=808a5e0d8a2a4d0791a756d59333118a, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:57.323058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbc772-286e-4926-a030-8d4f9148015f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb92eda4fe1f48d6a627c92f6deb1a53, user_id=8e20c52b031d49f18d63e69cb1c07591, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:57.323770 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1de93-f7e0-43a2-aca8-5f5f8d7673e9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:57.325691 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbc772-286e-4926-a030-8d4f9148015f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:57.336582 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1300/2593] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:57 2022] PUT /identity/v3/projects/cb92eda4fe1f48d6a627c92f6deb1a53/users/8e20c52b031d49f18d63e69cb1c07591/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:57.346554 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631734b-85b5-4606-8c8e-9f1784a0c1db None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.346847 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631734b-85b5-4606-8c8e-9f1784a0c1db None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.347132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7631734b-85b5-4606-8c8e-9f1784a0c1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.373612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7631734b-85b5-4606-8c8e-9f1784a0c1db None None] MFA Rules not processed for user `8e20c52b031d49f18d63e69cb1c07591`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:57.374777 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7631734b-85b5-4606-8c8e-9f1784a0c1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:57.405193 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1294/2594] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:57 2022] PUT /identity/v3/projects/b35a0921ea0f4b758ca448d85a8e55d8/users/808a5e0d8a2a4d0791a756d59333118a/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:57.409194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1de93-f7e0-43a2-aca8-5f5f8d7673e9 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:57.453875 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1301/2595] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:53:57.465304 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631734b-85b5-4606-8c8e-9f1784a0c1db None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:57.466750 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7631734b-85b5-4606-8c8e-9f1784a0c1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:57.474379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1de93-f7e0-43a2-aca8-5f5f8d7673e9 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:57.479078 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51641c-8e2b-4f64-985e-eb73bbe7692f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:57.479750 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51641c-8e2b-4f64-985e-eb73bbe7692f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.483758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51641c-8e2b-4f64-985e-eb73bbe7692f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.483758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51641c-8e2b-4f64-985e-eb73bbe7692f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.483758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51641c-8e2b-4f64-985e-eb73bbe7692f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:57.483758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51641c-8e2b-4f64-985e-eb73bbe7692f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:57.494299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1295/2596] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:53:57.498430 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51641c-8e2b-4f64-985e-eb73bbe7692f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:57.508779 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51641c-8e2b-4f64-985e-eb73bbe7692f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:57.514289 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb58442-f4a0-4c49-a3e8-cf153f3502e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:57.518051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb58442-f4a0-4c49-a3e8-cf153f3502e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.518051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb58442-f4a0-4c49-a3e8-cf153f3502e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.518051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb58442-f4a0-4c49-a3e8-cf153f3502e2 admin admin] PATH_INFO: `/v3/projects/b35a0921ea0f4b758ca448d85a8e55d8/users/808a5e0d8a2a4d0791a756d59333118a/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.518051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb58442-f4a0-4c49-a3e8-cf153f3502e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b35a0921ea0f4b758ca448d85a8e55d8, user_id=808a5e0d8a2a4d0791a756d59333118a, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:57.520423 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb58442-f4a0-4c49-a3e8-cf153f3502e2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:57.528367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7631734b-85b5-4606-8c8e-9f1784a0c1db None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:57.531333 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1296/2597] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:53:57 2022] PUT /identity/v3/projects/b35a0921ea0f4b758ca448d85a8e55d8/users/808a5e0d8a2a4d0791a756d59333118a/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:53:57.541685 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f26852-7a99-423b-97b8-8f7d21f5157f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.542006 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f26852-7a99-423b-97b8-8f7d21f5157f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.542288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f26852-7a99-423b-97b8-8f7d21f5157f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.569644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d7f26852-7a99-423b-97b8-8f7d21f5157f None None] MFA Rules not processed for user `808a5e0d8a2a4d0791a756d59333118a`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:57.570962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d7f26852-7a99-423b-97b8-8f7d21f5157f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:57.578962 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc8cd8-7d19-432e-b30f-02955b60b25f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:57.579696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8cd8-7d19-432e-b30f-02955b60b25f service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.579986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8cd8-7d19-432e-b30f-02955b60b25f service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.580283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc8cd8-7d19-432e-b30f-02955b60b25f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.585120 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:57.624062 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:57.643539 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc8cd8-7d19-432e-b30f-02955b60b25f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:57.646355 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1297/2598] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:53:57.646485 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc8cd8-7d19-432e-b30f-02955b60b25f service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:57.654880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f26852-7a99-423b-97b8-8f7d21f5157f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:57.655643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1302/2599] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:57 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:53:57.656364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d7f26852-7a99-423b-97b8-8f7d21f5157f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:57.669267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f26852-7a99-423b-97b8-8f7d21f5157f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:57.672927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58ff99-0f0a-4eb4-902a-f41cf059c4e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:57.673579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58ff99-0f0a-4eb4-902a-f41cf059c4e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.673896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58ff99-0f0a-4eb4-902a-f41cf059c4e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.674175 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58ff99-0f0a-4eb4-902a-f41cf059c4e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.684481 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58ff99-0f0a-4eb4-902a-f41cf059c4e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:57.685991 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d58ff99-0f0a-4eb4-902a-f41cf059c4e1 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:57.696538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1298/2600] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:57.727271 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc8cd8-7d19-432e-b30f-02955b60b25f service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:57.755309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58ff99-0f0a-4eb4-902a-f41cf059c4e1 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:57.764409 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58ff99-0f0a-4eb4-902a-f41cf059c4e1 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:57.768359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29612f7-61a3-4488-8a09-16ba177329fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:57.769081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29612f7-61a3-4488-8a09-16ba177329fa service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.769439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29612f7-61a3-4488-8a09-16ba177329fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.769835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29612f7-61a3-4488-8a09-16ba177329fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.796261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc8cd8-7d19-432e-b30f-02955b60b25f service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:57.801128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13382a-2266-445f-b6f8-f4b2f268c2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:57.802051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13382a-2266-445f-b6f8-f4b2f268c2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:57.802330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13382a-2266-445f-b6f8-f4b2f268c2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:57.802605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13382a-2266-445f-b6f8-f4b2f268c2fd admin admin] PATH_INFO: `/v3/users/ed28bf81e7eb4bc489bce4b95609366b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:57.803824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13382a-2266-445f-b6f8-f4b2f268c2fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed28bf81e7eb4bc489bce4b95609366b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:57.805808 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13382a-2266-445f-b6f8-f4b2f268c2fd admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:57.834781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29612f7-61a3-4488-8a09-16ba177329fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:57.836332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29612f7-61a3-4488-8a09-16ba177329fa service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:57.845778 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1299/2601] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:53:57.982168 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2c13382a-2266-445f-b6f8-f4b2f268c2fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed28bf81e7eb4bc489bce4b95609366b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:57.982831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2c13382a-2266-445f-b6f8-f4b2f268c2fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed28bf81e7eb4bc489bce4b95609366b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:57.983461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2c13382a-2266-445f-b6f8-f4b2f268c2fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed28bf81e7eb4bc489bce4b95609366b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:57.996194 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2c13382a-2266-445f-b6f8-f4b2f268c2fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed28bf81e7eb4bc489bce4b95609366b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:58.002949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-2c13382a-2266-445f-b6f8-f4b2f268c2fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed28bf81e7eb4bc489bce4b95609366b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:58.052364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1303/2602] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:53:57 2022] DELETE /identity/v3/users/ed28bf81e7eb4bc489bce4b95609366b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:58.057037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18c83-332c-459a-8350-9b274d6c9f16 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:58.057545 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18c83-332c-459a-8350-9b274d6c9f16 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:58.057666 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d18c83-332c-459a-8350-9b274d6c9f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:58.074986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-00d18c83-332c-459a-8350-9b274d6c9f16 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:53:58.076306 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-00d18c83-332c-459a-8350-9b274d6c9f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:58.137431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1300/2603] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:53:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:53:58.147196 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13382a-2266-445f-b6f8-f4b2f268c2fd admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:58.148625 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2c13382a-2266-445f-b6f8-f4b2f268c2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:58.207580 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13382a-2266-445f-b6f8-f4b2f268c2fd admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:58.211305 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86e103-1bc1-416e-b730-265e2b9402b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:58.211958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86e103-1bc1-416e-b730-265e2b9402b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:58.212249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86e103-1bc1-416e-b730-265e2b9402b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:58.213052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86e103-1bc1-416e-b730-265e2b9402b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:58.222682 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86e103-1bc1-416e-b730-265e2b9402b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:58.224171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86e103-1bc1-416e-b730-265e2b9402b1 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:58.230203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:58.235068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1304/2604] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:53:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:53:58.668406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18c83-332c-459a-8350-9b274d6c9f16 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:58.670898 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-00d18c83-332c-459a-8350-9b274d6c9f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:58.683331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d18c83-332c-459a-8350-9b274d6c9f16 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:58.688372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:58.689789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:58.690082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:58.690508 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] PATH_INFO: `/v3/projects/cd6f90490e5a4bf8bab4b6ddc686d441` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:58.691810 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6f90490e5a4bf8bab4b6ddc686d441)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:58.693834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:58.798557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:53:58.810844 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6f90490e5a4bf8bab4b6ddc686d441', 'request_id': 'req-644d64be-f14f-4669-8e1a-b34eca25548b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:58.895504 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6f90490e5a4bf8bab4b6ddc686d441', 'request_id': 'req-644d64be-f14f-4669-8e1a-b34eca25548b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:58.902204 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6f90490e5a4bf8bab4b6ddc686d441', 'request_id': 'req-644d64be-f14f-4669-8e1a-b34eca25548b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:58.912492 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] The token cache is being invalidate because project cd6f90490e5a4bf8bab4b6ddc686d441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:53:58.912725 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:58.913372 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:58.914953 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1301/2605] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:58 2022] DELETE /identity/v3/projects/cd6f90490e5a4bf8bab4b6ddc686d441 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:58.919024 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86e103-1bc1-416e-b730-265e2b9402b1 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:58.928660 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86e103-1bc1-416e-b730-265e2b9402b1 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:58.986270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7922f4c-3769-408f-955b-62f086fb461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:58.987178 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7922f4c-3769-408f-955b-62f086fb461d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:58.987463 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7922f4c-3769-408f-955b-62f086fb461d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:58.987737 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7922f4c-3769-408f-955b-62f086fb461d admin admin] PATH_INFO: `/v3/users/808a5e0d8a2a4d0791a756d59333118a` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:58.988923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7922f4c-3769-408f-955b-62f086fb461d admin admin] RBAC: Authorizing `identity:delete_user(user_id=808a5e0d8a2a4d0791a756d59333118a)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:58.990885 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7922f4c-3769-408f-955b-62f086fb461d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:59.200171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d7922f4c-3769-408f-955b-62f086fb461d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '808a5e0d8a2a4d0791a756d59333118a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:59.200822 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d7922f4c-3769-408f-955b-62f086fb461d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '808a5e0d8a2a4d0791a756d59333118a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:59.201428 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d7922f4c-3769-408f-955b-62f086fb461d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '808a5e0d8a2a4d0791a756d59333118a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:59.213160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d7922f4c-3769-408f-955b-62f086fb461d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '808a5e0d8a2a4d0791a756d59333118a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:59.220137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d7922f4c-3769-408f-955b-62f086fb461d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '808a5e0d8a2a4d0791a756d59333118a'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:53:59.301139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1305/2606] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:53:58 2022] DELETE /identity/v3/users/808a5e0d8a2a4d0791a756d59333118a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:53:59.760865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:53:59.762133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:53:59.776469 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d64be-f14f-4669-8e1a-b34eca25548b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:53:59.841896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901df617-0dc1-41ed-ae96-f1a8807a95e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:53:59.842934 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901df617-0dc1-41ed-ae96-f1a8807a95e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:53:59.846156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901df617-0dc1-41ed-ae96-f1a8807a95e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:53:59.846156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901df617-0dc1-41ed-ae96-f1a8807a95e1 admin admin] PATH_INFO: `/v3/projects/b35a0921ea0f4b758ca448d85a8e55d8` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:53:59.846156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901df617-0dc1-41ed-ae96-f1a8807a95e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b35a0921ea0f4b758ca448d85a8e55d8)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:53:59.847209 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901df617-0dc1-41ed-ae96-f1a8807a95e1 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:53:59.976660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-901df617-0dc1-41ed-ae96-f1a8807a95e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b35a0921ea0f4b758ca448d85a8e55d8', 'request_id': 'req-901df617-0dc1-41ed-ae96-f1a8807a95e1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:00.044080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-901df617-0dc1-41ed-ae96-f1a8807a95e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b35a0921ea0f4b758ca448d85a8e55d8', 'request_id': 'req-901df617-0dc1-41ed-ae96-f1a8807a95e1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:00.050808 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-901df617-0dc1-41ed-ae96-f1a8807a95e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b35a0921ea0f4b758ca448d85a8e55d8', 'request_id': 'req-901df617-0dc1-41ed-ae96-f1a8807a95e1'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:00.062530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-901df617-0dc1-41ed-ae96-f1a8807a95e1 admin admin] The token cache is being invalidate because project b35a0921ea0f4b758ca448d85a8e55d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:54:00.062822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-901df617-0dc1-41ed-ae96-f1a8807a95e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:00.066959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-901df617-0dc1-41ed-ae96-f1a8807a95e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:00.066959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1302/2607] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:53:59 2022] DELETE /identity/v3/projects/b35a0921ea0f4b758ca448d85a8e55d8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:00.071351 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb7d07-1bbb-4451-a840-658b58a8d57b None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:00.071916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb7d07-1bbb-4451-a840-658b58a8d57b None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:00.072255 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb7d07-1bbb-4451-a840-658b58a8d57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:00.091234 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-74eb7d07-1bbb-4451-a840-658b58a8d57b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:00.094919 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-74eb7d07-1bbb-4451-a840-658b58a8d57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:00.157631 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1306/2608] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:54:00.165463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f4db-8220-4920-b13f-51e7b5f4ec15 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:00.166309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f4db-8220-4920-b13f-51e7b5f4ec15 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:00.166594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f4db-8220-4920-b13f-51e7b5f4ec15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:00.186644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-72f9f4db-8220-4920-b13f-51e7b5f4ec15 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:00.187856 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-72f9f4db-8220-4920-b13f-51e7b5f4ec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:00.195954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1303/2609] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:00.200300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb7d07-1bbb-4451-a840-658b58a8d57b None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:00.210063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb7d07-1bbb-4451-a840-658b58a8d57b None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:00.215010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cb818-c389-46ac-974a-3170c3dd556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:00.215682 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cb818-c389-46ac-974a-3170c3dd556c admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:00.218471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cb818-c389-46ac-974a-3170c3dd556c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:00.218471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cb818-c389-46ac-974a-3170c3dd556c admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:00.218471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cb818-c389-46ac-974a-3170c3dd556c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:54:00.218471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cb818-c389-46ac-974a-3170c3dd556c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:00.218882 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cb818-c389-46ac-974a-3170c3dd556c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:00.230849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1307/2610] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:54:00.235223 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9f4db-8220-4920-b13f-51e7b5f4ec15 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:00.245545 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f9f4db-8220-4920-b13f-51e7b5f4ec15 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:00.250156 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae63d57-0f6c-48e3-a63b-07b8079c3316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:00.250824 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae63d57-0f6c-48e3-a63b-07b8079c3316 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:00.251151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae63d57-0f6c-48e3-a63b-07b8079c3316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:00.251378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae63d57-0f6c-48e3-a63b-07b8079c3316 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:00.252071 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae63d57-0f6c-48e3-a63b-07b8079c3316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:00.253978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae63d57-0f6c-48e3-a63b-07b8079c3316 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:00.328966 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1304/2611] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:54:00 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:54:00.332952 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cb818-c389-46ac-974a-3170c3dd556c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:00.343452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cb818-c389-46ac-974a-3170c3dd556c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:00.346979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:00.400388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15c8cb-d659-48fa-823f-9d66ddc4f2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:00.401367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15c8cb-d659-48fa-823f-9d66ddc4f2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:00.401653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15c8cb-d659-48fa-823f-9d66ddc4f2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:00.402017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15c8cb-d659-48fa-823f-9d66ddc4f2e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:00.402769 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15c8cb-d659-48fa-823f-9d66ddc4f2e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:00.404709 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15c8cb-d659-48fa-823f-9d66ddc4f2e8 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:00.510252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1308/2612] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:54:00 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:54:00.514392 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae63d57-0f6c-48e3-a63b-07b8079c3316 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:00.524710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae63d57-0f6c-48e3-a63b-07b8079c3316 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:00.530143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ba80c-432b-4571-966a-64d0e622b5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:00.530801 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ba80c-432b-4571-966a-64d0e622b5df admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:00.531089 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ba80c-432b-4571-966a-64d0e622b5df admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:00.535723 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ba80c-432b-4571-966a-64d0e622b5df admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:00.535723 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ba80c-432b-4571-966a-64d0e622b5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:00.535723 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ba80c-432b-4571-966a-64d0e622b5df admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:00.545308 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1305/2613] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:54:00.549380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15c8cb-d659-48fa-823f-9d66ddc4f2e8 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:00.559370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15c8cb-d659-48fa-823f-9d66ddc4f2e8 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:00.564056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b457165-f105-43b0-b36f-0ea1f592fad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:00.564717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457165-f105-43b0-b36f-0ea1f592fad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:00.565005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457165-f105-43b0-b36f-0ea1f592fad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:00.565292 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b457165-f105-43b0-b36f-0ea1f592fad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:00.566059 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b457165-f105-43b0-b36f-0ea1f592fad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:00.567667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b457165-f105-43b0-b36f-0ea1f592fad6 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:00.577458 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1309/2614] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:54:00.581660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ba80c-432b-4571-966a-64d0e622b5df admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:00.592051 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ba80c-432b-4571-966a-64d0e622b5df admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:00.596701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fea09d-b375-4d1f-9c03-5ec4ea10969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:00.597578 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fea09d-b375-4d1f-9c03-5ec4ea10969a admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:00.597902 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fea09d-b375-4d1f-9c03-5ec4ea10969a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:00.598182 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fea09d-b375-4d1f-9c03-5ec4ea10969a admin admin] PATH_INFO: `/v3/projects/eb45cf57e1e442e79bcb2982b1ea116f/users/3adcee12fdba4b6ba807933e27a10593/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:00.606789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:00.613637 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fea09d-b375-4d1f-9c03-5ec4ea10969a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb45cf57e1e442e79bcb2982b1ea116f, user_id=3adcee12fdba4b6ba807933e27a10593, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:00.616309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fea09d-b375-4d1f-9c03-5ec4ea10969a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:00.692890 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1306/2615] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:54:00 2022] PUT /identity/v3/projects/eb45cf57e1e442e79bcb2982b1ea116f/users/3adcee12fdba4b6ba807933e27a10593/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:00.704770 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c175e48-edd0-43ca-afd3-7f25e4492222 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:00.705060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c175e48-edd0-43ca-afd3-7f25e4492222 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:00.705344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c175e48-edd0-43ca-afd3-7f25e4492222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:00.733452 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6c175e48-edd0-43ca-afd3-7f25e4492222 None None] MFA Rules not processed for user `3adcee12fdba4b6ba807933e27a10593`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:00.734717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6c175e48-edd0-43ca-afd3-7f25e4492222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:00.799108 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1310/2616] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:00.803716 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fea09d-b375-4d1f-9c03-5ec4ea10969a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:00.866579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fea09d-b375-4d1f-9c03-5ec4ea10969a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:00.871541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb554df-126d-48be-9fb6-d4e8ac4387cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:00.872323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb554df-126d-48be-9fb6-d4e8ac4387cd admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:00.872648 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb554df-126d-48be-9fb6-d4e8ac4387cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:00.872931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb554df-126d-48be-9fb6-d4e8ac4387cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:00.873622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb554df-126d-48be-9fb6-d4e8ac4387cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:00.875653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb554df-126d-48be-9fb6-d4e8ac4387cd admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:00.924267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c175e48-edd0-43ca-afd3-7f25e4492222 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:00.925666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6c175e48-edd0-43ca-afd3-7f25e4492222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:00.940690 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c175e48-edd0-43ca-afd3-7f25e4492222 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:00.945535 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240b061-2ca3-4a30-b2ad-caa58cf2cde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:00.946816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240b061-2ca3-4a30-b2ad-caa58cf2cde0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:00.947106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240b061-2ca3-4a30-b2ad-caa58cf2cde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:00.947386 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240b061-2ca3-4a30-b2ad-caa58cf2cde0 admin admin] PATH_INFO: `/v3/users/f4a3f58287844487a4b028eb4fd8b34c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:00.949127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240b061-2ca3-4a30-b2ad-caa58cf2cde0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a3f58287844487a4b028eb4fd8b34c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:00.953340 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240b061-2ca3-4a30-b2ad-caa58cf2cde0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:00.983765 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1307/2617] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:54:00 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:54:00.984727 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb554df-126d-48be-9fb6-d4e8ac4387cd admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:01.048285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb554df-126d-48be-9fb6-d4e8ac4387cd admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:01.052946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f39792-b8b4-4967-9e9d-6386794bc5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:01.053622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39792-b8b4-4967-9e9d-6386794bc5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:01.053940 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39792-b8b4-4967-9e9d-6386794bc5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:01.054253 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f39792-b8b4-4967-9e9d-6386794bc5d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:01.055166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f39792-b8b4-4967-9e9d-6386794bc5d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:01.057101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f39792-b8b4-4967-9e9d-6386794bc5d7 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:01.174564 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1308/2618] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:54:00 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:54:01.178517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f39792-b8b4-4967-9e9d-6386794bc5d7 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:01.181938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0240b061-2ca3-4a30-b2ad-caa58cf2cde0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a3f58287844487a4b028eb4fd8b34c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:01.182656 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0240b061-2ca3-4a30-b2ad-caa58cf2cde0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a3f58287844487a4b028eb4fd8b34c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:01.183377 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0240b061-2ca3-4a30-b2ad-caa58cf2cde0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a3f58287844487a4b028eb4fd8b34c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:01.189057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f39792-b8b4-4967-9e9d-6386794bc5d7 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:01.193854 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2170f-738f-4167-bcc5-5b486049fa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:01.194516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2170f-738f-4167-bcc5-5b486049fa63 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:01.194805 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2170f-738f-4167-bcc5-5b486049fa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:01.195087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2170f-738f-4167-bcc5-5b486049fa63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:01.195819 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2170f-738f-4167-bcc5-5b486049fa63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:01.196038 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0240b061-2ca3-4a30-b2ad-caa58cf2cde0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a3f58287844487a4b028eb4fd8b34c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:01.197627 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2170f-738f-4167-bcc5-5b486049fa63 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:01.201443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:01.204450 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-0240b061-2ca3-4a30-b2ad-caa58cf2cde0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a3f58287844487a4b028eb4fd8b34c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:01.210822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1309/2619] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:54:01.213501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2170f-738f-4167-bcc5-5b486049fa63 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:01.215883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e4e2170f-738f-4167-bcc5-5b486049fa63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:01.228880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2170f-738f-4167-bcc5-5b486049fa63 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:01.234244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b443d-2ed7-4f69-b646-5b288373ee90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:01.236621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b443d-2ed7-4f69-b646-5b288373ee90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:01.236621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b443d-2ed7-4f69-b646-5b288373ee90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:01.236621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b443d-2ed7-4f69-b646-5b288373ee90 admin admin] PATH_INFO: `/v3/projects/0ce262edab5a4a3cbe3595481f9a7831/users/ace1118d32cc4aeaaba1fbeb00c8ff55/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:01.250729 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b443d-2ed7-4f69-b646-5b288373ee90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce262edab5a4a3cbe3595481f9a7831, user_id=ace1118d32cc4aeaaba1fbeb00c8ff55, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:01.253410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b443d-2ed7-4f69-b646-5b288373ee90 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:01.295942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1311/2620] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:54:00 2022] DELETE /identity/v3/users/f4a3f58287844487a4b028eb4fd8b34c => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:01.300269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910196bc-f1a0-42a2-a7cb-9e261084d2e1 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:01.300565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910196bc-f1a0-42a2-a7cb-9e261084d2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:01.300845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910196bc-f1a0-42a2-a7cb-9e261084d2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:01.319128 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-910196bc-f1a0-42a2-a7cb-9e261084d2e1 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:01.320368 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-910196bc-f1a0-42a2-a7cb-9e261084d2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:01.357545 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1310/2621] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:54:01 2022] PUT /identity/v3/projects/0ce262edab5a4a3cbe3595481f9a7831/users/ace1118d32cc4aeaaba1fbeb00c8ff55/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:01.361570 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b443d-2ed7-4f69-b646-5b288373ee90 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:01.379172 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1312/2622] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:54:01.389553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910196bc-f1a0-42a2-a7cb-9e261084d2e1 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:01.391017 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-910196bc-f1a0-42a2-a7cb-9e261084d2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:01.395265 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:01.427406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b443d-2ed7-4f69-b646-5b288373ee90 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:01.432087 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5e26d-f898-456a-b422-4ff7b803691f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:01.432921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5e26d-f898-456a-b422-4ff7b803691f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:01.433215 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5e26d-f898-456a-b422-4ff7b803691f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:01.433519 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5e26d-f898-456a-b422-4ff7b803691f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:01.434402 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5e26d-f898-456a-b422-4ff7b803691f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:01.436011 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5e26d-f898-456a-b422-4ff7b803691f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:01.450202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1311/2623] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:54:01.450381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910196bc-f1a0-42a2-a7cb-9e261084d2e1 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:01.451254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5e26d-f898-456a-b422-4ff7b803691f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:01.460803 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5e26d-f898-456a-b422-4ff7b803691f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:01.466122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa15e8a-f273-4a53-a084-d299a942f5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:01.466998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa15e8a-f273-4a53-a084-d299a942f5d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:01.467288 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa15e8a-f273-4a53-a084-d299a942f5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:01.467594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa15e8a-f273-4a53-a084-d299a942f5d0 admin admin] PATH_INFO: `/v3/projects/0ce262edab5a4a3cbe3595481f9a7831/users/ace1118d32cc4aeaaba1fbeb00c8ff55/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:01.469693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa15e8a-f273-4a53-a084-d299a942f5d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ce262edab5a4a3cbe3595481f9a7831, user_id=ace1118d32cc4aeaaba1fbeb00c8ff55, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:01.472365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa15e8a-f273-4a53-a084-d299a942f5d0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:01.483690 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1312/2624] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:54:01 2022] PUT /identity/v3/projects/0ce262edab5a4a3cbe3595481f9a7831/users/ace1118d32cc4aeaaba1fbeb00c8ff55/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:01.494093 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63057e3e-38a3-47cc-977e-80e73d546b05 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:01.494383 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63057e3e-38a3-47cc-977e-80e73d546b05 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:01.494663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63057e3e-38a3-47cc-977e-80e73d546b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:01.496960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587f49f-4835-4bc8-99bd-24bc4b26fcee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:01.497518 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587f49f-4835-4bc8-99bd-24bc4b26fcee service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:01.497835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587f49f-4835-4bc8-99bd-24bc4b26fcee service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:01.498240 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587f49f-4835-4bc8-99bd-24bc4b26fcee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:01.507817 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587f49f-4835-4bc8-99bd-24bc4b26fcee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:01.513832 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587f49f-4835-4bc8-99bd-24bc4b26fcee service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:01.519667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1313/2625] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:54:01.522836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-63057e3e-38a3-47cc-977e-80e73d546b05 None None] MFA Rules not processed for user `ace1118d32cc4aeaaba1fbeb00c8ff55`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:01.524048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-63057e3e-38a3-47cc-977e-80e73d546b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:01.594303 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1313/2626] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:54:01.607917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587f49f-4835-4bc8-99bd-24bc4b26fcee service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:01.609380 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8587f49f-4835-4bc8-99bd-24bc4b26fcee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:01.661707 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:01.667388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587f49f-4835-4bc8-99bd-24bc4b26fcee service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:01.717648 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d52a83-b421-4bfe-ba2c-014439094efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:01.718362 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d52a83-b421-4bfe-ba2c-014439094efb service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:01.718649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d52a83-b421-4bfe-ba2c-014439094efb service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:01.718931 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d52a83-b421-4bfe-ba2c-014439094efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:01.728680 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d52a83-b421-4bfe-ba2c-014439094efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:01.730575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d52a83-b421-4bfe-ba2c-014439094efb service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:01.743679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1314/2627] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:54:01.946290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63057e3e-38a3-47cc-977e-80e73d546b05 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:01.949649 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-63057e3e-38a3-47cc-977e-80e73d546b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:02.023189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63057e3e-38a3-47cc-977e-80e73d546b05 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:02.028629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:02.029500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:02.029838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:02.030115 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] PATH_INFO: `/v3/projects/0aacd4947457464980f0a67da87aeddc` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:02.031359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aacd4947457464980f0a67da87aeddc)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:02.033377 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:02.173650 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:02.181673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aacd4947457464980f0a67da87aeddc', 'request_id': 'req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:02.262106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aacd4947457464980f0a67da87aeddc', 'request_id': 'req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:02.269495 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aacd4947457464980f0a67da87aeddc', 'request_id': 'req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:02.282704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] The token cache is being invalidate because project 0aacd4947457464980f0a67da87aeddc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:54:02.283177 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:02.284165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:02.286711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1314/2628] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:54:01 2022] DELETE /identity/v3/projects/0aacd4947457464980f0a67da87aeddc => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:02.292783 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d52a83-b421-4bfe-ba2c-014439094efb service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:02.304297 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d52a83-b421-4bfe-ba2c-014439094efb service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:02.361400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb60f01-fb03-4d66-81bc-d63e489946a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:02.362337 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb60f01-fb03-4d66-81bc-d63e489946a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:02.362628 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb60f01-fb03-4d66-81bc-d63e489946a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:02.362910 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb60f01-fb03-4d66-81bc-d63e489946a0 admin admin] PATH_INFO: `/v3/users/8e20c52b031d49f18d63e69cb1c07591` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:02.364112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb60f01-fb03-4d66-81bc-d63e489946a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e20c52b031d49f18d63e69cb1c07591)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:02.366100 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb60f01-fb03-4d66-81bc-d63e489946a0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:02.521155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fcb60f01-fb03-4d66-81bc-d63e489946a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e20c52b031d49f18d63e69cb1c07591'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:02.521787 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fcb60f01-fb03-4d66-81bc-d63e489946a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e20c52b031d49f18d63e69cb1c07591'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:02.522441 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fcb60f01-fb03-4d66-81bc-d63e489946a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e20c52b031d49f18d63e69cb1c07591'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:02.540754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fcb60f01-fb03-4d66-81bc-d63e489946a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e20c52b031d49f18d63e69cb1c07591'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:02.548608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-fcb60f01-fb03-4d66-81bc-d63e489946a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e20c52b031d49f18d63e69cb1c07591'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:02.610699 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1315/2629] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:54:02 2022] DELETE /identity/v3/users/8e20c52b031d49f18d63e69cb1c07591 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:02.876821 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:02.878507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:02.892677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e93ed4c-4f83-423d-9b76-b428e35bb9f6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:02.951534 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e9537-3d65-4598-a7ff-65dce0772c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:02.952420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9537-3d65-4598-a7ff-65dce0772c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:02.952701 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9537-3d65-4598-a7ff-65dce0772c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:02.952978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9537-3d65-4598-a7ff-65dce0772c87 admin admin] PATH_INFO: `/v3/users/3adcee12fdba4b6ba807933e27a10593` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:02.954210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e9537-3d65-4598-a7ff-65dce0772c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3adcee12fdba4b6ba807933e27a10593)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:02.961383 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e9537-3d65-4598-a7ff-65dce0772c87 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:03.037524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb60f01-fb03-4d66-81bc-d63e489946a0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:03.039385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-fcb60f01-fb03-4d66-81bc-d63e489946a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:03.053413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb60f01-fb03-4d66-81bc-d63e489946a0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:03.058657 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:03.059273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:03.059671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:03.060053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] PATH_INFO: `/v3/projects/cb92eda4fe1f48d6a627c92f6deb1a53` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:03.061490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb92eda4fe1f48d6a627c92f6deb1a53)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:03.063916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:03.092644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:03.175289 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-923e9537-3d65-4598-a7ff-65dce0772c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3adcee12fdba4b6ba807933e27a10593'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:03.208225 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb92eda4fe1f48d6a627c92f6deb1a53', 'request_id': 'req-17c30865-3406-4b79-a797-0038f8232645'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:03.270188 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-923e9537-3d65-4598-a7ff-65dce0772c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3adcee12fdba4b6ba807933e27a10593'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:03.270822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-923e9537-3d65-4598-a7ff-65dce0772c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3adcee12fdba4b6ba807933e27a10593'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:03.278613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-923e9537-3d65-4598-a7ff-65dce0772c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3adcee12fdba4b6ba807933e27a10593'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:03.280189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-923e9537-3d65-4598-a7ff-65dce0772c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3adcee12fdba4b6ba807933e27a10593'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:03.298268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1315/2630] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:54:02 2022] DELETE /identity/v3/users/3adcee12fdba4b6ba807933e27a10593 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:03.302841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebc448-e9f7-45f8-a8fb-3a3524a3b4ed None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:03.303062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebc448-e9f7-45f8-a8fb-3a3524a3b4ed None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:03.303336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebc448-e9f7-45f8-a8fb-3a3524a3b4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:03.320259 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-97ebc448-e9f7-45f8-a8fb-3a3524a3b4ed None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:03.321452 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-97ebc448-e9f7-45f8-a8fb-3a3524a3b4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:03.361122 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:03.361624 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb92eda4fe1f48d6a627c92f6deb1a53', 'request_id': 'req-17c30865-3406-4b79-a797-0038f8232645'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:03.367766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb92eda4fe1f48d6a627c92f6deb1a53', 'request_id': 'req-17c30865-3406-4b79-a797-0038f8232645'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:03.379824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] The token cache is being invalidate because project cb92eda4fe1f48d6a627c92f6deb1a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:54:03.379984 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1316/2631] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:54:03.380256 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:03.387504 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:03.387504 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1316/2632] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:54:03 2022] DELETE /identity/v3/projects/cb92eda4fe1f48d6a627c92f6deb1a53 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:03.387918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8ec06-46fc-4b5b-a52d-212d7fc75ee1 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:03.387918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8ec06-46fc-4b5b-a52d-212d7fc75ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:03.388098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8ec06-46fc-4b5b-a52d-212d7fc75ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:03.390105 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:03.391487 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:03.406754 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-47b8ec06-46fc-4b5b-a52d-212d7fc75ee1 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:03.407982 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-47b8ec06-46fc-4b5b-a52d-212d7fc75ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:03.416154 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1317/2633] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:54:03.424552 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9b42d-32c8-4238-8f6e-a51177c3a8d4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:03.424846 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9b42d-32c8-4238-8f6e-a51177c3a8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:03.425130 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea9b42d-32c8-4238-8f6e-a51177c3a8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:03.442483 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4ea9b42d-32c8-4238-8f6e-a51177c3a8d4 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:03.443709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4ea9b42d-32c8-4238-8f6e-a51177c3a8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:03.449985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c30865-3406-4b79-a797-0038f8232645 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:03.451950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1318/2634] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:03.456582 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9b42d-32c8-4238-8f6e-a51177c3a8d4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:03.465531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea9b42d-32c8-4238-8f6e-a51177c3a8d4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:03.471865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843790f2-4d91-47bb-a07c-f50d93cf285f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:03.472620 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843790f2-4d91-47bb-a07c-f50d93cf285f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:03.473015 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843790f2-4d91-47bb-a07c-f50d93cf285f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:03.473453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843790f2-4d91-47bb-a07c-f50d93cf285f admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:03.474466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843790f2-4d91-47bb-a07c-f50d93cf285f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:54:03.474876 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843790f2-4d91-47bb-a07c-f50d93cf285f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:03.476706 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843790f2-4d91-47bb-a07c-f50d93cf285f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:03.489376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1319/2635] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:54:03.493667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843790f2-4d91-47bb-a07c-f50d93cf285f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:03.502449 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf3a5e-21b4-4307-b739-725eabe54e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:03.503112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf3a5e-21b4-4307-b739-725eabe54e8f service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:03.503399 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf3a5e-21b4-4307-b739-725eabe54e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:03.503684 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf3a5e-21b4-4307-b739-725eabe54e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:03.504986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843790f2-4d91-47bb-a07c-f50d93cf285f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:03.505494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c6bf3a5e-21b4-4307-b739-725eabe54e8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:03.510147 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7dfee-9207-4999-bb72-424cdbb56fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:03.510814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7dfee-9207-4999-bb72-424cdbb56fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:03.511096 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7dfee-9207-4999-bb72-424cdbb56fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:03.511391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7dfee-9207-4999-bb72-424cdbb56fb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:03.512079 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7dfee-9207-4999-bb72-424cdbb56fb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:03.514554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7dfee-9207-4999-bb72-424cdbb56fb4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:03.517713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf3a5e-21b4-4307-b739-725eabe54e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:03.519160 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf3a5e-21b4-4307-b739-725eabe54e8f service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:03.528795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1317/2636] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:54:03.599354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1320/2637] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:54:03 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:54:03.603189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf3a5e-21b4-4307-b739-725eabe54e8f service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:03.613615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf3a5e-21b4-4307-b739-725eabe54e8f service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:03.670920 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd6059-7e10-4ccc-a8e0-de65b5611c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:03.671598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd6059-7e10-4ccc-a8e0-de65b5611c6c admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:03.671886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd6059-7e10-4ccc-a8e0-de65b5611c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:03.672165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd6059-7e10-4ccc-a8e0-de65b5611c6c admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:03.672870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd6059-7e10-4ccc-a8e0-de65b5611c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:03.674921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd6059-7e10-4ccc-a8e0-de65b5611c6c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:03.684276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:03.772387 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1318/2638] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:54:03 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:54:03.773913 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7dfee-9207-4999-bb72-424cdbb56fb4 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:03.785453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7dfee-9207-4999-bb72-424cdbb56fb4 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:03.790306 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d86360-dfcc-4f6e-b178-83dbac9e4bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:03.790973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d86360-dfcc-4f6e-b178-83dbac9e4bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:03.791389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d86360-dfcc-4f6e-b178-83dbac9e4bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:03.791556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d86360-dfcc-4f6e-b178-83dbac9e4bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:03.792387 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d86360-dfcc-4f6e-b178-83dbac9e4bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:03.794031 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d86360-dfcc-4f6e-b178-83dbac9e4bdf admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:03.809909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1321/2639] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:54:03.811450 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd6059-7e10-4ccc-a8e0-de65b5611c6c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:03.821930 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd6059-7e10-4ccc-a8e0-de65b5611c6c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:03.827480 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26413e5-7aec-499d-9159-a95c77851de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:03.828205 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26413e5-7aec-499d-9159-a95c77851de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:03.828528 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26413e5-7aec-499d-9159-a95c77851de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:03.828816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26413e5-7aec-499d-9159-a95c77851de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:03.829554 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26413e5-7aec-499d-9159-a95c77851de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:03.831285 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26413e5-7aec-499d-9159-a95c77851de7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:03.842871 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1319/2640] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:54:03.846677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d86360-dfcc-4f6e-b178-83dbac9e4bdf admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:03.856690 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d86360-dfcc-4f6e-b178-83dbac9e4bdf admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:03.861644 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44ebed-e773-4502-88dc-5ae0c5425835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:03.862561 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ebed-e773-4502-88dc-5ae0c5425835 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:03.862850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ebed-e773-4502-88dc-5ae0c5425835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:03.863128 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44ebed-e773-4502-88dc-5ae0c5425835 admin admin] PATH_INFO: `/v3/projects/971293da3f1a4b1591ec9676a7cff839/users/76f4a84d5e7042b1823f5e0e157f9e3b/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:03.879293 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44ebed-e773-4502-88dc-5ae0c5425835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=971293da3f1a4b1591ec9676a7cff839, user_id=76f4a84d5e7042b1823f5e0e157f9e3b, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:03.881980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f44ebed-e773-4502-88dc-5ae0c5425835 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:03.960406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26413e5-7aec-499d-9159-a95c77851de7 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:03.962166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a26413e5-7aec-499d-9159-a95c77851de7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:03.979651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1322/2641] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:54:03 2022] PUT /identity/v3/projects/971293da3f1a4b1591ec9676a7cff839/users/76f4a84d5e7042b1823f5e0e157f9e3b/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:03.980119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26413e5-7aec-499d-9159-a95c77851de7 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:04.042466 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532e079-2f08-4d33-a9fa-031ded4550b3 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:04.042989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532e079-2f08-4d33-a9fa-031ded4550b3 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:04.043471 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532e079-2f08-4d33-a9fa-031ded4550b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:04.056853 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:04.057744 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:04.058041 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:04.058322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] PATH_INFO: `/v3/projects/eb45cf57e1e442e79bcb2982b1ea116f` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:04.059536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb45cf57e1e442e79bcb2982b1ea116f)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:04.062390 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:04.073551 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a532e079-2f08-4d33-a9fa-031ded4550b3 None None] MFA Rules not processed for user `76f4a84d5e7042b1823f5e0e157f9e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:04.074800 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a532e079-2f08-4d33-a9fa-031ded4550b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:04.145921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1323/2642] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:54:04.150541 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532e079-2f08-4d33-a9fa-031ded4550b3 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:04.160957 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532e079-2f08-4d33-a9fa-031ded4550b3 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:04.161980 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb45cf57e1e442e79bcb2982b1ea116f', 'request_id': 'req-a92b2c65-e62e-423b-9da8-5bb376e93e61'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:04.207846 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:04.217174 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e522a-4109-4d34-b2b1-e8c9502365a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:04.217890 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e522a-4109-4d34-b2b1-e8c9502365a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:04.218179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e522a-4109-4d34-b2b1-e8c9502365a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:04.218460 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e522a-4109-4d34-b2b1-e8c9502365a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:04.219152 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e522a-4109-4d34-b2b1-e8c9502365a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:04.221097 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e522a-4109-4d34-b2b1-e8c9502365a6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:04.244267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb45cf57e1e442e79bcb2982b1ea116f', 'request_id': 'req-a92b2c65-e62e-423b-9da8-5bb376e93e61'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:04.251030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb45cf57e1e442e79bcb2982b1ea116f', 'request_id': 'req-a92b2c65-e62e-423b-9da8-5bb376e93e61'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:04.262589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] The token cache is being invalidate because project eb45cf57e1e442e79bcb2982b1ea116f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:54:04.262877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:04.264714 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:04.266332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1320/2643] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:54:03 2022] DELETE /identity/v3/projects/eb45cf57e1e442e79bcb2982b1ea116f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:04.270150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:04.271474 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:04.284052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b2c65-e62e-423b-9da8-5bb376e93e61 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:04.288687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62be572-f1a0-483a-b6af-bab51d52a41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:04.289526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62be572-f1a0-483a-b6af-bab51d52a41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:04.289833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62be572-f1a0-483a-b6af-bab51d52a41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:04.290105 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62be572-f1a0-483a-b6af-bab51d52a41a admin admin] PATH_INFO: `/v3/users/ace1118d32cc4aeaaba1fbeb00c8ff55` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:04.291371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62be572-f1a0-483a-b6af-bab51d52a41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace1118d32cc4aeaaba1fbeb00c8ff55)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:04.293259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62be572-f1a0-483a-b6af-bab51d52a41a admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:04.329046 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1324/2644] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:54:04 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:54:04.332391 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e522a-4109-4d34-b2b1-e8c9502365a6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:04.333945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-998e522a-4109-4d34-b2b1-e8c9502365a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:04.398206 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e522a-4109-4d34-b2b1-e8c9502365a6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:04.402702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a2064-fc28-474c-80d2-4196f2cf9b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:04.403416 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a2064-fc28-474c-80d2-4196f2cf9b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:04.403703 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a2064-fc28-474c-80d2-4196f2cf9b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:04.404144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a2064-fc28-474c-80d2-4196f2cf9b3b admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:04.404909 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a2064-fc28-474c-80d2-4196f2cf9b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:04.406876 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a2064-fc28-474c-80d2-4196f2cf9b3b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:04.472557 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a62be572-f1a0-483a-b6af-bab51d52a41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace1118d32cc4aeaaba1fbeb00c8ff55'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:04.473206 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a62be572-f1a0-483a-b6af-bab51d52a41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace1118d32cc4aeaaba1fbeb00c8ff55'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:04.473851 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a62be572-f1a0-483a-b6af-bab51d52a41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace1118d32cc4aeaaba1fbeb00c8ff55'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:04.485598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a62be572-f1a0-483a-b6af-bab51d52a41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace1118d32cc4aeaaba1fbeb00c8ff55'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:04.490076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:04.493835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1325/2645] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:54:04 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:54:04.493991 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-a62be572-f1a0-483a-b6af-bab51d52a41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace1118d32cc4aeaaba1fbeb00c8ff55'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:04.497393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a2064-fc28-474c-80d2-4196f2cf9b3b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:04.499350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5c1a2064-fc28-474c-80d2-4196f2cf9b3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:04.511673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a2064-fc28-474c-80d2-4196f2cf9b3b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:04.517151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45879aac-1e3d-4f35-92a1-7fdc299eca80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:04.517843 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45879aac-1e3d-4f35-92a1-7fdc299eca80 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:04.518133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45879aac-1e3d-4f35-92a1-7fdc299eca80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:04.518410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45879aac-1e3d-4f35-92a1-7fdc299eca80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:04.519144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45879aac-1e3d-4f35-92a1-7fdc299eca80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:04.520782 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45879aac-1e3d-4f35-92a1-7fdc299eca80 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:04.531645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1326/2646] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:54:04.535790 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45879aac-1e3d-4f35-92a1-7fdc299eca80 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:04.545317 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45879aac-1e3d-4f35-92a1-7fdc299eca80 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:04.550510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ddd23-1c4f-48ee-9e0b-6b3ae8371182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:04.551330 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ddd23-1c4f-48ee-9e0b-6b3ae8371182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:04.551614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ddd23-1c4f-48ee-9e0b-6b3ae8371182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:04.551894 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ddd23-1c4f-48ee-9e0b-6b3ae8371182 admin admin] PATH_INFO: `/v3/projects/8545304233584450861f3e2c077eb953/users/b5b08d6e4274447da13709ad7904b18e/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:04.566575 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ddd23-1c4f-48ee-9e0b-6b3ae8371182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8545304233584450861f3e2c077eb953, user_id=b5b08d6e4274447da13709ad7904b18e, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:04.569207 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ddd23-1c4f-48ee-9e0b-6b3ae8371182 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:04.596917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1321/2647] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:54:04 2022] DELETE /identity/v3/users/ace1118d32cc4aeaaba1fbeb00c8ff55 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:04.677180 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1327/2648] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:54:04 2022] PUT /identity/v3/projects/8545304233584450861f3e2c077eb953/users/b5b08d6e4274447da13709ad7904b18e/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:04.692483 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62be572-f1a0-483a-b6af-bab51d52a41a admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:04.755674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62be572-f1a0-483a-b6af-bab51d52a41a admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:04.815669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8656754c-4c59-4cd2-8e42-b082af649f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:04.816355 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656754c-4c59-4cd2-8e42-b082af649f6c admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:04.816642 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656754c-4c59-4cd2-8e42-b082af649f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:04.818137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656754c-4c59-4cd2-8e42-b082af649f6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:04.818137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656754c-4c59-4cd2-8e42-b082af649f6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:04.819434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8656754c-4c59-4cd2-8e42-b082af649f6c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:04.833765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1322/2649] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:54:04.835713 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ddd23-1c4f-48ee-9e0b-6b3ae8371182 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:04.848365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ddd23-1c4f-48ee-9e0b-6b3ae8371182 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:04.855954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd45597-9f9e-4b9d-b0e1-3453fb8de62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:04.857714 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd45597-9f9e-4b9d-b0e1-3453fb8de62f admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:04.858192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd45597-9f9e-4b9d-b0e1-3453fb8de62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:04.858651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd45597-9f9e-4b9d-b0e1-3453fb8de62f admin admin] PATH_INFO: `/v3/projects/8545304233584450861f3e2c077eb953/users/b5b08d6e4274447da13709ad7904b18e/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:04.861650 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd45597-9f9e-4b9d-b0e1-3453fb8de62f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8545304233584450861f3e2c077eb953, user_id=b5b08d6e4274447da13709ad7904b18e, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:04.864799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd45597-9f9e-4b9d-b0e1-3453fb8de62f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:04.877361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1328/2650] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:54:04 2022] PUT /identity/v3/projects/8545304233584450861f3e2c077eb953/users/b5b08d6e4274447da13709ad7904b18e/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:04.889152 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060430-4727-476b-a3f9-0d4118014144 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:04.889792 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060430-4727-476b-a3f9-0d4118014144 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:04.889956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48060430-4727-476b-a3f9-0d4118014144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:04.917173 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-48060430-4727-476b-a3f9-0d4118014144 None None] MFA Rules not processed for user `b5b08d6e4274447da13709ad7904b18e`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:04.918437 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-48060430-4727-476b-a3f9-0d4118014144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:04.994398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1323/2651] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:05.005999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd45597-9f9e-4b9d-b0e1-3453fb8de62f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:05.008058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6dd45597-9f9e-4b9d-b0e1-3453fb8de62f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:05.038374 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48060430-4727-476b-a3f9-0d4118014144 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:05.039952 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-48060430-4727-476b-a3f9-0d4118014144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:05.066259 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:05.081248 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd45597-9f9e-4b9d-b0e1-3453fb8de62f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:05.089009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c2230-73c2-49a9-855c-c72a8e597e68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:05.089681 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c2230-73c2-49a9-855c-c72a8e597e68 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:05.090002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c2230-73c2-49a9-855c-c72a8e597e68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:05.090278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c2230-73c2-49a9-855c-c72a8e597e68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:05.093119 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b53c2230-73c2-49a9-855c-c72a8e597e68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:05.124166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48060430-4727-476b-a3f9-0d4118014144 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:05.130585 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb235e65-57c6-428d-b0e1-83f677d71641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:05.131584 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb235e65-57c6-428d-b0e1-83f677d71641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:05.131920 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb235e65-57c6-428d-b0e1-83f677d71641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:05.132701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb235e65-57c6-428d-b0e1-83f677d71641 admin admin] PATH_INFO: `/v3/projects/0ce262edab5a4a3cbe3595481f9a7831` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:05.133586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:05.135155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb235e65-57c6-428d-b0e1-83f677d71641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ce262edab5a4a3cbe3595481f9a7831)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:05.138623 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb235e65-57c6-428d-b0e1-83f677d71641 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:05.164553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c2230-73c2-49a9-855c-c72a8e597e68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:05.166331 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c2230-73c2-49a9-855c-c72a8e597e68 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:05.176912 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1329/2652] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:54:05.287837 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-eb235e65-57c6-428d-b0e1-83f677d71641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ce262edab5a4a3cbe3595481f9a7831', 'request_id': 'req-eb235e65-57c6-428d-b0e1-83f677d71641'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:05.375294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-eb235e65-57c6-428d-b0e1-83f677d71641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ce262edab5a4a3cbe3595481f9a7831', 'request_id': 'req-eb235e65-57c6-428d-b0e1-83f677d71641'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:05.381093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-eb235e65-57c6-428d-b0e1-83f677d71641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ce262edab5a4a3cbe3595481f9a7831', 'request_id': 'req-eb235e65-57c6-428d-b0e1-83f677d71641'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:05.393087 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-eb235e65-57c6-428d-b0e1-83f677d71641 admin admin] The token cache is being invalidate because project 0ce262edab5a4a3cbe3595481f9a7831 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:54:05.393382 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-eb235e65-57c6-428d-b0e1-83f677d71641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:05.394104 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-eb235e65-57c6-428d-b0e1-83f677d71641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:05.395684 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1324/2653] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:54:05 2022] DELETE /identity/v3/projects/0ce262edab5a4a3cbe3595481f9a7831 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:05.400711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eeaf79-a01a-48ef-85cb-9406f56d645a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:05.401002 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eeaf79-a01a-48ef-85cb-9406f56d645a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:05.401284 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eeaf79-a01a-48ef-85cb-9406f56d645a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:05.420358 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d9eeaf79-a01a-48ef-85cb-9406f56d645a None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:05.421567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d9eeaf79-a01a-48ef-85cb-9406f56d645a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:05.479636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1330/2654] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:05.488130 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e70ab-3d92-439c-9ec1-ebd59368e468 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:05.488605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e70ab-3d92-439c-9ec1-ebd59368e468 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:05.493175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e70ab-3d92-439c-9ec1-ebd59368e468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:05.506823 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-a38e70ab-3d92-439c-9ec1-ebd59368e468 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:05.508277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a38e70ab-3d92-439c-9ec1-ebd59368e468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:05.516618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1325/2655] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:05.520845 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eeaf79-a01a-48ef-85cb-9406f56d645a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:05.531316 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eeaf79-a01a-48ef-85cb-9406f56d645a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:05.536049 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d430fc-db2f-4c4f-a935-0e6bc5d728fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:05.536704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d430fc-db2f-4c4f-a935-0e6bc5d728fc admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:05.536990 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d430fc-db2f-4c4f-a935-0e6bc5d728fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:05.537269 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d430fc-db2f-4c4f-a935-0e6bc5d728fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:05.538066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d430fc-db2f-4c4f-a935-0e6bc5d728fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:54:05.538381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d430fc-db2f-4c4f-a935-0e6bc5d728fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:05.539997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d430fc-db2f-4c4f-a935-0e6bc5d728fc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:05.553477 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1331/2656] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:54:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:54:05.559339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e70ab-3d92-439c-9ec1-ebd59368e468 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:05.568903 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e70ab-3d92-439c-9ec1-ebd59368e468 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:05.573860 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38b96e-22af-4833-aa2c-dfc623d38264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:05.574535 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38b96e-22af-4833-aa2c-dfc623d38264 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:05.579313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38b96e-22af-4833-aa2c-dfc623d38264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:05.579313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38b96e-22af-4833-aa2c-dfc623d38264 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:05.579313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38b96e-22af-4833-aa2c-dfc623d38264 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:05.579313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38b96e-22af-4833-aa2c-dfc623d38264 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:05.675062 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1326/2657] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:54:05 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:54:05.679368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d430fc-db2f-4c4f-a935-0e6bc5d728fc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:05.689800 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d430fc-db2f-4c4f-a935-0e6bc5d728fc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:05.745422 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b860e7-2726-4902-8dc6-5112594ae3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:05.746121 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b860e7-2726-4902-8dc6-5112594ae3ae admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:05.746402 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b860e7-2726-4902-8dc6-5112594ae3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:05.746676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b860e7-2726-4902-8dc6-5112594ae3ae admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:05.747351 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b860e7-2726-4902-8dc6-5112594ae3ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:05.749910 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b860e7-2726-4902-8dc6-5112594ae3ae admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:05.850336 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1332/2658] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:54:05 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:54:05.854388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38b96e-22af-4833-aa2c-dfc623d38264 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:05.864792 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38b96e-22af-4833-aa2c-dfc623d38264 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:05.869743 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fb86c-9e88-4df2-8dd5-df3fd3303310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:05.870116 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fb86c-9e88-4df2-8dd5-df3fd3303310 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:05.870398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fb86c-9e88-4df2-8dd5-df3fd3303310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:05.870673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fb86c-9e88-4df2-8dd5-df3fd3303310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:05.871401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fb86c-9e88-4df2-8dd5-df3fd3303310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:05.873255 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fb86c-9e88-4df2-8dd5-df3fd3303310 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:05.884000 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1327/2659] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:54:05.888613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b860e7-2726-4902-8dc6-5112594ae3ae admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:05.900445 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b860e7-2726-4902-8dc6-5112594ae3ae admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:05.914270 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c51135-3279-4e98-941b-db95be374637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:05.914270 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c51135-3279-4e98-941b-db95be374637 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:05.914270 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c51135-3279-4e98-941b-db95be374637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:05.914270 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c51135-3279-4e98-941b-db95be374637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:05.914661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c51135-3279-4e98-941b-db95be374637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:05.914661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c51135-3279-4e98-941b-db95be374637 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:05.924286 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1333/2660] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:54:05.925610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fb86c-9e88-4df2-8dd5-df3fd3303310 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:05.935749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fb86c-9e88-4df2-8dd5-df3fd3303310 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:05.940603 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98e000-92be-45bf-aa05-34a1492287e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:05.941486 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98e000-92be-45bf-aa05-34a1492287e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:05.941801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98e000-92be-45bf-aa05-34a1492287e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:05.942080 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98e000-92be-45bf-aa05-34a1492287e1 admin admin] PATH_INFO: `/v3/projects/2a85be858d3d4a03942cd1e9b3cf1fa0/users/9f5aa9eed8e94b05958c86d678a5d98b/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:05.959697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98e000-92be-45bf-aa05-34a1492287e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a85be858d3d4a03942cd1e9b3cf1fa0, user_id=9f5aa9eed8e94b05958c86d678a5d98b, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:05.962438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98e000-92be-45bf-aa05-34a1492287e1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:06.024433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1328/2661] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:54:05 2022] PUT /identity/v3/projects/2a85be858d3d4a03942cd1e9b3cf1fa0/users/9f5aa9eed8e94b05958c86d678a5d98b/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:06.036394 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f850a-9ea1-4a2d-95e1-bda81d5b0980 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:06.036862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f850a-9ea1-4a2d-95e1-bda81d5b0980 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:06.036969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f850a-9ea1-4a2d-95e1-bda81d5b0980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:06.063811 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d69f850a-9ea1-4a2d-95e1-bda81d5b0980 None None] MFA Rules not processed for user `9f5aa9eed8e94b05958c86d678a5d98b`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:06.065057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d69f850a-9ea1-4a2d-95e1-bda81d5b0980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:06.094177 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:06.131694 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1334/2662] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:06.136539 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98e000-92be-45bf-aa05-34a1492287e1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:06.200006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98e000-92be-45bf-aa05-34a1492287e1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:06.205788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678454f4-e48b-405e-b10c-80460b265ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:06.206448 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678454f4-e48b-405e-b10c-80460b265ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:06.206726 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678454f4-e48b-405e-b10c-80460b265ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:06.206996 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678454f4-e48b-405e-b10c-80460b265ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:06.207749 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678454f4-e48b-405e-b10c-80460b265ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:06.209653 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678454f4-e48b-405e-b10c-80460b265ab9 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:06.297478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1329/2663] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:54:06 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:54:06.301561 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f850a-9ea1-4a2d-95e1-bda81d5b0980 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:06.313066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:06.313576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f850a-9ea1-4a2d-95e1-bda81d5b0980 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:06.498544 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58b28b-5551-4bc6-a9fb-181110b83c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:06.499132 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58b28b-5551-4bc6-a9fb-181110b83c86 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:06.499416 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58b28b-5551-4bc6-a9fb-181110b83c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:06.499693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58b28b-5551-4bc6-a9fb-181110b83c86 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:06.500389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58b28b-5551-4bc6-a9fb-181110b83c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:06.502399 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58b28b-5551-4bc6-a9fb-181110b83c86 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:06.593739 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1335/2664] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:54:06 2022] POST /identity/v3/users => generated 297 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:54:06.598085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678454f4-e48b-405e-b10c-80460b265ab9 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:06.609912 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678454f4-e48b-405e-b10c-80460b265ab9 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:06.614770 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6155c-e748-402b-b139-095ba163b678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:06.615439 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6155c-e748-402b-b139-095ba163b678 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:06.615724 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6155c-e748-402b-b139-095ba163b678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:06.616115 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6155c-e748-402b-b139-095ba163b678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:06.616859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6155c-e748-402b-b139-095ba163b678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:06.618497 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6155c-e748-402b-b139-095ba163b678 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:06.629490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1330/2665] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:54:06.634055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58b28b-5551-4bc6-a9fb-181110b83c86 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:06.644949 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58b28b-5551-4bc6-a9fb-181110b83c86 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:06.650145 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03746f-43d7-4a3a-a83a-2794394a1732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:06.651034 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03746f-43d7-4a3a-a83a-2794394a1732 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:06.651315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03746f-43d7-4a3a-a83a-2794394a1732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:06.651591 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03746f-43d7-4a3a-a83a-2794394a1732 admin admin] PATH_INFO: `/v3/projects/d0a728d8398a4ed6897628dba903b225/users/3e271ca99653450597b431b1918936f9/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:06.667109 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03746f-43d7-4a3a-a83a-2794394a1732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a728d8398a4ed6897628dba903b225, user_id=3e271ca99653450597b431b1918936f9, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:06.669895 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03746f-43d7-4a3a-a83a-2794394a1732 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:06.757837 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1336/2666] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:54:06 2022] PUT /identity/v3/projects/d0a728d8398a4ed6897628dba903b225/users/3e271ca99653450597b431b1918936f9/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:06.760948 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6155c-e748-402b-b139-095ba163b678 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:06.772323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6155c-e748-402b-b139-095ba163b678 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:06.833750 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dc4dee-78e6-4570-a0e0-1eb7258f6193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:06.834662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc4dee-78e6-4570-a0e0-1eb7258f6193 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:06.835011 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc4dee-78e6-4570-a0e0-1eb7258f6193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:06.835353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dc4dee-78e6-4570-a0e0-1eb7258f6193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:06.836182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc4dee-78e6-4570-a0e0-1eb7258f6193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:06.837918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dc4dee-78e6-4570-a0e0-1eb7258f6193 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:06.849385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1331/2667] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:54:06.853471 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03746f-43d7-4a3a-a83a-2794394a1732 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:06.863951 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03746f-43d7-4a3a-a83a-2794394a1732 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:06.868651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1872638-ec57-469a-b8f5-2a652826c51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:06.869530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1872638-ec57-469a-b8f5-2a652826c51b admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:06.869858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1872638-ec57-469a-b8f5-2a652826c51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:06.870134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1872638-ec57-469a-b8f5-2a652826c51b admin admin] PATH_INFO: `/v3/projects/d0a728d8398a4ed6897628dba903b225/users/3e271ca99653450597b431b1918936f9/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:06.872099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1872638-ec57-469a-b8f5-2a652826c51b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0a728d8398a4ed6897628dba903b225, user_id=3e271ca99653450597b431b1918936f9, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:06.874836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1872638-ec57-469a-b8f5-2a652826c51b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:06.885554 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1337/2668] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:54:06 2022] PUT /identity/v3/projects/d0a728d8398a4ed6897628dba903b225/users/3e271ca99653450597b431b1918936f9/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:06.896376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d13efb-7c94-45fd-9702-ccb904834eb6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:06.896662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d13efb-7c94-45fd-9702-ccb904834eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:06.897030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d13efb-7c94-45fd-9702-ccb904834eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:06.924753 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-87d13efb-7c94-45fd-9702-ccb904834eb6 None None] MFA Rules not processed for user `3e271ca99653450597b431b1918936f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:06.926013 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-87d13efb-7c94-45fd-9702-ccb904834eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:07.007358 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1332/2669] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:07.020041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1872638-ec57-469a-b8f5-2a652826c51b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:07.021797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a1872638-ec57-469a-b8f5-2a652826c51b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:07.096754 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1872638-ec57-469a-b8f5-2a652826c51b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:07.100936 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f686b1a-d9d9-4e21-b312-016d1f32d477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:07.101500 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f686b1a-d9d9-4e21-b312-016d1f32d477 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:07.101806 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f686b1a-d9d9-4e21-b312-016d1f32d477 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:07.102084 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f686b1a-d9d9-4e21-b312-016d1f32d477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:07.112458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f686b1a-d9d9-4e21-b312-016d1f32d477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:07.114099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f686b1a-d9d9-4e21-b312-016d1f32d477 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:07.126364 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1338/2670] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:54:07.322796 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d13efb-7c94-45fd-9702-ccb904834eb6 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:07.333247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d13efb-7c94-45fd-9702-ccb904834eb6 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:07.337392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cdd40-59bf-4141-b171-b9cd997d10c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:07.348052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cdd40-59bf-4141-b171-b9cd997d10c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:07.348052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cdd40-59bf-4141-b171-b9cd997d10c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:07.348052 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cdd40-59bf-4141-b171-b9cd997d10c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:07.386509 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:07.416979 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cdd40-59bf-4141-b171-b9cd997d10c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:07.418808 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cdd40-59bf-4141-b171-b9cd997d10c3 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:07.428519 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1333/2671] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:54:07.925445 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f686b1a-d9d9-4e21-b312-016d1f32d477 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:07.955192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:07.993786 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f686b1a-d9d9-4e21-b312-016d1f32d477 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:07.998516 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d331d-a116-41d8-b634-654f201762ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:07.999521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d331d-a116-41d8-b634-654f201762ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:07.999874 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d331d-a116-41d8-b634-654f201762ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:08.000221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d331d-a116-41d8-b634-654f201762ee admin admin] PATH_INFO: `/v3/users/9f5aa9eed8e94b05958c86d678a5d98b` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:08.001571 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d331d-a116-41d8-b634-654f201762ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f5aa9eed8e94b05958c86d678a5d98b)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:08.003593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d331d-a116-41d8-b634-654f201762ee admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:08.153682 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7c5d331d-a116-41d8-b634-654f201762ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f5aa9eed8e94b05958c86d678a5d98b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:08.221602 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7c5d331d-a116-41d8-b634-654f201762ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f5aa9eed8e94b05958c86d678a5d98b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:08.222298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7c5d331d-a116-41d8-b634-654f201762ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f5aa9eed8e94b05958c86d678a5d98b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:08.229969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7c5d331d-a116-41d8-b634-654f201762ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f5aa9eed8e94b05958c86d678a5d98b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:08.230676 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-7c5d331d-a116-41d8-b634-654f201762ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f5aa9eed8e94b05958c86d678a5d98b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:08.249351 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1339/2672] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:54:07 2022] DELETE /identity/v3/users/9f5aa9eed8e94b05958c86d678a5d98b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:08.253983 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff00e27-cdbe-475b-848b-80a072645742 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:08.254473 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff00e27-cdbe-475b-848b-80a072645742 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:08.254596 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff00e27-cdbe-475b-848b-80a072645742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:08.272633 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7ff00e27-cdbe-475b-848b-80a072645742 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:08.274175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7ff00e27-cdbe-475b-848b-80a072645742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:08.334666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1334/2673] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:54:08.346112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d331d-a116-41d8-b634-654f201762ee admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:08.347687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7c5d331d-a116-41d8-b634-654f201762ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:08.411811 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d331d-a116-41d8-b634-654f201762ee admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:08.417374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e206d-b570-40e9-a9aa-a06e87405797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:08.418636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e206d-b570-40e9-a9aa-a06e87405797 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:08.420611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e206d-b570-40e9-a9aa-a06e87405797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:08.420961 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e206d-b570-40e9-a9aa-a06e87405797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:08.434351 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e206d-b570-40e9-a9aa-a06e87405797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:08.434351 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e206d-b570-40e9-a9aa-a06e87405797 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:08.445746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff00e27-cdbe-475b-848b-80a072645742 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:08.445746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7ff00e27-cdbe-475b-848b-80a072645742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:08.445993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1340/2674] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:54:08.460049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff00e27-cdbe-475b-848b-80a072645742 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:08.466028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ed755-3d46-44f9-aca0-d083c2ac8b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:08.467322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ed755-3d46-44f9-aca0-d083c2ac8b10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:08.467616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ed755-3d46-44f9-aca0-d083c2ac8b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:08.467898 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ed755-3d46-44f9-aca0-d083c2ac8b10 admin admin] PATH_INFO: `/v3/users/76f4a84d5e7042b1823f5e0e157f9e3b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:08.469299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ed755-3d46-44f9-aca0-d083c2ac8b10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76f4a84d5e7042b1823f5e0e157f9e3b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:08.471283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ed755-3d46-44f9-aca0-d083c2ac8b10 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:08.680683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9b7ed755-3d46-44f9-aca0-d083c2ac8b10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76f4a84d5e7042b1823f5e0e157f9e3b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:08.681761 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9b7ed755-3d46-44f9-aca0-d083c2ac8b10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76f4a84d5e7042b1823f5e0e157f9e3b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:08.683285 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9b7ed755-3d46-44f9-aca0-d083c2ac8b10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76f4a84d5e7042b1823f5e0e157f9e3b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:08.704812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9b7ed755-3d46-44f9-aca0-d083c2ac8b10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76f4a84d5e7042b1823f5e0e157f9e3b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:08.714153 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-9b7ed755-3d46-44f9-aca0-d083c2ac8b10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76f4a84d5e7042b1823f5e0e157f9e3b'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:08.808126 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1335/2675] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:54:08 2022] DELETE /identity/v3/users/76f4a84d5e7042b1823f5e0e157f9e3b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:08.813283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30129be-aef3-46de-9c04-49a73ea57812 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:08.813283 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30129be-aef3-46de-9c04-49a73ea57812 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:08.813564 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30129be-aef3-46de-9c04-49a73ea57812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:08.834659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-a30129be-aef3-46de-9c04-49a73ea57812 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:08.835924 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a30129be-aef3-46de-9c04-49a73ea57812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:08.881097 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:08.900594 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1341/2676] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:08.911566 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ed755-3d46-44f9-aca0-d083c2ac8b10 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:08.913293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-9b7ed755-3d46-44f9-aca0-d083c2ac8b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:08.973524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:08.980565 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30129be-aef3-46de-9c04-49a73ea57812 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:08.980818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ed755-3d46-44f9-aca0-d083c2ac8b10 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:08.982763 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a30129be-aef3-46de-9c04-49a73ea57812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:08.985636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7809ba5-0827-49bf-9810-135ed7117bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:08.986414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7809ba5-0827-49bf-9810-135ed7117bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:08.986768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7809ba5-0827-49bf-9810-135ed7117bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:08.987125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7809ba5-0827-49bf-9810-135ed7117bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:08.999651 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7809ba5-0827-49bf-9810-135ed7117bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:09.001115 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7809ba5-0827-49bf-9810-135ed7117bd0 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:09.002086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30129be-aef3-46de-9c04-49a73ea57812 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:09.007323 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:09.008475 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:09.008785 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:09.009069 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] PATH_INFO: `/v3/projects/2a85be858d3d4a03942cd1e9b3cf1fa0` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:09.010306 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a85be858d3d4a03942cd1e9b3cf1fa0)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:09.012214 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:09.022090 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1336/2677] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:54:09.158978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a85be858d3d4a03942cd1e9b3cf1fa0', 'request_id': 'req-cfdab52f-bdd2-419d-a868-503d9ae548a2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.244220 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a85be858d3d4a03942cd1e9b3cf1fa0', 'request_id': 'req-cfdab52f-bdd2-419d-a868-503d9ae548a2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.255663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a85be858d3d4a03942cd1e9b3cf1fa0', 'request_id': 'req-cfdab52f-bdd2-419d-a868-503d9ae548a2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.267727 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] The token cache is being invalidate because project 2a85be858d3d4a03942cd1e9b3cf1fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:54:09.268012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.268708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.270623 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1342/2678] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:54:08 2022] DELETE /identity/v3/projects/2a85be858d3d4a03942cd1e9b3cf1fa0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:09.274781 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7809ba5-0827-49bf-9810-135ed7117bd0 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:09.286074 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7809ba5-0827-49bf-9810-135ed7117bd0 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:09.348261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c645c36-1e25-4f0b-9735-5107fd33f144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:09.349151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c645c36-1e25-4f0b-9735-5107fd33f144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:09.349438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c645c36-1e25-4f0b-9735-5107fd33f144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:09.349733 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c645c36-1e25-4f0b-9735-5107fd33f144 admin admin] PATH_INFO: `/v3/users/3e271ca99653450597b431b1918936f9` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:09.350956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c645c36-1e25-4f0b-9735-5107fd33f144 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e271ca99653450597b431b1918936f9)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:09.352895 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c645c36-1e25-4f0b-9735-5107fd33f144 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:09.486416 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:09.487030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:09.501174 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdab52f-bdd2-419d-a868-503d9ae548a2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:09.509033 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:09.509998 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:09.510311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:09.510772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] PATH_INFO: `/v3/projects/971293da3f1a4b1591ec9676a7cff839` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:09.511978 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=971293da3f1a4b1591ec9676a7cff839)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:09.515252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:09.541058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1c645c36-1e25-4f0b-9735-5107fd33f144 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e271ca99653450597b431b1918936f9'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.541806 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1c645c36-1e25-4f0b-9735-5107fd33f144 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e271ca99653450597b431b1918936f9'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.542477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1c645c36-1e25-4f0b-9735-5107fd33f144 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e271ca99653450597b431b1918936f9'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.555234 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1c645c36-1e25-4f0b-9735-5107fd33f144 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e271ca99653450597b431b1918936f9'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.562700 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-1c645c36-1e25-4f0b-9735-5107fd33f144 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e271ca99653450597b431b1918936f9'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.655833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1337/2679] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:54:09 2022] DELETE /identity/v3/users/3e271ca99653450597b431b1918936f9 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:09.670704 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971293da3f1a4b1591ec9676a7cff839', 'request_id': 'req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.735547 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971293da3f1a4b1591ec9676a7cff839', 'request_id': 'req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.744550 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971293da3f1a4b1591ec9676a7cff839', 'request_id': 'req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.756903 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] The token cache is being invalidate because project 971293da3f1a4b1591ec9676a7cff839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:54:09.757192 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.758132 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:09.759652 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1343/2680] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:54:09 2022] DELETE /identity/v3/projects/971293da3f1a4b1591ec9676a7cff839 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:09.764385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c645c36-1e25-4f0b-9735-5107fd33f144 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:09.765835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-1c645c36-1e25-4f0b-9735-5107fd33f144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:09.830568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c645c36-1e25-4f0b-9735-5107fd33f144 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:09.835229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9a62d-3256-4a15-9514-bf877e837285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:09.836107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9a62d-3256-4a15-9514-bf877e837285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:09.836392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9a62d-3256-4a15-9514-bf877e837285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:09.836671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9a62d-3256-4a15-9514-bf877e837285 admin admin] PATH_INFO: `/v3/users/b5b08d6e4274447da13709ad7904b18e` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:09.837890 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9a62d-3256-4a15-9514-bf877e837285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5b08d6e4274447da13709ad7904b18e)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:09.839842 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9a62d-3256-4a15-9514-bf877e837285 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:09.884916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:10.038227 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-92d9a62d-3256-4a15-9514-bf877e837285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5b08d6e4274447da13709ad7904b18e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:10.038859 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-92d9a62d-3256-4a15-9514-bf877e837285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5b08d6e4274447da13709ad7904b18e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:10.039652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-92d9a62d-3256-4a15-9514-bf877e837285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5b08d6e4274447da13709ad7904b18e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:10.051896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-92d9a62d-3256-4a15-9514-bf877e837285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5b08d6e4274447da13709ad7904b18e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:10.058825 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-92d9a62d-3256-4a15-9514-bf877e837285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5b08d6e4274447da13709ad7904b18e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:10.092509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:10.101435 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:10.162104 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1338/2681] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:54:09 2022] DELETE /identity/v3/users/b5b08d6e4274447da13709ad7904b18e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:10.187501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:10.203941 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa06aa-f249-4ea5-9235-389bd4c19b2b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:10.261414 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcdc84-0494-4363-ac10-db985588c0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:10.262612 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcdc84-0494-4363-ac10-db985588c0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:10.262890 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcdc84-0494-4363-ac10-db985588c0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:10.263154 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcdc84-0494-4363-ac10-db985588c0f2 admin admin] PATH_INFO: `/v3/projects/d0a728d8398a4ed6897628dba903b225` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:10.264485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcdc84-0494-4363-ac10-db985588c0f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0a728d8398a4ed6897628dba903b225)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:10.266866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcdc84-0494-4363-ac10-db985588c0f2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:10.383630 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3bbcdc84-0494-4363-ac10-db985588c0f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0a728d8398a4ed6897628dba903b225', 'request_id': 'req-3bbcdc84-0494-4363-ac10-db985588c0f2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:10.461363 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3bbcdc84-0494-4363-ac10-db985588c0f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0a728d8398a4ed6897628dba903b225', 'request_id': 'req-3bbcdc84-0494-4363-ac10-db985588c0f2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:10.469141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3bbcdc84-0494-4363-ac10-db985588c0f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0a728d8398a4ed6897628dba903b225', 'request_id': 'req-3bbcdc84-0494-4363-ac10-db985588c0f2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:10.482626 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3bbcdc84-0494-4363-ac10-db985588c0f2 admin admin] The token cache is being invalidate because project d0a728d8398a4ed6897628dba903b225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:54:10.483111 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3bbcdc84-0494-4363-ac10-db985588c0f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:10.483910 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-3bbcdc84-0494-4363-ac10-db985588c0f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:10.487300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1344/2682] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:54:10 2022] DELETE /identity/v3/projects/d0a728d8398a4ed6897628dba903b225 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:10.492368 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21453-26c1-4afe-88f4-e01193801eab None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:10.501018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21453-26c1-4afe-88f4-e01193801eab None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:10.501018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e21453-26c1-4afe-88f4-e01193801eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:10.518762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f7e21453-26c1-4afe-88f4-e01193801eab None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:10.520057 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f7e21453-26c1-4afe-88f4-e01193801eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:10.618909 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1339/2683] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:10.628761 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364df9c-4888-461a-a495-5325cb3b3040 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:10.629285 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364df9c-4888-461a-a495-5325cb3b3040 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:10.629836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364df9c-4888-461a-a495-5325cb3b3040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:10.653271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-f364df9c-4888-461a-a495-5325cb3b3040 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:10.655066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f364df9c-4888-461a-a495-5325cb3b3040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:10.665211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1345/2684] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:54:10.670212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e21453-26c1-4afe-88f4-e01193801eab None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:10.681964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e21453-26c1-4afe-88f4-e01193801eab None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:10.687953 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f0382-7e36-48ce-b53a-cc929d78bfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:10.688643 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f0382-7e36-48ce-b53a-cc929d78bfa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:10.688928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f0382-7e36-48ce-b53a-cc929d78bfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:10.689229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f0382-7e36-48ce-b53a-cc929d78bfa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:10.690060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f0382-7e36-48ce-b53a-cc929d78bfa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:54:10.690408 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f0382-7e36-48ce-b53a-cc929d78bfa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:10.692007 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f0382-7e36-48ce-b53a-cc929d78bfa2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:10.716182 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1340/2685] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:54:10.718047 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364df9c-4888-461a-a495-5325cb3b3040 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:10.749403 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364df9c-4888-461a-a495-5325cb3b3040 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:10.755296 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313f280-b64d-4df0-8b95-bcd0e01b50df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:10.755972 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313f280-b64d-4df0-8b95-bcd0e01b50df admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:10.756252 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313f280-b64d-4df0-8b95-bcd0e01b50df admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:10.756521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313f280-b64d-4df0-8b95-bcd0e01b50df admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:10.757224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313f280-b64d-4df0-8b95-bcd0e01b50df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:10.759593 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313f280-b64d-4df0-8b95-bcd0e01b50df admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:10.782315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f0382-7e36-48ce-b53a-cc929d78bfa2 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:10.782315 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a00f0382-7e36-48ce-b53a-cc929d78bfa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:10.800121 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f0382-7e36-48ce-b53a-cc929d78bfa2 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:10.806541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ae159-f10c-48a0-88b9-ee23888c68d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:10.807578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ae159-f10c-48a0-88b9-ee23888c68d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:10.810925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ae159-f10c-48a0-88b9-ee23888c68d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:10.810925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ae159-f10c-48a0-88b9-ee23888c68d7 admin admin] PATH_INFO: `/v3/projects/8545304233584450861f3e2c077eb953` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:10.810925 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ae159-f10c-48a0-88b9-ee23888c68d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8545304233584450861f3e2c077eb953)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:10.812010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ae159-f10c-48a0-88b9-ee23888c68d7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:10.901119 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1346/2686] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:54:10 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:54:10.902327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313f280-b64d-4df0-8b95-bcd0e01b50df admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:10.981447 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313f280-b64d-4df0-8b95-bcd0e01b50df admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:10.988547 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ca5ae159-f10c-48a0-88b9-ee23888c68d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8545304233584450861f3e2c077eb953', 'request_id': 'req-ca5ae159-f10c-48a0-88b9-ee23888c68d7'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:10.989185 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:11.053660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66846602-9974-482c-a5d1-2456626d5161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.054816 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846602-9974-482c-a5d1-2456626d5161 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.055117 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846602-9974-482c-a5d1-2456626d5161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.055798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846602-9974-482c-a5d1-2456626d5161 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.056493 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66846602-9974-482c-a5d1-2456626d5161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:11.058531 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66846602-9974-482c-a5d1-2456626d5161 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:11.070159 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ca5ae159-f10c-48a0-88b9-ee23888c68d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8545304233584450861f3e2c077eb953', 'request_id': 'req-ca5ae159-f10c-48a0-88b9-ee23888c68d7'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:11.077217 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ca5ae159-f10c-48a0-88b9-ee23888c68d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8545304233584450861f3e2c077eb953', 'request_id': 'req-ca5ae159-f10c-48a0-88b9-ee23888c68d7'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:11.090630 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:11.099659 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ca5ae159-f10c-48a0-88b9-ee23888c68d7 admin admin] The token cache is being invalidate because project 8545304233584450861f3e2c077eb953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:54:11.099956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ca5ae159-f10c-48a0-88b9-ee23888c68d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:11.100711 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ca5ae159-f10c-48a0-88b9-ee23888c68d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:11.102695 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1341/2687] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:54:10 2022] DELETE /identity/v3/projects/8545304233584450861f3e2c077eb953 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:11.108104 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a581c1-e959-47c4-a5e0-fcc61290a03d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.112048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a581c1-e959-47c4-a5e0-fcc61290a03d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.112048 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a581c1-e959-47c4-a5e0-fcc61290a03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.126833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-75a581c1-e959-47c4-a5e0-fcc61290a03d None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:11.128066 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-75a581c1-e959-47c4-a5e0-fcc61290a03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:11.136769 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1342/2688] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:54:11.146180 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a230f-f556-4f11-bc8b-6782d01c5cf1 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.146498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a230f-f556-4f11-bc8b-6782d01c5cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.146779 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a230f-f556-4f11-bc8b-6782d01c5cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.165608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-8d6a230f-f556-4f11-bc8b-6782d01c5cf1 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:11.166845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8d6a230f-f556-4f11-bc8b-6782d01c5cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:11.170306 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1347/2689] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:54:10 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:54:11.177025 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1343/2690] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:54:11.178381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66846602-9974-482c-a5d1-2456626d5161 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:11.179423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a230f-f556-4f11-bc8b-6782d01c5cf1 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:11.180135 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-66846602-9974-482c-a5d1-2456626d5161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:11.189050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a230f-f556-4f11-bc8b-6782d01c5cf1 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:11.194154 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66846602-9974-482c-a5d1-2456626d5161 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:11.194637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08f41f-5955-42d3-8fef-60ee3c766f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.194920 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f41f-5955-42d3-8fef-60ee3c766f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.195154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f41f-5955-42d3-8fef-60ee3c766f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.195443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08f41f-5955-42d3-8fef-60ee3c766f70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.196262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08f41f-5955-42d3-8fef-60ee3c766f70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:54:11.196543 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08f41f-5955-42d3-8fef-60ee3c766f70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:11.198453 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08f41f-5955-42d3-8fef-60ee3c766f70 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:11.204439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781550d9-9cc4-4736-af5d-8755c86647b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.204439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781550d9-9cc4-4736-af5d-8755c86647b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.204439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781550d9-9cc4-4736-af5d-8755c86647b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.204439 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781550d9-9cc4-4736-af5d-8755c86647b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.204858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781550d9-9cc4-4736-af5d-8755c86647b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:11.204858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781550d9-9cc4-4736-af5d-8755c86647b8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:11.215209 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1344/2691] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:54:11.216663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08f41f-5955-42d3-8fef-60ee3c766f70 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:11.227814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1348/2692] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:54:11.228320 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08f41f-5955-42d3-8fef-60ee3c766f70 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:11.232988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2c51b-f25c-4709-997f-3c203d6d2ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.233804 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2c51b-f25c-4709-997f-3c203d6d2ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.234088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2c51b-f25c-4709-997f-3c203d6d2ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.234363 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2c51b-f25c-4709-997f-3c203d6d2ee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.235153 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2c51b-f25c-4709-997f-3c203d6d2ee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:11.236036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781550d9-9cc4-4736-af5d-8755c86647b8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:11.237060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2c51b-f25c-4709-997f-3c203d6d2ee5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:11.246579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781550d9-9cc4-4736-af5d-8755c86647b8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:11.251378 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a2ebb-63f6-4e5b-a3fb-8f2994a5a7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.252114 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a2ebb-63f6-4e5b-a3fb-8f2994a5a7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.252675 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a2ebb-63f6-4e5b-a3fb-8f2994a5a7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.253043 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a2ebb-63f6-4e5b-a3fb-8f2994a5a7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.253960 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a2ebb-63f6-4e5b-a3fb-8f2994a5a7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:11.256037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a2ebb-63f6-4e5b-a3fb-8f2994a5a7e8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:11.267384 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1349/2693] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:54:11.271339 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a2ebb-63f6-4e5b-a3fb-8f2994a5a7e8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:11.281138 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a2ebb-63f6-4e5b-a3fb-8f2994a5a7e8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:11.285745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360447c-c8b7-4d40-a075-4d0746f2fa25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.286607 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360447c-c8b7-4d40-a075-4d0746f2fa25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.286891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360447c-c8b7-4d40-a075-4d0746f2fa25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.287166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360447c-c8b7-4d40-a075-4d0746f2fa25 admin admin] PATH_INFO: `/v3/projects/3ed46d0c71df402da0bc0c02647d59ee/users/0ffbcc40eb7746e08a6bde2a6e562a0d/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.302601 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360447c-c8b7-4d40-a075-4d0746f2fa25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed46d0c71df402da0bc0c02647d59ee, user_id=0ffbcc40eb7746e08a6bde2a6e562a0d, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:11.305645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7360447c-c8b7-4d40-a075-4d0746f2fa25 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:11.337270 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1345/2694] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:54:11 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:54:11.341499 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2c51b-f25c-4709-997f-3c203d6d2ee5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:11.404465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2c51b-f25c-4709-997f-3c203d6d2ee5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:11.409431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a2344-4024-4427-b318-0a89cae65aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.410400 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a2344-4024-4427-b318-0a89cae65aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.411765 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a2344-4024-4427-b318-0a89cae65aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.412299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a2344-4024-4427-b318-0a89cae65aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.413677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a2344-4024-4427-b318-0a89cae65aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:11.416124 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a2344-4024-4427-b318-0a89cae65aa9 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:11.416514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1350/2695] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:54:11 2022] PUT /identity/v3/projects/3ed46d0c71df402da0bc0c02647d59ee/users/0ffbcc40eb7746e08a6bde2a6e562a0d/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:11.496517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8909b-bb37-41e8-afba-54c49a3a5517 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.496786 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8909b-bb37-41e8-afba-54c49a3a5517 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.497100 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b8909b-bb37-41e8-afba-54c49a3a5517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.524038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-40b8909b-bb37-41e8-afba-54c49a3a5517 None None] MFA Rules not processed for user `0ffbcc40eb7746e08a6bde2a6e562a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:11.524438 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1346/2696] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:54:11 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:54:11.528277 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a2344-4024-4427-b318-0a89cae65aa9 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:11.529181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-40b8909b-bb37-41e8-afba-54c49a3a5517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:11.539475 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a2344-4024-4427-b318-0a89cae65aa9 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:11.596393 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1351/2697] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:54:11.598587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c78e-7bed-406d-99d4-b6d85ad29c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.599544 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c78e-7bed-406d-99d4-b6d85ad29c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.599705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c78e-7bed-406d-99d4-b6d85ad29c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.599892 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992c78e-7bed-406d-99d4-b6d85ad29c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.600587 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8909b-bb37-41e8-afba-54c49a3a5517 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:11.600714 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992c78e-7bed-406d-99d4-b6d85ad29c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:11.602550 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992c78e-7bed-406d-99d4-b6d85ad29c89 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:11.612624 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b8909b-bb37-41e8-afba-54c49a3a5517 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:11.616655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1347/2698] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:54:11.617476 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5ef51-2193-4a55-95fb-91e5114e15cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.617608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c78e-7bed-406d-99d4-b6d85ad29c89 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:11.618245 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5ef51-2193-4a55-95fb-91e5114e15cc admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.618528 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5ef51-2193-4a55-95fb-91e5114e15cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.618804 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c5ef51-2193-4a55-95fb-91e5114e15cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.619503 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5ef51-2193-4a55-95fb-91e5114e15cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:11.621389 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c5ef51-2193-4a55-95fb-91e5114e15cc admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:11.629058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992c78e-7bed-406d-99d4-b6d85ad29c89 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:11.633981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08c5c3-f800-4395-b840-cb14418d3d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.634663 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08c5c3-f800-4395-b840-cb14418d3d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.634943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08c5c3-f800-4395-b840-cb14418d3d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.635228 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08c5c3-f800-4395-b840-cb14418d3d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.636445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08c5c3-f800-4395-b840-cb14418d3d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:11.637499 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08c5c3-f800-4395-b840-cb14418d3d57 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:11.654793 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1348/2699] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:54:11.658800 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08c5c3-f800-4395-b840-cb14418d3d57 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:11.668417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08c5c3-f800-4395-b840-cb14418d3d57 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:11.673762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f57b0-bd5d-4d8e-b8a7-423ccee0fb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.674646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f57b0-bd5d-4d8e-b8a7-423ccee0fb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.674962 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f57b0-bd5d-4d8e-b8a7-423ccee0fb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.675244 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f57b0-bd5d-4d8e-b8a7-423ccee0fb38 admin admin] PATH_INFO: `/v3/projects/b8b028d5199c4c52946ae83600984f3c/users/f0411cf0331049338640a882f11c88a5/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.690446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f57b0-bd5d-4d8e-b8a7-423ccee0fb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b028d5199c4c52946ae83600984f3c, user_id=f0411cf0331049338640a882f11c88a5, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:11.693138 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f57b0-bd5d-4d8e-b8a7-423ccee0fb38 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:11.711715 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1352/2700] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:54:11 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:54:11.712799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5ef51-2193-4a55-95fb-91e5114e15cc admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:11.778424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c5ef51-2193-4a55-95fb-91e5114e15cc admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:11.784861 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1349/2701] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:54:11 2022] PUT /identity/v3/projects/b8b028d5199c4c52946ae83600984f3c/users/f0411cf0331049338640a882f11c88a5/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:11.792010 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:11.797852 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e890a-1cf6-4f10-9c1a-e5c09a75ef11 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.798154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e890a-1cf6-4f10-9c1a-e5c09a75ef11 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.798495 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e890a-1cf6-4f10-9c1a-e5c09a75ef11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.826598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0d9e890a-1cf6-4f10-9c1a-e5c09a75ef11 None None] MFA Rules not processed for user `f0411cf0331049338640a882f11c88a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:11.828004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0d9e890a-1cf6-4f10-9c1a-e5c09a75ef11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:11.842216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16edb8b-790f-4023-acc2-afb61b9be06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.843106 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16edb8b-790f-4023-acc2-afb61b9be06b admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.843495 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16edb8b-790f-4023-acc2-afb61b9be06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.843890 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16edb8b-790f-4023-acc2-afb61b9be06b admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.844718 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16edb8b-790f-4023-acc2-afb61b9be06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:11.851081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16edb8b-790f-4023-acc2-afb61b9be06b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:11.871368 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:11.895772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1350/2702] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:11.907177 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e890a-1cf6-4f10-9c1a-e5c09a75ef11 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:11.908734 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0d9e890a-1cf6-4f10-9c1a-e5c09a75ef11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:11.928222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1353/2703] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:54:11 2022] POST /identity/v3/users => generated 289 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:54:11.932249 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16edb8b-790f-4023-acc2-afb61b9be06b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:11.943812 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16edb8b-790f-4023-acc2-afb61b9be06b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:11.949009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c230d5d-e51f-437b-b814-41d7e4c8924f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.949844 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c230d5d-e51f-437b-b814-41d7e4c8924f admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.950060 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c230d5d-e51f-437b-b814-41d7e4c8924f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.950334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c230d5d-e51f-437b-b814-41d7e4c8924f admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.951271 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c230d5d-e51f-437b-b814-41d7e4c8924f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:11.952951 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c230d5d-e51f-437b-b814-41d7e4c8924f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:11.963629 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1354/2704] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:54:11.968420 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c230d5d-e51f-437b-b814-41d7e4c8924f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:11.986202 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c230d5d-e51f-437b-b814-41d7e4c8924f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:11.987280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e890a-1cf6-4f10-9c1a-e5c09a75ef11 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:11.991721 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dbce1-fbf5-472d-b49f-19e0f9e19922 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.992055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf774d-7546-4472-b984-d6b6c16fc5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:11.992385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dbce1-fbf5-472d-b49f-19e0f9e19922 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.992673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dbce1-fbf5-472d-b49f-19e0f9e19922 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.992900 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf774d-7546-4472-b984-d6b6c16fc5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:11.993095 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dbce1-fbf5-472d-b49f-19e0f9e19922 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.993321 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf774d-7546-4472-b984-d6b6c16fc5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:11.993547 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf774d-7546-4472-b984-d6b6c16fc5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:11.994542 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf774d-7546-4472-b984-d6b6c16fc5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:11.996489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf774d-7546-4472-b984-d6b6c16fc5a2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:12.007014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dbce1-fbf5-472d-b49f-19e0f9e19922 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:12.008132 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1355/2705] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:54:12.008730 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dbce1-fbf5-472d-b49f-19e0f9e19922 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:12.012370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf774d-7546-4472-b984-d6b6c16fc5a2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:12.018779 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1351/2706] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:54:12.023404 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf774d-7546-4472-b984-d6b6c16fc5a2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:12.029005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d1e7d-04fd-44d7-a0ef-cb8c7abfef31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:12.029568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d1e7d-04fd-44d7-a0ef-cb8c7abfef31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:12.029568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d1e7d-04fd-44d7-a0ef-cb8c7abfef31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:12.029787 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d1e7d-04fd-44d7-a0ef-cb8c7abfef31 admin admin] PATH_INFO: `/v3/projects/569be7302efa4664b962b3d47b3aed09/users/6c67fd6bc18144fba20e13ca43af7668/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:12.045579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d1e7d-04fd-44d7-a0ef-cb8c7abfef31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=569be7302efa4664b962b3d47b3aed09, user_id=6c67fd6bc18144fba20e13ca43af7668, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:12.048366 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d1e7d-04fd-44d7-a0ef-cb8c7abfef31 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:12.133058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1356/2707] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:54:12 2022] PUT /identity/v3/projects/569be7302efa4664b962b3d47b3aed09/users/6c67fd6bc18144fba20e13ca43af7668/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:12.149776 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c953e-39b7-45eb-9544-8acad7eafb6e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:12.150076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c953e-39b7-45eb-9544-8acad7eafb6e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:12.150366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c953e-39b7-45eb-9544-8acad7eafb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:12.182446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-7c3c953e-39b7-45eb-9544-8acad7eafb6e None None] MFA Rules not processed for user `6c67fd6bc18144fba20e13ca43af7668`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:12.183741 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-7c3c953e-39b7-45eb-9544-8acad7eafb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:12.253703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1352/2708] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:12.258705 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d1e7d-04fd-44d7-a0ef-cb8c7abfef31 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:12.321952 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d1e7d-04fd-44d7-a0ef-cb8c7abfef31 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:12.327814 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7a239-6483-4f11-8c9c-d3965d064c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:12.328473 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7a239-6483-4f11-8c9c-d3965d064c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:12.328754 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7a239-6483-4f11-8c9c-d3965d064c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:12.329032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7a239-6483-4f11-8c9c-d3965d064c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:12.329731 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7a239-6483-4f11-8c9c-d3965d064c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:12.331642 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7a239-6483-4f11-8c9c-d3965d064c15 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:12.344507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:12.426100 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1357/2709] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:54:12 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:54:12.430359 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c953e-39b7-45eb-9544-8acad7eafb6e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:12.442120 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c953e-39b7-45eb-9544-8acad7eafb6e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:12.485536 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:12.524103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b4c18-80c0-49e4-9ebc-9355c4783164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:12.524788 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b4c18-80c0-49e4-9ebc-9355c4783164 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:12.525367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b4c18-80c0-49e4-9ebc-9355c4783164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:12.525367 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b4c18-80c0-49e4-9ebc-9355c4783164 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:12.526064 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b4c18-80c0-49e4-9ebc-9355c4783164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:12.528036 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b4c18-80c0-49e4-9ebc-9355c4783164 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:12.643920 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1353/2710] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:54:12 2022] POST /identity/v3/users => generated 294 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:54:12.647595 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7a239-6483-4f11-8c9c-d3965d064c15 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:12.665316 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7a239-6483-4f11-8c9c-d3965d064c15 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:12.670973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f72a6-47c3-4603-a293-3524a8963b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:12.672618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f72a6-47c3-4603-a293-3524a8963b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:12.672618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f72a6-47c3-4603-a293-3524a8963b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:12.672618 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f72a6-47c3-4603-a293-3524a8963b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:12.673249 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f72a6-47c3-4603-a293-3524a8963b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:12.674931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904f72a6-47c3-4603-a293-3524a8963b11 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:12.687118 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1358/2711] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:54:12.692191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b4c18-80c0-49e4-9ebc-9355c4783164 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:12.709269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b4c18-80c0-49e4-9ebc-9355c4783164 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:12.715335 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69418ef-cc2c-407d-9b0b-1f899e433229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:12.716413 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69418ef-cc2c-407d-9b0b-1f899e433229 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:12.716975 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69418ef-cc2c-407d-9b0b-1f899e433229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:12.717450 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69418ef-cc2c-407d-9b0b-1f899e433229 admin admin] PATH_INFO: `/v3/projects/84e6ae968ba5486a9b54a6fbb7e47f38/users/2cd547c170ac460a8d6d25a39547e7eb/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:12.736056 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69418ef-cc2c-407d-9b0b-1f899e433229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e6ae968ba5486a9b54a6fbb7e47f38, user_id=2cd547c170ac460a8d6d25a39547e7eb, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:12.739561 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69418ef-cc2c-407d-9b0b-1f899e433229 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:12.824876 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1354/2712] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:54:12 2022] PUT /identity/v3/projects/84e6ae968ba5486a9b54a6fbb7e47f38/users/2cd547c170ac460a8d6d25a39547e7eb/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:12.829139 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f72a6-47c3-4603-a293-3524a8963b11 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:12.839625 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f72a6-47c3-4603-a293-3524a8963b11 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:12.927946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923ce36-a72a-457f-9d0f-b7578dedeb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:12.928381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923ce36-a72a-457f-9d0f-b7578dedeb1b admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:12.928771 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923ce36-a72a-457f-9d0f-b7578dedeb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:12.929688 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923ce36-a72a-457f-9d0f-b7578dedeb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:12.930260 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923ce36-a72a-457f-9d0f-b7578dedeb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:12.932021 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923ce36-a72a-457f-9d0f-b7578dedeb1b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:12.946523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1359/2713] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:54:12.947886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69418ef-cc2c-407d-9b0b-1f899e433229 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:12.959346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69418ef-cc2c-407d-9b0b-1f899e433229 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:12.964247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04e695-7b24-4eb0-9114-d04b30b0e5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:12.965161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04e695-7b24-4eb0-9114-d04b30b0e5f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:12.965444 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04e695-7b24-4eb0-9114-d04b30b0e5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:12.965855 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04e695-7b24-4eb0-9114-d04b30b0e5f1 admin admin] PATH_INFO: `/v3/projects/84e6ae968ba5486a9b54a6fbb7e47f38/users/2cd547c170ac460a8d6d25a39547e7eb/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:12.968560 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04e695-7b24-4eb0-9114-d04b30b0e5f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e6ae968ba5486a9b54a6fbb7e47f38, user_id=2cd547c170ac460a8d6d25a39547e7eb, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:12.971253 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04e695-7b24-4eb0-9114-d04b30b0e5f1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:12.985197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1355/2714] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:54:12 2022] PUT /identity/v3/projects/84e6ae968ba5486a9b54a6fbb7e47f38/users/2cd547c170ac460a8d6d25a39547e7eb/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:13.001164 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739a646-d048-423f-b51a-f6b234ae04e5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:13.001457 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739a646-d048-423f-b51a-f6b234ae04e5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:13.001810 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739a646-d048-423f-b51a-f6b234ae04e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:13.032134 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e739a646-d048-423f-b51a-f6b234ae04e5 None None] MFA Rules not processed for user `2cd547c170ac460a8d6d25a39547e7eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:13.033325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e739a646-d048-423f-b51a-f6b234ae04e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:13.102460 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1360/2715] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:13.115107 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04e695-7b24-4eb0-9114-d04b30b0e5f1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:13.170039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04e695-7b24-4eb0-9114-d04b30b0e5f1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:13.173605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7767f-a102-456a-9b5d-872c2a5b027b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:13.174284 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7767f-a102-456a-9b5d-872c2a5b027b service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:13.174571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7767f-a102-456a-9b5d-872c2a5b027b service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:13.174853 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c7767f-a102-456a-9b5d-872c2a5b027b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:13.230294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7767f-a102-456a-9b5d-872c2a5b027b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:13.231778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c7767f-a102-456a-9b5d-872c2a5b027b service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:13.240610 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1356/2716] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:54:15.256527 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739a646-d048-423f-b51a-f6b234ae04e5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:15.274669 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739a646-d048-423f-b51a-f6b234ae04e5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:15.278556 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df809b-4b74-4c0c-a067-6665ae8a92b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:15.279371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df809b-4b74-4c0c-a067-6665ae8a92b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:15.279586 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df809b-4b74-4c0c-a067-6665ae8a92b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:15.279927 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df809b-4b74-4c0c-a067-6665ae8a92b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:15.355522 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df809b-4b74-4c0c-a067-6665ae8a92b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:15.356981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df809b-4b74-4c0c-a067-6665ae8a92b6 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:15.369037 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1361/2717] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:54:16.956274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7767f-a102-456a-9b5d-872c2a5b027b service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:16.965208 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c7767f-a102-456a-9b5d-872c2a5b027b service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:16.969122 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5b8dd-6ab4-40a8-82bc-8b3b5170733a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:16.969808 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5b8dd-6ab4-40a8-82bc-8b3b5170733a service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:16.970097 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5b8dd-6ab4-40a8-82bc-8b3b5170733a service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:16.970376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc5b8dd-6ab4-40a8-82bc-8b3b5170733a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:16.982150 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5b8dd-6ab4-40a8-82bc-8b3b5170733a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:16.983778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc5b8dd-6ab4-40a8-82bc-8b3b5170733a service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:16.994631 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1357/2718] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:54:20.939626 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c29f-241c-419c-ab0e-2e62eeb465f5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:20.940141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c29f-241c-419c-ab0e-2e62eeb465f5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:20.940264 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5c29f-241c-419c-ab0e-2e62eeb465f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:20.946080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:20.958606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-0cf5c29f-241c-419c-ab0e-2e62eeb465f5 None None] MFA Rules not processed for user `d3e23e1c56394f1baf5d068aaa1d9e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:20.959834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-0cf5c29f-241c-419c-ab0e-2e62eeb465f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:21.015362 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1362/2719] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:21.322969 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5b8dd-6ab4-40a8-82bc-8b3b5170733a service cinder] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:21.324505 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-4dc5b8dd-6ab4-40a8-82bc-8b3b5170733a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:21.345014 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:21.381778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc5b8dd-6ab4-40a8-82bc-8b3b5170733a service cinder] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:21.385624 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195dd1aa-ae19-4f23-bdb3-6e2545111da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:21.386290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dd1aa-ae19-4f23-bdb3-6e2545111da1 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:21.386572 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dd1aa-ae19-4f23-bdb3-6e2545111da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:21.386849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195dd1aa-ae19-4f23-bdb3-6e2545111da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:21.388606 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-195dd1aa-ae19-4f23-bdb3-6e2545111da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:21.399666 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195dd1aa-ae19-4f23-bdb3-6e2545111da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:21.401145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195dd1aa-ae19-4f23-bdb3-6e2545111da1 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:21.409365 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1358/2720] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:54:21.586811 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5c29f-241c-419c-ab0e-2e62eeb465f5 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:21.650965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5c29f-241c-419c-ab0e-2e62eeb465f5 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:21.655869 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3f455-b1bb-4afd-b3f7-71f7d46b1a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:21.656747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3f455-b1bb-4afd-b3f7-71f7d46b1a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:21.657032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3f455-b1bb-4afd-b3f7-71f7d46b1a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:21.657310 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3f455-b1bb-4afd-b3f7-71f7d46b1a0f admin admin] PATH_INFO: `/v3/users/0ffbcc40eb7746e08a6bde2a6e562a0d` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:21.658538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3f455-b1bb-4afd-b3f7-71f7d46b1a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ffbcc40eb7746e08a6bde2a6e562a0d)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:21.660511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3f455-b1bb-4afd-b3f7-71f7d46b1a0f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:21.879086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cfb3f455-b1bb-4afd-b3f7-71f7d46b1a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ffbcc40eb7746e08a6bde2a6e562a0d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:21.958219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cfb3f455-b1bb-4afd-b3f7-71f7d46b1a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ffbcc40eb7746e08a6bde2a6e562a0d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:21.958899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cfb3f455-b1bb-4afd-b3f7-71f7d46b1a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ffbcc40eb7746e08a6bde2a6e562a0d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:21.966449 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cfb3f455-b1bb-4afd-b3f7-71f7d46b1a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ffbcc40eb7746e08a6bde2a6e562a0d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:21.967334 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-cfb3f455-b1bb-4afd-b3f7-71f7d46b1a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ffbcc40eb7746e08a6bde2a6e562a0d'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:21.985535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1363/2721] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:54:21 2022] DELETE /identity/v3/users/0ffbcc40eb7746e08a6bde2a6e562a0d => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:21.990756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f0a1c-5ad9-4082-8ef3-c3f80e231075 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:21.991154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f0a1c-5ad9-4082-8ef3-c3f80e231075 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:21.991579 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9f0a1c-5ad9-4082-8ef3-c3f80e231075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:22.011257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0c9f0a1c-5ad9-4082-8ef3-c3f80e231075 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:22.012503 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0c9f0a1c-5ad9-4082-8ef3-c3f80e231075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:22.077964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1359/2722] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:54:22.087952 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3f455-b1bb-4afd-b3f7-71f7d46b1a0f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:22.089472 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-cfb3f455-b1bb-4afd-b3f7-71f7d46b1a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:22.126058 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:22.155702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3f455-b1bb-4afd-b3f7-71f7d46b1a0f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:22.159742 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c0342-69ab-4524-a73a-b01d3bacab20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:22.160509 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c0342-69ab-4524-a73a-b01d3bacab20 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:22.160897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c0342-69ab-4524-a73a-b01d3bacab20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:22.161365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c0342-69ab-4524-a73a-b01d3bacab20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:22.171463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c0342-69ab-4524-a73a-b01d3bacab20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:22.173042 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c0342-69ab-4524-a73a-b01d3bacab20 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:22.182674 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1364/2723] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:54:22.639620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f0a1c-5ad9-4082-8ef3-c3f80e231075 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:22.641303 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0c9f0a1c-5ad9-4082-8ef3-c3f80e231075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:22.653715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9f0a1c-5ad9-4082-8ef3-c3f80e231075 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:22.659474 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:22.668766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:22.668766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:22.668766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] PATH_INFO: `/v3/projects/3ed46d0c71df402da0bc0c02647d59ee` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:22.668766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed46d0c71df402da0bc0c02647d59ee)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:22.668766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:22.804671 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed46d0c71df402da0bc0c02647d59ee', 'request_id': 'req-b97d99db-ef87-4485-bca2-c96ece04bc9e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:22.924099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed46d0c71df402da0bc0c02647d59ee', 'request_id': 'req-b97d99db-ef87-4485-bca2-c96ece04bc9e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:22.933245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed46d0c71df402da0bc0c02647d59ee', 'request_id': 'req-b97d99db-ef87-4485-bca2-c96ece04bc9e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:22.946060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] The token cache is being invalidate because project 3ed46d0c71df402da0bc0c02647d59ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:54:22.946457 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:22.947431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:22.949114 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1360/2724] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:54:22 2022] DELETE /identity/v3/projects/3ed46d0c71df402da0bc0c02647d59ee => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:22.954017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c0342-69ab-4524-a73a-b01d3bacab20 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:22.965481 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c0342-69ab-4524-a73a-b01d3bacab20 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:23.031632 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d0bba-9044-41df-9409-a1b0fbdfb04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:23.032501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d0bba-9044-41df-9409-a1b0fbdfb04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:23.032781 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d0bba-9044-41df-9409-a1b0fbdfb04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:23.033055 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d0bba-9044-41df-9409-a1b0fbdfb04b admin admin] PATH_INFO: `/v3/users/6c67fd6bc18144fba20e13ca43af7668` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:23.034410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d0bba-9044-41df-9409-a1b0fbdfb04b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c67fd6bc18144fba20e13ca43af7668)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:23.036428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d0bba-9044-41df-9409-a1b0fbdfb04b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:23.190316 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b58d0bba-9044-41df-9409-a1b0fbdfb04b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c67fd6bc18144fba20e13ca43af7668'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:23.250203 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b58d0bba-9044-41df-9409-a1b0fbdfb04b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c67fd6bc18144fba20e13ca43af7668'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:23.250822 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b58d0bba-9044-41df-9409-a1b0fbdfb04b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c67fd6bc18144fba20e13ca43af7668'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:23.258365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b58d0bba-9044-41df-9409-a1b0fbdfb04b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c67fd6bc18144fba20e13ca43af7668'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:23.258996 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b58d0bba-9044-41df-9409-a1b0fbdfb04b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c67fd6bc18144fba20e13ca43af7668'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:23.276143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1365/2725] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:54:22 2022] DELETE /identity/v3/users/6c67fd6bc18144fba20e13ca43af7668 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:23.387184 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:23.388667 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:23.401537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d99db-ef87-4485-bca2-c96ece04bc9e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:23.444508 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:23.459351 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f5576-6501-4540-8bed-1d033f7f880e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:23.460232 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f5576-6501-4540-8bed-1d033f7f880e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:23.460515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f5576-6501-4540-8bed-1d033f7f880e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:23.460795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f5576-6501-4540-8bed-1d033f7f880e admin admin] PATH_INFO: `/v3/users/f0411cf0331049338640a882f11c88a5` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:23.462074 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f5576-6501-4540-8bed-1d033f7f880e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0411cf0331049338640a882f11c88a5)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:23.464050 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f5576-6501-4540-8bed-1d033f7f880e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:23.638599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7e9f5576-6501-4540-8bed-1d033f7f880e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0411cf0331049338640a882f11c88a5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:23.639710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7e9f5576-6501-4540-8bed-1d033f7f880e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0411cf0331049338640a882f11c88a5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:23.640339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7e9f5576-6501-4540-8bed-1d033f7f880e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0411cf0331049338640a882f11c88a5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:23.652273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7e9f5576-6501-4540-8bed-1d033f7f880e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0411cf0331049338640a882f11c88a5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:23.660068 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-7e9f5576-6501-4540-8bed-1d033f7f880e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0411cf0331049338640a882f11c88a5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:23.700343 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d0bba-9044-41df-9409-a1b0fbdfb04b admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:23.702467 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b58d0bba-9044-41df-9409-a1b0fbdfb04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:23.716524 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d0bba-9044-41df-9409-a1b0fbdfb04b admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:23.722911 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:23.730041 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1361/2726] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:54:23 2022] DELETE /identity/v3/users/f0411cf0331049338640a882f11c88a5 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:23.731646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:23.731646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:23.731646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] PATH_INFO: `/v3/projects/569be7302efa4664b962b3d47b3aed09` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:23.732158 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=569be7302efa4664b962b3d47b3aed09)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:23.735066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:23.735785 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b8b86-fb7b-4638-8793-93551e6e96d4 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:23.736145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b8b86-fb7b-4638-8793-93551e6e96d4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:23.736620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b8b86-fb7b-4638-8793-93551e6e96d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:23.754619 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-885b8b86-fb7b-4638-8793-93551e6e96d4 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:54:23.755846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-885b8b86-fb7b-4638-8793-93551e6e96d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:23.823705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1362/2727] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:54:23.834103 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b8b86-fb7b-4638-8793-93551e6e96d4 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:23.836106 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-885b8b86-fb7b-4638-8793-93551e6e96d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:23.860914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:23.866009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '569be7302efa4664b962b3d47b3aed09', 'request_id': 'req-122571d3-cda6-4f64-9028-c6d5ae3da3c6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:23.907257 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b8b86-fb7b-4638-8793-93551e6e96d4 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:23.924609 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:23.958216 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33a82e-bf8a-40ec-8db3-d7346fc40909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:23.958874 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33a82e-bf8a-40ec-8db3-d7346fc40909 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:23.959156 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33a82e-bf8a-40ec-8db3-d7346fc40909 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:23.959431 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33a82e-bf8a-40ec-8db3-d7346fc40909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:23.969434 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '569be7302efa4664b962b3d47b3aed09', 'request_id': 'req-122571d3-cda6-4f64-9028-c6d5ae3da3c6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:23.985280 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '569be7302efa4664b962b3d47b3aed09', 'request_id': 'req-122571d3-cda6-4f64-9028-c6d5ae3da3c6'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:24.001751 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] The token cache is being invalidate because project 569be7302efa4664b962b3d47b3aed09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:54:24.003201 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:24.004460 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:24.006613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1366/2728] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:54:23 2022] DELETE /identity/v3/projects/569be7302efa4664b962b3d47b3aed09 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:54:24.011965 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:24.014718 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:24.039432 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33a82e-bf8a-40ec-8db3-d7346fc40909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:24.042025 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33a82e-bf8a-40ec-8db3-d7346fc40909 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:24.060222 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1363/2729] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:54:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:54:24.104880 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122571d3-cda6-4f64-9028-c6d5ae3da3c6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:24.112489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff3d43-c8da-49ef-a254-1d9bb18e2e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:24.113641 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff3d43-c8da-49ef-a254-1d9bb18e2e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:24.113948 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff3d43-c8da-49ef-a254-1d9bb18e2e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:24.114256 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff3d43-c8da-49ef-a254-1d9bb18e2e1c admin admin] PATH_INFO: `/v3/users/2cd547c170ac460a8d6d25a39547e7eb` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:24.116151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff3d43-c8da-49ef-a254-1d9bb18e2e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd547c170ac460a8d6d25a39547e7eb)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:24.118181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff3d43-c8da-49ef-a254-1d9bb18e2e1c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:24.380827 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-74ff3d43-c8da-49ef-a254-1d9bb18e2e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd547c170ac460a8d6d25a39547e7eb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:24.477683 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-74ff3d43-c8da-49ef-a254-1d9bb18e2e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd547c170ac460a8d6d25a39547e7eb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:24.480836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-74ff3d43-c8da-49ef-a254-1d9bb18e2e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd547c170ac460a8d6d25a39547e7eb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:24.487198 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-74ff3d43-c8da-49ef-a254-1d9bb18e2e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd547c170ac460a8d6d25a39547e7eb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:24.487883 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-74ff3d43-c8da-49ef-a254-1d9bb18e2e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd547c170ac460a8d6d25a39547e7eb'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:24.506728 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1367/2730] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:54:24 2022] DELETE /identity/v3/users/2cd547c170ac460a8d6d25a39547e7eb => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:24.559155 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33a82e-bf8a-40ec-8db3-d7346fc40909 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:24.561677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6a33a82e-bf8a-40ec-8db3-d7346fc40909 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:24.575141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33a82e-bf8a-40ec-8db3-d7346fc40909 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:24.646881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a4a0e-944c-42f7-b550-fbf309ae963e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:24.646881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a4a0e-944c-42f7-b550-fbf309ae963e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:24.646881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a4a0e-944c-42f7-b550-fbf309ae963e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:24.646881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a4a0e-944c-42f7-b550-fbf309ae963e admin admin] PATH_INFO: `/v3/projects/b8b028d5199c4c52946ae83600984f3c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:24.648602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a4a0e-944c-42f7-b550-fbf309ae963e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b028d5199c4c52946ae83600984f3c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:24.650044 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a4a0e-944c-42f7-b550-fbf309ae963e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:24.771603 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d90a4a0e-944c-42f7-b550-fbf309ae963e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b028d5199c4c52946ae83600984f3c', 'request_id': 'req-d90a4a0e-944c-42f7-b550-fbf309ae963e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:24.837863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d90a4a0e-944c-42f7-b550-fbf309ae963e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b028d5199c4c52946ae83600984f3c', 'request_id': 'req-d90a4a0e-944c-42f7-b550-fbf309ae963e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:24.844945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d90a4a0e-944c-42f7-b550-fbf309ae963e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b028d5199c4c52946ae83600984f3c', 'request_id': 'req-d90a4a0e-944c-42f7-b550-fbf309ae963e'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:24.853026 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:24.856931 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d90a4a0e-944c-42f7-b550-fbf309ae963e admin admin] The token cache is being invalidate because project b8b028d5199c4c52946ae83600984f3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:54:24.857274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d90a4a0e-944c-42f7-b550-fbf309ae963e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:24.861553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d90a4a0e-944c-42f7-b550-fbf309ae963e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:24.861553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1364/2731] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:54:24 2022] DELETE /identity/v3/projects/b8b028d5199c4c52946ae83600984f3c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:25.161141 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff3d43-c8da-49ef-a254-1d9bb18e2e1c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:54:25.163057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-74ff3d43-c8da-49ef-a254-1d9bb18e2e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:54:25.189853 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff3d43-c8da-49ef-a254-1d9bb18e2e1c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:54:25.265418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:54:25.277194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:54:25.286039 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:54:25.286039 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:54:25.286039 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] PATH_INFO: `/v3/projects/84e6ae968ba5486a9b54a6fbb7e47f38` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:54:25.286039 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e6ae968ba5486a9b54a6fbb7e47f38)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:54:25.286039 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:54:25.396581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e6ae968ba5486a9b54a6fbb7e47f38', 'request_id': 'req-4efccab3-901f-4efd-ad64-2e389eb01354'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:25.486923 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e6ae968ba5486a9b54a6fbb7e47f38', 'request_id': 'req-4efccab3-901f-4efd-ad64-2e389eb01354'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:25.493859 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e6ae968ba5486a9b54a6fbb7e47f38', 'request_id': 'req-4efccab3-901f-4efd-ad64-2e389eb01354'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:25.505165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] The token cache is being invalidate because project 84e6ae968ba5486a9b54a6fbb7e47f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:54:25.505645 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:25.506719 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:54:25.508579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1368/2732] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:54:25 2022] DELETE /identity/v3/projects/84e6ae968ba5486a9b54a6fbb7e47f38 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:54:35.667335 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:55:19.860849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520169b4-283d-4ad5-8133-b2432e6bd031 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:55:19.861573 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520169b4-283d-4ad5-8133-b2432e6bd031 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:55:19.861573 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520169b4-283d-4ad5-8133-b2432e6bd031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:55:19.888648 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-520169b4-283d-4ad5-8133-b2432e6bd031 None None] MFA Rules not processed for user `d3e23e1c56394f1baf5d068aaa1d9e2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:55:19.889896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-520169b4-283d-4ad5-8133-b2432e6bd031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:55:19.961833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1365/2733] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:55:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:55:29.959642 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=37 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:55:33.594901 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:55:33.596454 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:55:33.750469 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efccab3-901f-4efd-ad64-2e389eb01354 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:55:33.757015 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ccd73-c047-4e1c-a015-bf4de03317ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:55:33.757666 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ccd73-c047-4e1c-a015-bf4de03317ae service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:55:33.757975 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ccd73-c047-4e1c-a015-bf4de03317ae service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:55:33.758499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ccd73-c047-4e1c-a015-bf4de03317ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:55:33.760275 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ab7ccd73-c047-4e1c-a015-bf4de03317ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:55:33.773418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ccd73-c047-4e1c-a015-bf4de03317ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:55:33.775032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ccd73-c047-4e1c-a015-bf4de03317ae service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:55:33.785643 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1369/2734] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:55:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:55:43.781045 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=64 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:16.145629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520169b4-283d-4ad5-8133-b2432e6bd031 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:16.147063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-520169b4-283d-4ad5-8133-b2432e6bd031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:16.235373 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520169b4-283d-4ad5-8133-b2432e6bd031 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:16.240477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25871aa2-a352-4ebe-a554-58eef1ec0f6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c9898ccf874dce88f08bebdbae02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:16.241132 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871aa2-a352-4ebe-a554-58eef1ec0f6e service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:16.242138 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871aa2-a352-4ebe-a554-58eef1ec0f6e service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:16.242555 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25871aa2-a352-4ebe-a554-58eef1ec0f6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:16.244634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-25871aa2-a352-4ebe-a554-58eef1ec0f6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:16.256457 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25871aa2-a352-4ebe-a554-58eef1ec0f6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:16.258218 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25871aa2-a352-4ebe-a554-58eef1ec0f6e service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:16.268494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1366/2735] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:56:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:56:26.264104 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=41 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:27.915225 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ccd73-c047-4e1c-a015-bf4de03317ae service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:27.916928 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-ab7ccd73-c047-4e1c-a015-bf4de03317ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:28.027663 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ccd73-c047-4e1c-a015-bf4de03317ae service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:28.032424 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6dd83-1f99-48b9-bf80-e34a75fa342a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:28.035673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6dd83-1f99-48b9-bf80-e34a75fa342a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:28.035673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6dd83-1f99-48b9-bf80-e34a75fa342a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:28.035673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6dd83-1f99-48b9-bf80-e34a75fa342a admin admin] PATH_INFO: `/v3/users/d3e23e1c56394f1baf5d068aaa1d9e2c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:28.035673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6dd83-1f99-48b9-bf80-e34a75fa342a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3e23e1c56394f1baf5d068aaa1d9e2c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:28.037187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f6dd83-1f99-48b9-bf80-e34a75fa342a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:28.195862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88f6dd83-1f99-48b9-bf80-e34a75fa342a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3e23e1c56394f1baf5d068aaa1d9e2c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:28.251365 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88f6dd83-1f99-48b9-bf80-e34a75fa342a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3e23e1c56394f1baf5d068aaa1d9e2c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:28.251964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88f6dd83-1f99-48b9-bf80-e34a75fa342a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3e23e1c56394f1baf5d068aaa1d9e2c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:28.260072 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88f6dd83-1f99-48b9-bf80-e34a75fa342a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3e23e1c56394f1baf5d068aaa1d9e2c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:28.260702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-88f6dd83-1f99-48b9-bf80-e34a75fa342a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3e23e1c56394f1baf5d068aaa1d9e2c'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:28.278885 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1370/2736] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:56:27 2022] DELETE /identity/v3/users/d3e23e1c56394f1baf5d068aaa1d9e2c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:56:28.550644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25871aa2-a352-4ebe-a554-58eef1ec0f6e service placement] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:28.562313 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25871aa2-a352-4ebe-a554-58eef1ec0f6e service placement] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:28.625686 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:28.626586 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:28.626873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:28.627153 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb admin admin] PATH_INFO: `/v3/projects/c878503c91e64c0a828910ae5e315c7f` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:28.628345 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c878503c91e64c0a828910ae5e315c7f)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:28.630301 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:28.720105 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c878503c91e64c0a828910ae5e315c7f', 'request_id': 'req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:28.789221 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c878503c91e64c0a828910ae5e315c7f', 'request_id': 'req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:28.795071 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c878503c91e64c0a828910ae5e315c7f', 'request_id': 'req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:28.806630 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb admin admin] The token cache is being invalidate because project c878503c91e64c0a828910ae5e315c7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:56:28.807593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:28.807593 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-ab15b3a1-a76b-427d-91bc-0d4b4ab846bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:28.809118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1367/2737] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:56:28 2022] DELETE /identity/v3/projects/c878503c91e64c0a828910ae5e315c7f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:56:28.814270 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3a7ad-d162-4209-89a3-b87b2a3790be None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:28.814560 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3a7ad-d162-4209-89a3-b87b2a3790be None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:28.814838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3a7ad-d162-4209-89a3-b87b2a3790be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:28.871189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-e1e3a7ad-d162-4209-89a3-b87b2a3790be None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:56:28.872396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-e1e3a7ad-d162-4209-89a3-b87b2a3790be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:28.886179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:28.932463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1371/2738] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:56:28.940489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632da055-0976-4953-9486-43e070e47df7 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:28.940780 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632da055-0976-4953-9486-43e070e47df7 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:28.941063 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632da055-0976-4953-9486-43e070e47df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:28.961154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-632da055-0976-4953-9486-43e070e47df7 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:56:28.962401 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-632da055-0976-4953-9486-43e070e47df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:28.970841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1368/2739] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:56:28.975172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3a7ad-d162-4209-89a3-b87b2a3790be None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:28.985354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3a7ad-d162-4209-89a3-b87b2a3790be None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:28.989885 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53088f-a3bc-4e72-8472-bce6803a3ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:28.990537 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53088f-a3bc-4e72-8472-bce6803a3ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:28.990820 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53088f-a3bc-4e72-8472-bce6803a3ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:28.991181 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53088f-a3bc-4e72-8472-bce6803a3ec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:28.991862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53088f-a3bc-4e72-8472-bce6803a3ec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:56:28.992166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53088f-a3bc-4e72-8472-bce6803a3ec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:28.993758 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53088f-a3bc-4e72-8472-bce6803a3ec6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:29.004951 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1372/2740] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:56:29.009899 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632da055-0976-4953-9486-43e070e47df7 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:29.019278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632da055-0976-4953-9486-43e070e47df7 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:29.024622 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee58528-5827-40d5-b314-d51271ed1c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:29.025279 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee58528-5827-40d5-b314-d51271ed1c20 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:29.025564 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee58528-5827-40d5-b314-d51271ed1c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:29.025878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee58528-5827-40d5-b314-d51271ed1c20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:29.026587 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee58528-5827-40d5-b314-d51271ed1c20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:29.028541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee58528-5827-40d5-b314-d51271ed1c20 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:29.116740 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1369/2741] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:56:29 2022] POST /identity/v3/projects => generated 355 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:56:29.120874 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53088f-a3bc-4e72-8472-bce6803a3ec6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:29.130962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53088f-a3bc-4e72-8472-bce6803a3ec6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:29.185710 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4d003-8f18-40a6-b033-d42b44c7f905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:29.186398 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4d003-8f18-40a6-b033-d42b44c7f905 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:29.186684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4d003-8f18-40a6-b033-d42b44c7f905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:29.186957 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e4d003-8f18-40a6-b033-d42b44c7f905 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:29.187632 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4d003-8f18-40a6-b033-d42b44c7f905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:29.189523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e4d003-8f18-40a6-b033-d42b44c7f905 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:29.291772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1373/2742] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:56:29 2022] POST /identity/v3/users => generated 278 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:56:29.295903 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee58528-5827-40d5-b314-d51271ed1c20 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:29.307139 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee58528-5827-40d5-b314-d51271ed1c20 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:29.311945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f1683-e59e-4844-9373-cd73c3289c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:29.312604 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1683-e59e-4844-9373-cd73c3289c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:29.312921 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1683-e59e-4844-9373-cd73c3289c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:29.313197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f1683-e59e-4844-9373-cd73c3289c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:29.313970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f1683-e59e-4844-9373-cd73c3289c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:29.315567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f1683-e59e-4844-9373-cd73c3289c7e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:29.327755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1370/2743] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:56:29.331736 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4d003-8f18-40a6-b033-d42b44c7f905 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:29.344442 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e4d003-8f18-40a6-b033-d42b44c7f905 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:29.349004 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b12180-5fad-4b6f-979f-cfc163925cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:29.349687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b12180-5fad-4b6f-979f-cfc163925cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:29.349959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b12180-5fad-4b6f-979f-cfc163925cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:29.350239 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b12180-5fad-4b6f-979f-cfc163925cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:29.351174 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b12180-5fad-4b6f-979f-cfc163925cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:29.352797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b12180-5fad-4b6f-979f-cfc163925cb9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:29.362932 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1374/2744] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:56:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:56:29.375369 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f1683-e59e-4844-9373-cd73c3289c7e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:29.387079 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f1683-e59e-4844-9373-cd73c3289c7e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:29.391762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ee009-4f7e-4a1d-a9a9-c975990bd056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:29.392683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ee009-4f7e-4a1d-a9a9-c975990bd056 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:29.392966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ee009-4f7e-4a1d-a9a9-c975990bd056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:29.393245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5ee009-4f7e-4a1d-a9a9-c975990bd056 admin admin] PATH_INFO: `/v3/projects/9d5183abc57944f290c6e58c66fe5d6b/users/bdce8d99f907464da1398dcaf5091e65/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:29.530343 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ee009-4f7e-4a1d-a9a9-c975990bd056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5183abc57944f290c6e58c66fe5d6b, user_id=bdce8d99f907464da1398dcaf5091e65, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:29.533033 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5ee009-4f7e-4a1d-a9a9-c975990bd056 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:29.640977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1371/2745] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:56:29 2022] PUT /identity/v3/projects/9d5183abc57944f290c6e58c66fe5d6b/users/bdce8d99f907464da1398dcaf5091e65/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:56:29.651063 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1439-e96d-4d6c-a30b-910a56fdfdd9 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:29.651355 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1439-e96d-4d6c-a30b-910a56fdfdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:29.651634 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e1439-e96d-4d6c-a30b-910a56fdfdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:29.679388 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-070e1439-e96d-4d6c-a30b-910a56fdfdd9 None None] MFA Rules not processed for user `bdce8d99f907464da1398dcaf5091e65`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:56:29.680678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-070e1439-e96d-4d6c-a30b-910a56fdfdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:29.743000 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1375/2746] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:56:29 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:56:29.747408 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ee009-4f7e-4a1d-a9a9-c975990bd056 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:29.777254 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:29.809060 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5ee009-4f7e-4a1d-a9a9-c975990bd056 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:29.813829 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dab7b3-1ed2-4945-9fd6-bee7fa91f5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:29.819030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dab7b3-1ed2-4945-9fd6-bee7fa91f5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:29.819030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dab7b3-1ed2-4945-9fd6-bee7fa91f5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:29.819030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dab7b3-1ed2-4945-9fd6-bee7fa91f5e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:29.819030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dab7b3-1ed2-4945-9fd6-bee7fa91f5e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:29.819030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dab7b3-1ed2-4945-9fd6-bee7fa91f5e5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:29.893228 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1372/2747] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:56:29 2022] POST /identity/v3/projects => generated 355 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:56:29.897128 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e1439-e96d-4d6c-a30b-910a56fdfdd9 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:29.908328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e1439-e96d-4d6c-a30b-910a56fdfdd9 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:29.920090 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:29.965498 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c579f32-59aa-4f8e-af61-9e03c81636ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:29.966242 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579f32-59aa-4f8e-af61-9e03c81636ed admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:29.966529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579f32-59aa-4f8e-af61-9e03c81636ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:29.966809 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579f32-59aa-4f8e-af61-9e03c81636ed admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:29.967507 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c579f32-59aa-4f8e-af61-9e03c81636ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:29.969463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c579f32-59aa-4f8e-af61-9e03c81636ed admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:30.092866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1376/2748] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:56:29 2022] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:56:30.096798 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dab7b3-1ed2-4945-9fd6-bee7fa91f5e5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:30.107827 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dab7b3-1ed2-4945-9fd6-bee7fa91f5e5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:30.112343 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4edc88-f1ba-487e-81c2-5c64db308736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:30.112992 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4edc88-f1ba-487e-81c2-5c64db308736 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:30.113272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4edc88-f1ba-487e-81c2-5c64db308736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:30.113545 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4edc88-f1ba-487e-81c2-5c64db308736 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:30.114293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4edc88-f1ba-487e-81c2-5c64db308736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:30.115863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4edc88-f1ba-487e-81c2-5c64db308736 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:30.125646 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1373/2749] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:56:30.130261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c579f32-59aa-4f8e-af61-9e03c81636ed admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:30.140527 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c579f32-59aa-4f8e-af61-9e03c81636ed admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:30.145228 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fae0a1-5d98-46fa-b7b4-992b99269b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:30.146083 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fae0a1-5d98-46fa-b7b4-992b99269b21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:30.146370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fae0a1-5d98-46fa-b7b4-992b99269b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:30.146650 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fae0a1-5d98-46fa-b7b4-992b99269b21 admin admin] PATH_INFO: `/v3/projects/9feb17bd2aa84e5da14a2385b4784618/users/2b2cc5b2c4b94a919f1757135c1dd60f/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:30.161896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fae0a1-5d98-46fa-b7b4-992b99269b21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9feb17bd2aa84e5da14a2385b4784618, user_id=2b2cc5b2c4b94a919f1757135c1dd60f, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:30.165409 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fae0a1-5d98-46fa-b7b4-992b99269b21 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:30.229022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1377/2750] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:56:30 2022] PUT /identity/v3/projects/9feb17bd2aa84e5da14a2385b4784618/users/2b2cc5b2c4b94a919f1757135c1dd60f/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:56:30.232956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4edc88-f1ba-487e-81c2-5c64db308736 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:30.242870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4edc88-f1ba-487e-81c2-5c64db308736 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:30.297759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5385160-3329-4f70-aa8b-84c8868cf3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:30.298415 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5385160-3329-4f70-aa8b-84c8868cf3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:30.298690 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5385160-3329-4f70-aa8b-84c8868cf3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:30.298960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5385160-3329-4f70-aa8b-84c8868cf3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:30.299675 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5385160-3329-4f70-aa8b-84c8868cf3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:30.301258 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5385160-3329-4f70-aa8b-84c8868cf3f0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:30.310818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1374/2751] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:56:30.314954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fae0a1-5d98-46fa-b7b4-992b99269b21 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:30.325772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fae0a1-5d98-46fa-b7b4-992b99269b21 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:30.330309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05630ade-f815-403d-a149-5a97e4a535ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:30.331189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05630ade-f815-403d-a149-5a97e4a535ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:30.331467 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05630ade-f815-403d-a149-5a97e4a535ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:30.331743 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05630ade-f815-403d-a149-5a97e4a535ee admin admin] PATH_INFO: `/v3/projects/9feb17bd2aa84e5da14a2385b4784618/users/2b2cc5b2c4b94a919f1757135c1dd60f/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:30.333702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05630ade-f815-403d-a149-5a97e4a535ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=9feb17bd2aa84e5da14a2385b4784618, user_id=2b2cc5b2c4b94a919f1757135c1dd60f, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:30.337098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05630ade-f815-403d-a149-5a97e4a535ee admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:30.347112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1378/2752] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:56:30 2022] PUT /identity/v3/projects/9feb17bd2aa84e5da14a2385b4784618/users/2b2cc5b2c4b94a919f1757135c1dd60f/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:56:30.358790 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3833ed0-bcca-4403-9857-48ef7718e0d0 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:30.359081 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3833ed0-bcca-4403-9857-48ef7718e0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:30.359356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3833ed0-bcca-4403-9857-48ef7718e0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:30.385453 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-f3833ed0-bcca-4403-9857-48ef7718e0d0 None None] MFA Rules not processed for user `2b2cc5b2c4b94a919f1757135c1dd60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:56:30.386668 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f3833ed0-bcca-4403-9857-48ef7718e0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:30.453598 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1375/2753] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:56:30 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:56:30.465135 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05630ade-f815-403d-a149-5a97e4a535ee admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:30.466895 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-05630ade-f815-403d-a149-5a97e4a535ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:30.545501 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05630ade-f815-403d-a149-5a97e4a535ee admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:30.549221 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39414a-2835-4204-85a7-219cb5b31c82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:30.549899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39414a-2835-4204-85a7-219cb5b31c82 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:30.550185 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39414a-2835-4204-85a7-219cb5b31c82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:30.550461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39414a-2835-4204-85a7-219cb5b31c82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:30.560526 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39414a-2835-4204-85a7-219cb5b31c82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:30.561981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39414a-2835-4204-85a7-219cb5b31c82 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:30.571762 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1379/2754] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:56:30 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:56:30.846929 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3833ed0-bcca-4403-9857-48ef7718e0d0 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:30.857276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3833ed0-bcca-4403-9857-48ef7718e0d0 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:30.860845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6055dcc-0817-4c3f-b3e3-11f14f7d706f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:30.861480 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6055dcc-0817-4c3f-b3e3-11f14f7d706f service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:30.861786 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6055dcc-0817-4c3f-b3e3-11f14f7d706f service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:30.862065 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6055dcc-0817-4c3f-b3e3-11f14f7d706f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:30.880795 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:30.918121 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6055dcc-0817-4c3f-b3e3-11f14f7d706f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:30.919588 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6055dcc-0817-4c3f-b3e3-11f14f7d706f service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:30.928282 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1376/2755] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:56:30 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:56:40.567206 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=72,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:41.303099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=18 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:48.342226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39414a-2835-4204-85a7-219cb5b31c82 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:48.403992 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39414a-2835-4204-85a7-219cb5b31c82 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:48.408635 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dec3c1-3c3c-493a-9f35-139e5ffa3b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:48.409499 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dec3c1-3c3c-493a-9f35-139e5ffa3b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:48.409824 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dec3c1-3c3c-493a-9f35-139e5ffa3b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:48.410082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dec3c1-3c3c-493a-9f35-139e5ffa3b2a admin admin] PATH_INFO: `/v3/users/bdce8d99f907464da1398dcaf5091e65` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:48.411523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dec3c1-3c3c-493a-9f35-139e5ffa3b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdce8d99f907464da1398dcaf5091e65)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:48.413426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dec3c1-3c3c-493a-9f35-139e5ffa3b2a admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:48.607290 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f0dec3c1-3c3c-493a-9f35-139e5ffa3b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdce8d99f907464da1398dcaf5091e65'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:48.696893 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f0dec3c1-3c3c-493a-9f35-139e5ffa3b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdce8d99f907464da1398dcaf5091e65'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:48.697547 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f0dec3c1-3c3c-493a-9f35-139e5ffa3b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdce8d99f907464da1398dcaf5091e65'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:48.705270 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f0dec3c1-3c3c-493a-9f35-139e5ffa3b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdce8d99f907464da1398dcaf5091e65'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:48.711881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-f0dec3c1-3c3c-493a-9f35-139e5ffa3b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdce8d99f907464da1398dcaf5091e65'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:48.722954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1380/2756] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:56:48 2022] DELETE /identity/v3/users/bdce8d99f907464da1398dcaf5091e65 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:56:48.727554 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bce5a-33bd-4281-ae75-3ba3acb9d477 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:48.728046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bce5a-33bd-4281-ae75-3ba3acb9d477 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:48.728163 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bce5a-33bd-4281-ae75-3ba3acb9d477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:48.745476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ac7bce5a-33bd-4281-ae75-3ba3acb9d477 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:56:48.746772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ac7bce5a-33bd-4281-ae75-3ba3acb9d477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:48.805513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1377/2757] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:56:48.816287 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dec3c1-3c3c-493a-9f35-139e5ffa3b2a admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:48.817673 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-f0dec3c1-3c3c-493a-9f35-139e5ffa3b2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:48.895957 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dec3c1-3c3c-493a-9f35-139e5ffa3b2a admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:48.899504 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d60f03-73b4-4f9c-b69a-e65bd7a5eb90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:48.900142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d60f03-73b4-4f9c-b69a-e65bd7a5eb90 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:48.900419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d60f03-73b4-4f9c-b69a-e65bd7a5eb90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:48.900692 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d60f03-73b4-4f9c-b69a-e65bd7a5eb90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:48.910580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d60f03-73b4-4f9c-b69a-e65bd7a5eb90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:48.911986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d60f03-73b4-4f9c-b69a-e65bd7a5eb90 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:48.922104 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1381/2758] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:56:49.315941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bce5a-33bd-4281-ae75-3ba3acb9d477 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:49.317414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ac7bce5a-33bd-4281-ae75-3ba3acb9d477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:49.331136 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bce5a-33bd-4281-ae75-3ba3acb9d477 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:49.335755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:49.336627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:49.336907 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:49.337181 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] PATH_INFO: `/v3/projects/9d5183abc57944f290c6e58c66fe5d6b` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:49.338385 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5183abc57944f290c6e58c66fe5d6b)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:49.340328 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:49.480465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5183abc57944f290c6e58c66fe5d6b', 'request_id': 'req-930e845d-a50a-4861-aa80-385642ba3abe'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:49.536369 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5183abc57944f290c6e58c66fe5d6b', 'request_id': 'req-930e845d-a50a-4861-aa80-385642ba3abe'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:49.542156 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5183abc57944f290c6e58c66fe5d6b', 'request_id': 'req-930e845d-a50a-4861-aa80-385642ba3abe'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:49.553442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] The token cache is being invalidate because project 9d5183abc57944f290c6e58c66fe5d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:56:49.553729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:49.554386 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:49.555923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1378/2759] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:56:49 2022] DELETE /identity/v3/projects/9d5183abc57944f290c6e58c66fe5d6b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:56:49.560012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d60f03-73b4-4f9c-b69a-e65bd7a5eb90 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:49.575944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:49.575944 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d60f03-73b4-4f9c-b69a-e65bd7a5eb90 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:49.625613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07899442-51aa-46f8-b702-bf56bc605985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:49.626519 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899442-51aa-46f8-b702-bf56bc605985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:49.626833 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899442-51aa-46f8-b702-bf56bc605985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:49.627112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07899442-51aa-46f8-b702-bf56bc605985 admin admin] PATH_INFO: `/v3/users/2b2cc5b2c4b94a919f1757135c1dd60f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:49.628361 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07899442-51aa-46f8-b702-bf56bc605985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2cc5b2c4b94a919f1757135c1dd60f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:49.630300 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07899442-51aa-46f8-b702-bf56bc605985 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:49.830730 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-07899442-51aa-46f8-b702-bf56bc605985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2cc5b2c4b94a919f1757135c1dd60f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:49.936689 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-07899442-51aa-46f8-b702-bf56bc605985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2cc5b2c4b94a919f1757135c1dd60f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:49.937861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-07899442-51aa-46f8-b702-bf56bc605985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2cc5b2c4b94a919f1757135c1dd60f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:49.945112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-07899442-51aa-46f8-b702-bf56bc605985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2cc5b2c4b94a919f1757135c1dd60f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:49.945788 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-07899442-51aa-46f8-b702-bf56bc605985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2cc5b2c4b94a919f1757135c1dd60f'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:49.963595 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1382/2760] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:56:49 2022] DELETE /identity/v3/users/2b2cc5b2c4b94a919f1757135c1dd60f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:56:50.447443 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:50.448918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:50.462454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e845d-a50a-4861-aa80-385642ba3abe admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:50.520774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42bf54b-7e52-475f-946c-7dd8a588c076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:50.521627 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bf54b-7e52-475f-946c-7dd8a588c076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:50.521948 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bf54b-7e52-475f-946c-7dd8a588c076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:50.522223 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bf54b-7e52-475f-946c-7dd8a588c076 admin admin] PATH_INFO: `/v3/projects/9feb17bd2aa84e5da14a2385b4784618` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:50.523405 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bf54b-7e52-475f-946c-7dd8a588c076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9feb17bd2aa84e5da14a2385b4784618)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:50.525302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42bf54b-7e52-475f-946c-7dd8a588c076 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:50.629468 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:50.646266 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d42bf54b-7e52-475f-946c-7dd8a588c076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9feb17bd2aa84e5da14a2385b4784618', 'request_id': 'req-d42bf54b-7e52-475f-946c-7dd8a588c076'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:50.747343 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d42bf54b-7e52-475f-946c-7dd8a588c076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9feb17bd2aa84e5da14a2385b4784618', 'request_id': 'req-d42bf54b-7e52-475f-946c-7dd8a588c076'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:50.754655 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d42bf54b-7e52-475f-946c-7dd8a588c076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9feb17bd2aa84e5da14a2385b4784618', 'request_id': 'req-d42bf54b-7e52-475f-946c-7dd8a588c076'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:50.766319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d42bf54b-7e52-475f-946c-7dd8a588c076 admin admin] The token cache is being invalidate because project 9feb17bd2aa84e5da14a2385b4784618 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:56:50.766642 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d42bf54b-7e52-475f-946c-7dd8a588c076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:50.767293 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-d42bf54b-7e52-475f-946c-7dd8a588c076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:50.768852 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1379/2761] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:56:50 2022] DELETE /identity/v3/projects/9feb17bd2aa84e5da14a2385b4784618 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:56:50.773834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b22c99-26bf-41e5-ac2d-e7d8dc22bb59 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:50.774304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b22c99-26bf-41e5-ac2d-e7d8dc22bb59 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:50.774428 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b22c99-26bf-41e5-ac2d-e7d8dc22bb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:50.792723 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-82b22c99-26bf-41e5-ac2d-e7d8dc22bb59 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:56:50.793963 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-82b22c99-26bf-41e5-ac2d-e7d8dc22bb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:50.853615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1383/2762] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:56:50.863417 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7086f-eb73-41e1-b061-0bc3c979bec5 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:50.863701 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7086f-eb73-41e1-b061-0bc3c979bec5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:50.863978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7086f-eb73-41e1-b061-0bc3c979bec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:50.882567 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-edf7086f-eb73-41e1-b061-0bc3c979bec5 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:56:50.883993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-edf7086f-eb73-41e1-b061-0bc3c979bec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:50.892408 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1380/2763] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:56:50.896746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b22c99-26bf-41e5-ac2d-e7d8dc22bb59 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:50.906636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b22c99-26bf-41e5-ac2d-e7d8dc22bb59 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:50.911205 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6ce1b-a24f-4d97-9b6b-3f1b21d63d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:50.915054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6ce1b-a24f-4d97-9b6b-3f1b21d63d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:50.915054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6ce1b-a24f-4d97-9b6b-3f1b21d63d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:50.915054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6ce1b-a24f-4d97-9b6b-3f1b21d63d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:50.915054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6ce1b-a24f-4d97-9b6b-3f1b21d63d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:56:50.915054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6ce1b-a24f-4d97-9b6b-3f1b21d63d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:50.915553 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6ce1b-a24f-4d97-9b6b-3f1b21d63d91 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:50.927619 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1384/2764] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:56:50.931993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7086f-eb73-41e1-b061-0bc3c979bec5 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:50.942123 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7086f-eb73-41e1-b061-0bc3c979bec5 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:50.946985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe73ca6-0c29-4918-a688-5584facaa6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:50.947664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73ca6-0c29-4918-a688-5584facaa6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:50.947943 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73ca6-0c29-4918-a688-5584facaa6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:50.948242 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe73ca6-0c29-4918-a688-5584facaa6b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:50.948958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe73ca6-0c29-4918-a688-5584facaa6b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:50.950873 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe73ca6-0c29-4918-a688-5584facaa6b9 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:51.047594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1381/2765] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:56:50 2022] POST /identity/v3/projects => generated 409 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:56:51.051640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6ce1b-a24f-4d97-9b6b-3f1b21d63d91 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:51.061555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6ce1b-a24f-4d97-9b6b-3f1b21d63d91 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:51.066973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:51.122070 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d42a3e-d496-4326-a262-a8a11e341e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:51.122746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d42a3e-d496-4326-a262-a8a11e341e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:51.123032 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d42a3e-d496-4326-a262-a8a11e341e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:51.123310 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d42a3e-d496-4326-a262-a8a11e341e50 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:51.124009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d42a3e-d496-4326-a262-a8a11e341e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:51.126008 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d42a3e-d496-4326-a262-a8a11e341e50 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:51.331722 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1385/2766] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:56:51 2022] POST /identity/v3/users => generated 305 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:56:51.335914 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe73ca6-0c29-4918-a688-5584facaa6b9 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:51.347381 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe73ca6-0c29-4918-a688-5584facaa6b9 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:51.351916 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e22b1-7d9b-448c-94cb-afee0620fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:51.353261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e22b1-7d9b-448c-94cb-afee0620fb8d admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:51.353261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e22b1-7d9b-448c-94cb-afee0620fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:51.353261 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e22b1-7d9b-448c-94cb-afee0620fb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:51.353818 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e22b1-7d9b-448c-94cb-afee0620fb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:51.355464 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20e22b1-7d9b-448c-94cb-afee0620fb8d admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:51.368893 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1382/2767] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:56:51.373763 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d42a3e-d496-4326-a262-a8a11e341e50 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:51.384355 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d42a3e-d496-4326-a262-a8a11e341e50 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:51.388954 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21845a46-2581-4d59-afa8-3e3270c8d5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:51.389615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21845a46-2581-4d59-afa8-3e3270c8d5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:51.389952 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21845a46-2581-4d59-afa8-3e3270c8d5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:51.390278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21845a46-2581-4d59-afa8-3e3270c8d5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:51.391038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21845a46-2581-4d59-afa8-3e3270c8d5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:51.392632 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21845a46-2581-4d59-afa8-3e3270c8d5c4 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:51.402632 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1386/2768] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:56:51.407191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e22b1-7d9b-448c-94cb-afee0620fb8d admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:51.417000 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e22b1-7d9b-448c-94cb-afee0620fb8d admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:51.422191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc8a5c-0642-4a6e-ad58-bcd3599e1ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:51.423062 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc8a5c-0642-4a6e-ad58-bcd3599e1ea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:51.423342 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc8a5c-0642-4a6e-ad58-bcd3599e1ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:51.423615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc8a5c-0642-4a6e-ad58-bcd3599e1ea4 admin admin] PATH_INFO: `/v3/projects/f18b2e5c58224ff8af7ed3b1d991cdbd/users/b76b6783a69c4080a1b8146091cd8770/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:51.437828 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc8a5c-0642-4a6e-ad58-bcd3599e1ea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18b2e5c58224ff8af7ed3b1d991cdbd, user_id=b76b6783a69c4080a1b8146091cd8770, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:51.440445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc8a5c-0642-4a6e-ad58-bcd3599e1ea4 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:51.519915 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1383/2769] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:56:51 2022] PUT /identity/v3/projects/f18b2e5c58224ff8af7ed3b1d991cdbd/users/b76b6783a69c4080a1b8146091cd8770/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:56:51.531742 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e8e61-d5e2-465f-a3be-004f2ef6ba76 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:51.535919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e8e61-d5e2-465f-a3be-004f2ef6ba76 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:51.535919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e8e61-d5e2-465f-a3be-004f2ef6ba76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:51.558709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-482e8e61-d5e2-465f-a3be-004f2ef6ba76 None None] MFA Rules not processed for user `b76b6783a69c4080a1b8146091cd8770`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:56:51.559999 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-482e8e61-d5e2-465f-a3be-004f2ef6ba76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:51.624914 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1387/2770] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:56:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:56:51.629336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc8a5c-0642-4a6e-ad58-bcd3599e1ea4 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:51.697076 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc8a5c-0642-4a6e-ad58-bcd3599e1ea4 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:51.701689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b05df4-93c1-4b44-935b-856a734d641b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:51.702384 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b05df4-93c1-4b44-935b-856a734d641b admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:51.703235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b05df4-93c1-4b44-935b-856a734d641b admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:51.703513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b05df4-93c1-4b44-935b-856a734d641b admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:51.704245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b05df4-93c1-4b44-935b-856a734d641b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:51.706166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b05df4-93c1-4b44-935b-856a734d641b admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:51.812612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1384/2771] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:56:51 2022] POST /identity/v3/projects => generated 409 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:56:51.816739 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e8e61-d5e2-465f-a3be-004f2ef6ba76 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:51.827319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e8e61-d5e2-465f-a3be-004f2ef6ba76 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:51.882986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30afc6-0569-4b7a-b8dc-54c520592283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:51.883583 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30afc6-0569-4b7a-b8dc-54c520592283 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:51.884166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30afc6-0569-4b7a-b8dc-54c520592283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:51.884442 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30afc6-0569-4b7a-b8dc-54c520592283 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:51.885130 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30afc6-0569-4b7a-b8dc-54c520592283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:51.887170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30afc6-0569-4b7a-b8dc-54c520592283 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:52.000755 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1388/2772] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:56:51 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:56:52.010703 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b05df4-93c1-4b44-935b-856a734d641b admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:52.021608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b05df4-93c1-4b44-935b-856a734d641b admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:52.026252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dc34b-e7a9-46c9-90d2-24e75213a4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:52.026936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc34b-e7a9-46c9-90d2-24e75213a4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:52.027223 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc34b-e7a9-46c9-90d2-24e75213a4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:52.027501 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc34b-e7a9-46c9-90d2-24e75213a4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:52.028231 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dc34b-e7a9-46c9-90d2-24e75213a4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:52.029841 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79dc34b-e7a9-46c9-90d2-24e75213a4b1 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:52.040100 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1385/2773] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:56:52.044124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30afc6-0569-4b7a-b8dc-54c520592283 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:52.053938 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30afc6-0569-4b7a-b8dc-54c520592283 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:52.058506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36af3b7-775f-4472-917c-8b87e2ca0888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:52.059381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36af3b7-775f-4472-917c-8b87e2ca0888 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:52.059667 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36af3b7-775f-4472-917c-8b87e2ca0888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:52.059946 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36af3b7-775f-4472-917c-8b87e2ca0888 admin admin] PATH_INFO: `/v3/projects/2ded0403f91944748d83a7d4aebff5c3/users/467fa906ece145198687f1dfb21e3b7e/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:52.062732 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:52.081083 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36af3b7-775f-4472-917c-8b87e2ca0888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ded0403f91944748d83a7d4aebff5c3, user_id=467fa906ece145198687f1dfb21e3b7e, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:52.083942 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36af3b7-775f-4472-917c-8b87e2ca0888 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:52.159613 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1389/2774] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:56:52 2022] PUT /identity/v3/projects/2ded0403f91944748d83a7d4aebff5c3/users/467fa906ece145198687f1dfb21e3b7e/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:56:52.163500 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dc34b-e7a9-46c9-90d2-24e75213a4b1 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:52.174661 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dc34b-e7a9-46c9-90d2-24e75213a4b1 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:52.194840 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:52.230429 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2955955-7193-483a-81b0-f77625b71b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:52.231100 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2955955-7193-483a-81b0-f77625b71b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:52.231528 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2955955-7193-483a-81b0-f77625b71b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:52.231929 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2955955-7193-483a-81b0-f77625b71b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:52.232662 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2955955-7193-483a-81b0-f77625b71b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:52.235161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2955955-7193-483a-81b0-f77625b71b17 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:52.245319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1386/2775] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:56:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:56:52.250380 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36af3b7-775f-4472-917c-8b87e2ca0888 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:52.260951 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36af3b7-775f-4472-917c-8b87e2ca0888 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:52.265756 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610484f3-ef74-4f4a-8c26-894c37f2cc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:52.270839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610484f3-ef74-4f4a-8c26-894c37f2cc1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:52.270839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610484f3-ef74-4f4a-8c26-894c37f2cc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:52.270839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610484f3-ef74-4f4a-8c26-894c37f2cc1f admin admin] PATH_INFO: `/v3/projects/2ded0403f91944748d83a7d4aebff5c3/users/467fa906ece145198687f1dfb21e3b7e/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:52.270839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610484f3-ef74-4f4a-8c26-894c37f2cc1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ded0403f91944748d83a7d4aebff5c3, user_id=467fa906ece145198687f1dfb21e3b7e, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:52.271931 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610484f3-ef74-4f4a-8c26-894c37f2cc1f admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:52.282871 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1390/2776] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:56:52 2022] PUT /identity/v3/projects/2ded0403f91944748d83a7d4aebff5c3/users/467fa906ece145198687f1dfb21e3b7e/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:56:52.292985 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b49e8-8b15-4fc0-89b0-814b2e09b709 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:52.293280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b49e8-8b15-4fc0-89b0-814b2e09b709 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:52.293571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b49e8-8b15-4fc0-89b0-814b2e09b709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:52.321575 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ff6b49e8-8b15-4fc0-89b0-814b2e09b709 None None] MFA Rules not processed for user `467fa906ece145198687f1dfb21e3b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:56:52.322825 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ff6b49e8-8b15-4fc0-89b0-814b2e09b709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:52.390119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1387/2777] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:56:52 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:56:52.400677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610484f3-ef74-4f4a-8c26-894c37f2cc1f admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:52.402345 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-610484f3-ef74-4f4a-8c26-894c37f2cc1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:56:52.457969 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610484f3-ef74-4f4a-8c26-894c37f2cc1f admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:52.461529 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e91c3-c25f-49c7-8d44-2fb40ea869f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:52.462195 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e91c3-c25f-49c7-8d44-2fb40ea869f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:52.462474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e91c3-c25f-49c7-8d44-2fb40ea869f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:52.462746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e91c3-c25f-49c7-8d44-2fb40ea869f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:52.471665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e91c3-c25f-49c7-8d44-2fb40ea869f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:52.473080 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e91c3-c25f-49c7-8d44-2fb40ea869f4 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:52.482255 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1391/2778] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:56:52 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:56:52.787269 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b49e8-8b15-4fc0-89b0-814b2e09b709 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:52.797731 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b49e8-8b15-4fc0-89b0-814b2e09b709 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:52.801327 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5ee5a4-7f7f-40ea-9a0a-986cdbab06c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:52.801995 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ee5a4-7f7f-40ea-9a0a-986cdbab06c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:52.802280 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ee5a4-7f7f-40ea-9a0a-986cdbab06c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:52.802559 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5ee5a4-7f7f-40ea-9a0a-986cdbab06c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:52.858677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ee5a4-7f7f-40ea-9a0a-986cdbab06c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:52.861006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5ee5a4-7f7f-40ea-9a0a-986cdbab06c3 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:52.869821 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1388/2779] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:56:52 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:56:59.597172 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e91c3-c25f-49c7-8d44-2fb40ea869f4 service cinder] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:56:59.659095 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e91c3-c25f-49c7-8d44-2fb40ea869f4 service cinder] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:56:59.663684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43032901-ab24-427e-8e48-f16770814e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:56:59.664546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43032901-ab24-427e-8e48-f16770814e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:59.664862 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43032901-ab24-427e-8e48-f16770814e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:59.665143 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43032901-ab24-427e-8e48-f16770814e01 admin admin] PATH_INFO: `/v3/users/b76b6783a69c4080a1b8146091cd8770` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:59.666416 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43032901-ab24-427e-8e48-f16770814e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b76b6783a69c4080a1b8146091cd8770)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:56:59.668414 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43032901-ab24-427e-8e48-f16770814e01 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:56:59.847708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-43032901-ab24-427e-8e48-f16770814e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b76b6783a69c4080a1b8146091cd8770'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:59.942301 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-43032901-ab24-427e-8e48-f16770814e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b76b6783a69c4080a1b8146091cd8770'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:59.942949 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-43032901-ab24-427e-8e48-f16770814e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b76b6783a69c4080a1b8146091cd8770'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:59.950696 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-43032901-ab24-427e-8e48-f16770814e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b76b6783a69c4080a1b8146091cd8770'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:59.960107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-43032901-ab24-427e-8e48-f16770814e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b76b6783a69c4080a1b8146091cd8770'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:56:59.960107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:56:59.969066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1392/2780] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:56:59 2022] DELETE /identity/v3/users/b76b6783a69c4080a1b8146091cd8770 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:56:59.974770 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d1129-7054-458e-9f92-2015045852de None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:56:59.975276 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d1129-7054-458e-9f92-2015045852de None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:56:59.975379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d1129-7054-458e-9f92-2015045852de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:56:59.992937 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-6a8d1129-7054-458e-9f92-2015045852de None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:56:59.994174 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6a8d1129-7054-458e-9f92-2015045852de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:00.034169 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=100 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:00.053039 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1389/2781] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:00.063355 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43032901-ab24-427e-8e48-f16770814e01 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:00.064741 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-43032901-ab24-427e-8e48-f16770814e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:00.123937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43032901-ab24-427e-8e48-f16770814e01 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:00.127970 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeacff1-14e5-402f-8dec-d131c55c66c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:00.128625 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeacff1-14e5-402f-8dec-d131c55c66c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:00.128907 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeacff1-14e5-402f-8dec-d131c55c66c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:00.129178 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeacff1-14e5-402f-8dec-d131c55c66c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:00.138376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeacff1-14e5-402f-8dec-d131c55c66c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:00.139797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeacff1-14e5-402f-8dec-d131c55c66c2 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:00.149453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1393/2782] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:57:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:57:00.577984 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d1129-7054-458e-9f92-2015045852de None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:00.579477 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6a8d1129-7054-458e-9f92-2015045852de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:00.594469 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d1129-7054-458e-9f92-2015045852de None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:00.600096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:00.602070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:00.602344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:00.602713 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] PATH_INFO: `/v3/projects/f18b2e5c58224ff8af7ed3b1d991cdbd` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:00.603966 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18b2e5c58224ff8af7ed3b1d991cdbd)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:00.605904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:00.777229 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18b2e5c58224ff8af7ed3b1d991cdbd', 'request_id': 'req-bde99968-d069-472d-9306-f5cfc22b0768'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:00.862317 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18b2e5c58224ff8af7ed3b1d991cdbd', 'request_id': 'req-bde99968-d069-472d-9306-f5cfc22b0768'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:00.868474 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18b2e5c58224ff8af7ed3b1d991cdbd', 'request_id': 'req-bde99968-d069-472d-9306-f5cfc22b0768'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:00.880444 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] The token cache is being invalidate because project f18b2e5c58224ff8af7ed3b1d991cdbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:57:00.880734 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:00.881376 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:00.882972 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1390/2783] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:57:00 2022] DELETE /identity/v3/projects/f18b2e5c58224ff8af7ed3b1d991cdbd => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:00.887195 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeacff1-14e5-402f-8dec-d131c55c66c2 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:00.897517 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeacff1-14e5-402f-8dec-d131c55c66c2 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:00.952521 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e58cce7-3684-4f19-9d34-5c0860b1e78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:00.956315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58cce7-3684-4f19-9d34-5c0860b1e78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:00.956315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58cce7-3684-4f19-9d34-5c0860b1e78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:00.956315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58cce7-3684-4f19-9d34-5c0860b1e78b admin admin] PATH_INFO: `/v3/users/467fa906ece145198687f1dfb21e3b7e` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:00.956315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58cce7-3684-4f19-9d34-5c0860b1e78b admin admin] RBAC: Authorizing `identity:delete_user(user_id=467fa906ece145198687f1dfb21e3b7e)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:00.957858 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e58cce7-3684-4f19-9d34-5c0860b1e78b admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:01.109847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e58cce7-3684-4f19-9d34-5c0860b1e78b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '467fa906ece145198687f1dfb21e3b7e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:01.198305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e58cce7-3684-4f19-9d34-5c0860b1e78b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '467fa906ece145198687f1dfb21e3b7e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:01.198919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e58cce7-3684-4f19-9d34-5c0860b1e78b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '467fa906ece145198687f1dfb21e3b7e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:01.206088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e58cce7-3684-4f19-9d34-5c0860b1e78b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '467fa906ece145198687f1dfb21e3b7e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:01.213671 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-4e58cce7-3684-4f19-9d34-5c0860b1e78b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '467fa906ece145198687f1dfb21e3b7e'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:01.223557 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1394/2784] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:57:00 2022] DELETE /identity/v3/users/467fa906ece145198687f1dfb21e3b7e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:01.606763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:01.608235 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:01.622498 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde99968-d069-472d-9306-f5cfc22b0768 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:01.681849 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aeb106-f57c-434d-8c67-dde50713012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:01.682716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeb106-f57c-434d-8c67-dde50713012c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:01.682997 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeb106-f57c-434d-8c67-dde50713012c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:01.683272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aeb106-f57c-434d-8c67-dde50713012c admin admin] PATH_INFO: `/v3/projects/2ded0403f91944748d83a7d4aebff5c3` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:01.684471 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aeb106-f57c-434d-8c67-dde50713012c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ded0403f91944748d83a7d4aebff5c3)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:01.686414 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aeb106-f57c-434d-8c67-dde50713012c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:01.787869 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f7aeb106-f57c-434d-8c67-dde50713012c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ded0403f91944748d83a7d4aebff5c3', 'request_id': 'req-f7aeb106-f57c-434d-8c67-dde50713012c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:01.861602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f7aeb106-f57c-434d-8c67-dde50713012c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ded0403f91944748d83a7d4aebff5c3', 'request_id': 'req-f7aeb106-f57c-434d-8c67-dde50713012c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:01.868049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f7aeb106-f57c-434d-8c67-dde50713012c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ded0403f91944748d83a7d4aebff5c3', 'request_id': 'req-f7aeb106-f57c-434d-8c67-dde50713012c'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:01.875442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:01.879996 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f7aeb106-f57c-434d-8c67-dde50713012c admin admin] The token cache is being invalidate because project 2ded0403f91944748d83a7d4aebff5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:57:01.880283 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f7aeb106-f57c-434d-8c67-dde50713012c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:01.880918 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-f7aeb106-f57c-434d-8c67-dde50713012c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:01.882537 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1391/2785] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:57:01 2022] DELETE /identity/v3/projects/2ded0403f91944748d83a7d4aebff5c3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:01.887797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93961a87-7682-4780-bb4d-37738d434105 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:01.888296 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93961a87-7682-4780-bb4d-37738d434105 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:01.888396 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93961a87-7682-4780-bb4d-37738d434105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:01.907476 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-93961a87-7682-4780-bb4d-37738d434105 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:01.909408 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-93961a87-7682-4780-bb4d-37738d434105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:01.917899 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:01.968325 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1395/2786] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:01.976833 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debebc-435c-4f12-bc03-dbc116f4bc2c None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:01.977119 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debebc-435c-4f12-bc03-dbc116f4bc2c None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:01.977395 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debebc-435c-4f12-bc03-dbc116f4bc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:01.995114 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-43debebc-435c-4f12-bc03-dbc116f4bc2c None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:01.996311 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-43debebc-435c-4f12-bc03-dbc116f4bc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:02.004366 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1392/2787] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:02.008527 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93961a87-7682-4780-bb4d-37738d434105 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:02.019400 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93961a87-7682-4780-bb4d-37738d434105 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:02.024057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c638f-a8f7-4f9c-9e00-07f4925da366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:02.030352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c638f-a8f7-4f9c-9e00-07f4925da366 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:02.030352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c638f-a8f7-4f9c-9e00-07f4925da366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:02.030352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c638f-a8f7-4f9c-9e00-07f4925da366 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:02.030352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c638f-a8f7-4f9c-9e00-07f4925da366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:57:02.030352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c638f-a8f7-4f9c-9e00-07f4925da366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:02.030352 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c638f-a8f7-4f9c-9e00-07f4925da366 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:02.040763 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1396/2788] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:57:02.044977 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debebc-435c-4f12-bc03-dbc116f4bc2c None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:02.054421 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debebc-435c-4f12-bc03-dbc116f4bc2c None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:02.059434 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f4526-9766-4b5a-a9df-4a25c92acfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:02.064906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f4526-9766-4b5a-a9df-4a25c92acfa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:02.064906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f4526-9766-4b5a-a9df-4a25c92acfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:02.064906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f4526-9766-4b5a-a9df-4a25c92acfa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:02.064906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f4526-9766-4b5a-a9df-4a25c92acfa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:02.064906 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f4526-9766-4b5a-a9df-4a25c92acfa4 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:02.144957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1393/2789] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:57:02 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:57:02.149189 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c638f-a8f7-4f9c-9e00-07f4925da366 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:02.159979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c638f-a8f7-4f9c-9e00-07f4925da366 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:02.215687 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c142e-b0a7-477c-81d1-5a0c110d2a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:02.216425 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c142e-b0a7-477c-81d1-5a0c110d2a2c admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:02.216730 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c142e-b0a7-477c-81d1-5a0c110d2a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:02.217005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c142e-b0a7-477c-81d1-5a0c110d2a2c admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:02.217836 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c142e-b0a7-477c-81d1-5a0c110d2a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:02.219753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c142e-b0a7-477c-81d1-5a0c110d2a2c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:02.336620 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1397/2790] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:57:02 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:57:02.340800 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f4526-9766-4b5a-a9df-4a25c92acfa4 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:02.351716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f4526-9766-4b5a-a9df-4a25c92acfa4 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:02.356364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1641aa-f32c-4f6e-81ae-dcbc5dfa48d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:02.357127 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1641aa-f32c-4f6e-81ae-dcbc5dfa48d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:02.357416 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1641aa-f32c-4f6e-81ae-dcbc5dfa48d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:02.357695 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1641aa-f32c-4f6e-81ae-dcbc5dfa48d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:02.358458 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1641aa-f32c-4f6e-81ae-dcbc5dfa48d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:02.360049 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1641aa-f32c-4f6e-81ae-dcbc5dfa48d9 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:02.370351 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1394/2791] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:57:02.374381 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c142e-b0a7-477c-81d1-5a0c110d2a2c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:02.385036 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c142e-b0a7-477c-81d1-5a0c110d2a2c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:02.389633 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f0cbd-0b6f-463d-bf38-696412ed31d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:02.390328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f0cbd-0b6f-463d-bf38-696412ed31d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:02.390640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f0cbd-0b6f-463d-bf38-696412ed31d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:02.390922 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f0cbd-0b6f-463d-bf38-696412ed31d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:02.391651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f0cbd-0b6f-463d-bf38-696412ed31d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:02.393887 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f0cbd-0b6f-463d-bf38-696412ed31d9 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:02.403846 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1398/2792] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:57:02.407846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1641aa-f32c-4f6e-81ae-dcbc5dfa48d9 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:02.417743 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1641aa-f32c-4f6e-81ae-dcbc5dfa48d9 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:02.422375 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02965210-8a08-475b-9188-75aa5cd61d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:02.423245 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02965210-8a08-475b-9188-75aa5cd61d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:02.423531 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02965210-8a08-475b-9188-75aa5cd61d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:02.423811 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02965210-8a08-475b-9188-75aa5cd61d45 admin admin] PATH_INFO: `/v3/projects/df7cc87b9e11444ea776ca6f5545e668/users/06b9a94724b445b2bcb7de22e45f04c5/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:02.437922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02965210-8a08-475b-9188-75aa5cd61d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df7cc87b9e11444ea776ca6f5545e668, user_id=06b9a94724b445b2bcb7de22e45f04c5, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:02.441088 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02965210-8a08-475b-9188-75aa5cd61d45 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:02.508752 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1395/2793] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:57:02 2022] PUT /identity/v3/projects/df7cc87b9e11444ea776ca6f5545e668/users/06b9a94724b445b2bcb7de22e45f04c5/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:57:02.573588 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44684e-9e92-4785-b0bf-04456f30fb78 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:02.573918 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44684e-9e92-4785-b0bf-04456f30fb78 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:02.574199 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44684e-9e92-4785-b0bf-04456f30fb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:02.604074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-eb44684e-9e92-4785-b0bf-04456f30fb78 None None] MFA Rules not processed for user `06b9a94724b445b2bcb7de22e45f04c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:02.605276 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-eb44684e-9e92-4785-b0bf-04456f30fb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:02.669043 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1399/2794] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:57:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:02.673496 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02965210-8a08-475b-9188-75aa5cd61d45 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:02.733670 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02965210-8a08-475b-9188-75aa5cd61d45 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:02.738838 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8778a-aa19-45f5-abce-d23264800ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:02.739515 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8778a-aa19-45f5-abce-d23264800ccb admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:02.739801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8778a-aa19-45f5-abce-d23264800ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:02.740078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a8778a-aa19-45f5-abce-d23264800ccb admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:02.740771 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8778a-aa19-45f5-abce-d23264800ccb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:02.742694 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a8778a-aa19-45f5-abce-d23264800ccb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:02.847084 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1396/2795] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:57:02 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:57:02.851879 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44684e-9e92-4785-b0bf-04456f30fb78 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:02.863742 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44684e-9e92-4785-b0bf-04456f30fb78 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:02.868356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:02.920611 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e652f-f96e-421a-a630-9b60bae3bd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:02.921222 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e652f-f96e-421a-a630-9b60bae3bd03 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:02.921506 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e652f-f96e-421a-a630-9b60bae3bd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:02.921816 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e652f-f96e-421a-a630-9b60bae3bd03 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:02.922505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e652f-f96e-421a-a630-9b60bae3bd03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:02.925046 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e652f-f96e-421a-a630-9b60bae3bd03 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:03.010967 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1400/2796] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:57:02 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:57:03.015022 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8778a-aa19-45f5-abce-d23264800ccb admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:03.025348 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a8778a-aa19-45f5-abce-d23264800ccb admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:03.030073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb045e6-85e6-4ea5-8f95-16f6e72f05cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:03.030742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb045e6-85e6-4ea5-8f95-16f6e72f05cd admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:03.031030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb045e6-85e6-4ea5-8f95-16f6e72f05cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:03.031316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb045e6-85e6-4ea5-8f95-16f6e72f05cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:03.032111 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb045e6-85e6-4ea5-8f95-16f6e72f05cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:03.034272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb045e6-85e6-4ea5-8f95-16f6e72f05cd admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:03.044754 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1397/2797] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:57:03.048905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e652f-f96e-421a-a630-9b60bae3bd03 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:03.059291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e652f-f96e-421a-a630-9b60bae3bd03 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:03.064510 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee2840-1b8e-44da-b29d-d691363e2d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:03.065416 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee2840-1b8e-44da-b29d-d691363e2d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:03.065745 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee2840-1b8e-44da-b29d-d691363e2d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:03.066107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee2840-1b8e-44da-b29d-d691363e2d89 admin admin] PATH_INFO: `/v3/projects/34d59ce476eb4a0b8d01898afc89c5ce/users/86f4d8b6221143cb8b87653b1a9e61b3/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:03.081057 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee2840-1b8e-44da-b29d-d691363e2d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d59ce476eb4a0b8d01898afc89c5ce, user_id=86f4d8b6221143cb8b87653b1a9e61b3, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:03.083746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee2840-1b8e-44da-b29d-d691363e2d89 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:03.154163 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1401/2798] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:57:03 2022] PUT /identity/v3/projects/34d59ce476eb4a0b8d01898afc89c5ce/users/86f4d8b6221143cb8b87653b1a9e61b3/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:03.158325 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb045e6-85e6-4ea5-8f95-16f6e72f05cd admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:03.169018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb045e6-85e6-4ea5-8f95-16f6e72f05cd admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:03.224241 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61f967-8286-41eb-b1b9-bc6553c24a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:03.224831 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61f967-8286-41eb-b1b9-bc6553c24a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:03.225197 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61f967-8286-41eb-b1b9-bc6553c24a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:03.225476 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61f967-8286-41eb-b1b9-bc6553c24a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:03.226231 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61f967-8286-41eb-b1b9-bc6553c24a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:03.227819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61f967-8286-41eb-b1b9-bc6553c24a08 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:03.237845 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1398/2799] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:57:03.242185 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee2840-1b8e-44da-b29d-d691363e2d89 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:03.252266 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee2840-1b8e-44da-b29d-d691363e2d89 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:03.257039 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62136868-e4a2-4822-a94e-7b6902ea1532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:03.257974 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62136868-e4a2-4822-a94e-7b6902ea1532 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:03.258256 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62136868-e4a2-4822-a94e-7b6902ea1532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:03.258532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62136868-e4a2-4822-a94e-7b6902ea1532 admin admin] PATH_INFO: `/v3/projects/34d59ce476eb4a0b8d01898afc89c5ce/users/86f4d8b6221143cb8b87653b1a9e61b3/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:03.260797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62136868-e4a2-4822-a94e-7b6902ea1532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34d59ce476eb4a0b8d01898afc89c5ce, user_id=86f4d8b6221143cb8b87653b1a9e61b3, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:03.263452 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62136868-e4a2-4822-a94e-7b6902ea1532 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:03.273486 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1402/2800] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:57:03 2022] PUT /identity/v3/projects/34d59ce476eb4a0b8d01898afc89c5ce/users/86f4d8b6221143cb8b87653b1a9e61b3/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:03.283323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f733eb-c22b-483f-8d75-aad7e4977370 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:03.284171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f733eb-c22b-483f-8d75-aad7e4977370 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:03.284602 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f733eb-c22b-483f-8d75-aad7e4977370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:03.291251 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:03.310821 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-65f733eb-c22b-483f-8d75-aad7e4977370 None None] MFA Rules not processed for user `86f4d8b6221143cb8b87653b1a9e61b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:03.312032 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-65f733eb-c22b-483f-8d75-aad7e4977370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:03.378770 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1399/2801] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:57:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:03.389699 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62136868-e4a2-4822-a94e-7b6902ea1532 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:03.391397 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-62136868-e4a2-4822-a94e-7b6902ea1532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:03.447376 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62136868-e4a2-4822-a94e-7b6902ea1532 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:03.451007 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e3b3f-a5ed-4e0c-a4fc-34291d4697d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:03.451643 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e3b3f-a5ed-4e0c-a4fc-34291d4697d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:03.451929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e3b3f-a5ed-4e0c-a4fc-34291d4697d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:03.452206 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e3b3f-a5ed-4e0c-a4fc-34291d4697d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:03.463053 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e3b3f-a5ed-4e0c-a4fc-34291d4697d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:03.464505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e3b3f-a5ed-4e0c-a4fc-34291d4697d2 service cinder] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:03.474947 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1403/2802] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:57:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:57:04.020763 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f733eb-c22b-483f-8d75-aad7e4977370 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:04.082571 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f733eb-c22b-483f-8d75-aad7e4977370 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:04.087565 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20f353-3c0d-4cbb-91eb-811919c38b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:04.088463 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20f353-3c0d-4cbb-91eb-811919c38b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:04.088738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20f353-3c0d-4cbb-91eb-811919c38b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:04.089010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20f353-3c0d-4cbb-91eb-811919c38b09 admin admin] PATH_INFO: `/v3/users/06b9a94724b445b2bcb7de22e45f04c5` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:04.090226 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20f353-3c0d-4cbb-91eb-811919c38b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06b9a94724b445b2bcb7de22e45f04c5)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:04.092133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20f353-3c0d-4cbb-91eb-811919c38b09 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:04.217741 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5b20f353-3c0d-4cbb-91eb-811919c38b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06b9a94724b445b2bcb7de22e45f04c5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:04.218394 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5b20f353-3c0d-4cbb-91eb-811919c38b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06b9a94724b445b2bcb7de22e45f04c5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:04.219002 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5b20f353-3c0d-4cbb-91eb-811919c38b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06b9a94724b445b2bcb7de22e45f04c5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:04.230816 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5b20f353-3c0d-4cbb-91eb-811919c38b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06b9a94724b445b2bcb7de22e45f04c5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:04.238161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-5b20f353-3c0d-4cbb-91eb-811919c38b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06b9a94724b445b2bcb7de22e45f04c5'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:04.295990 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1400/2803] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:57:04 2022] DELETE /identity/v3/users/06b9a94724b445b2bcb7de22e45f04c5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:04.301022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabe13e-b4d6-419e-b0cf-6c700bc0680f None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:04.303165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabe13e-b4d6-419e-b0cf-6c700bc0680f None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:04.303165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabe13e-b4d6-419e-b0cf-6c700bc0680f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:04.319825 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-bfabe13e-b4d6-419e-b0cf-6c700bc0680f None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:04.321027 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bfabe13e-b4d6-419e-b0cf-6c700bc0680f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:04.378973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1404/2804] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:04.388834 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20f353-3c0d-4cbb-91eb-811919c38b09 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:04.390264 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5b20f353-3c0d-4cbb-91eb-811919c38b09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:04.401302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:04.447154 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20f353-3c0d-4cbb-91eb-811919c38b09 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:04.450789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3f62a-f549-49f5-8816-6a2e6ea78010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:04.451433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3f62a-f549-49f5-8816-6a2e6ea78010 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:04.451717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3f62a-f549-49f5-8816-6a2e6ea78010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:04.451988 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3f62a-f549-49f5-8816-6a2e6ea78010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:04.460861 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3f62a-f549-49f5-8816-6a2e6ea78010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:04.462333 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3f62a-f549-49f5-8816-6a2e6ea78010 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:04.472146 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1401/2805] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:57:04.892319 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabe13e-b4d6-419e-b0cf-6c700bc0680f None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:04.894465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-bfabe13e-b4d6-419e-b0cf-6c700bc0680f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:04.903207 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:04.911750 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabe13e-b4d6-419e-b0cf-6c700bc0680f None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:04.916496 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:04.917366 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:04.917653 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:04.918043 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] PATH_INFO: `/v3/projects/df7cc87b9e11444ea776ca6f5545e668` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:04.922217 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df7cc87b9e11444ea776ca6f5545e668)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:04.922217 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:05.039072 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df7cc87b9e11444ea776ca6f5545e668', 'request_id': 'req-b06799a6-2253-4830-8c1d-f6a119ba4836'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:05.096132 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df7cc87b9e11444ea776ca6f5545e668', 'request_id': 'req-b06799a6-2253-4830-8c1d-f6a119ba4836'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:05.103789 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df7cc87b9e11444ea776ca6f5545e668', 'request_id': 'req-b06799a6-2253-4830-8c1d-f6a119ba4836'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:05.115083 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] The token cache is being invalidate because project df7cc87b9e11444ea776ca6f5545e668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:57:05.115374 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:05.116020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:05.117597 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1405/2806] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:57:04 2022] DELETE /identity/v3/projects/df7cc87b9e11444ea776ca6f5545e668 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:05.121649 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3f62a-f549-49f5-8816-6a2e6ea78010 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:05.132641 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3f62a-f549-49f5-8816-6a2e6ea78010 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:05.189949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e8c28-b750-46f4-b37d-4c62b76a71a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:05.191448 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e8c28-b750-46f4-b37d-4c62b76a71a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:05.191729 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e8c28-b750-46f4-b37d-4c62b76a71a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:05.192005 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e8c28-b750-46f4-b37d-4c62b76a71a3 admin admin] PATH_INFO: `/v3/users/86f4d8b6221143cb8b87653b1a9e61b3` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:05.193207 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e8c28-b750-46f4-b37d-4c62b76a71a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86f4d8b6221143cb8b87653b1a9e61b3)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:05.195151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e8c28-b750-46f4-b37d-4c62b76a71a3 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:05.378526 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-459e8c28-b750-46f4-b37d-4c62b76a71a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86f4d8b6221143cb8b87653b1a9e61b3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:05.379300 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-459e8c28-b750-46f4-b37d-4c62b76a71a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86f4d8b6221143cb8b87653b1a9e61b3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:05.379936 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-459e8c28-b750-46f4-b37d-4c62b76a71a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86f4d8b6221143cb8b87653b1a9e61b3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:05.391824 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-459e8c28-b750-46f4-b37d-4c62b76a71a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86f4d8b6221143cb8b87653b1a9e61b3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:05.398904 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-459e8c28-b750-46f4-b37d-4c62b76a71a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86f4d8b6221143cb8b87653b1a9e61b3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:05.474298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1402/2807] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:57:05 2022] DELETE /identity/v3/users/86f4d8b6221143cb8b87653b1a9e61b3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:05.841170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:05.844218 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:05.857119 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06799a6-2253-4830-8c1d-f6a119ba4836 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:05.917817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe428f91-8ef2-47b1-903b-375777cfc3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:05.918683 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe428f91-8ef2-47b1-903b-375777cfc3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:05.918960 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe428f91-8ef2-47b1-903b-375777cfc3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:05.919232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe428f91-8ef2-47b1-903b-375777cfc3da admin admin] PATH_INFO: `/v3/projects/34d59ce476eb4a0b8d01898afc89c5ce` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:05.920401 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe428f91-8ef2-47b1-903b-375777cfc3da admin admin] RBAC: Authorizing `identity:delete_project(project_id=34d59ce476eb4a0b8d01898afc89c5ce)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:05.922332 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe428f91-8ef2-47b1-903b-375777cfc3da admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:06.034315 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe428f91-8ef2-47b1-903b-375777cfc3da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34d59ce476eb4a0b8d01898afc89c5ce', 'request_id': 'req-fe428f91-8ef2-47b1-903b-375777cfc3da'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:06.102022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe428f91-8ef2-47b1-903b-375777cfc3da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34d59ce476eb4a0b8d01898afc89c5ce', 'request_id': 'req-fe428f91-8ef2-47b1-903b-375777cfc3da'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:06.108811 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe428f91-8ef2-47b1-903b-375777cfc3da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34d59ce476eb4a0b8d01898afc89c5ce', 'request_id': 'req-fe428f91-8ef2-47b1-903b-375777cfc3da'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:06.119247 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe428f91-8ef2-47b1-903b-375777cfc3da admin admin] The token cache is being invalidate because project 34d59ce476eb4a0b8d01898afc89c5ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:57:06.119538 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe428f91-8ef2-47b1-903b-375777cfc3da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:06.120170 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe428f91-8ef2-47b1-903b-375777cfc3da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:06.121711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1406/2808] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:57:05 2022] DELETE /identity/v3/projects/34d59ce476eb4a0b8d01898afc89c5ce => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:06.126738 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f2e27-2ebe-4c88-b773-f4317d94c737 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:06.127189 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f2e27-2ebe-4c88-b773-f4317d94c737 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:06.127284 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f2e27-2ebe-4c88-b773-f4317d94c737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:06.146118 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-3a7f2e27-2ebe-4c88-b773-f4317d94c737 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:06.147322 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-3a7f2e27-2ebe-4c88-b773-f4317d94c737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:06.173412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:06.205353 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1403/2809] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:06.214675 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4538-74b2-4253-9a11-ab4c9dc67583 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:06.215014 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4538-74b2-4253-9a11-ab4c9dc67583 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:06.215298 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d4538-74b2-4253-9a11-ab4c9dc67583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:06.233066 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-429d4538-74b2-4253-9a11-ab4c9dc67583 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:06.234311 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-429d4538-74b2-4253-9a11-ab4c9dc67583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:06.242453 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1407/2810] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:57:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:06.246629 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f2e27-2ebe-4c88-b773-f4317d94c737 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:06.256964 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f2e27-2ebe-4c88-b773-f4317d94c737 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:06.262124 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b30a20-7a35-40d8-8e62-f3880201e402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:06.263086 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b30a20-7a35-40d8-8e62-f3880201e402 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:06.263371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b30a20-7a35-40d8-8e62-f3880201e402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:06.263650 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b30a20-7a35-40d8-8e62-f3880201e402 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:06.264382 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b30a20-7a35-40d8-8e62-f3880201e402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:57:06.264696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b30a20-7a35-40d8-8e62-f3880201e402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:06.266323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b30a20-7a35-40d8-8e62-f3880201e402 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:06.278942 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1404/2811] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:57:06.283293 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d4538-74b2-4253-9a11-ab4c9dc67583 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:06.292443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d4538-74b2-4253-9a11-ab4c9dc67583 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:06.296973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa77d-f996-4cae-a621-db0d31327172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:06.297623 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa77d-f996-4cae-a621-db0d31327172 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:06.297935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa77d-f996-4cae-a621-db0d31327172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:06.298210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aa77d-f996-4cae-a621-db0d31327172 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:06.298895 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aa77d-f996-4cae-a621-db0d31327172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:06.300834 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aa77d-f996-4cae-a621-db0d31327172 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:06.308583 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:06.377210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1408/2812] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:57:06 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:57:06.384249 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b30a20-7a35-40d8-8e62-f3880201e402 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:06.394198 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b30a20-7a35-40d8-8e62-f3880201e402 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:06.448690 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d74f58-acf4-4982-a02a-5736566bce0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:06.449388 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d74f58-acf4-4982-a02a-5736566bce0c admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:06.449673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d74f58-acf4-4982-a02a-5736566bce0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:06.449981 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d74f58-acf4-4982-a02a-5736566bce0c admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:06.450679 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d74f58-acf4-4982-a02a-5736566bce0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:06.452618 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d74f58-acf4-4982-a02a-5736566bce0c admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:06.508030 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1405/2813] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:57:06 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:57:06.512579 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa77d-f996-4cae-a621-db0d31327172 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:06.523196 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aa77d-f996-4cae-a621-db0d31327172 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:06.527901 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1de3a9-5f38-4429-9fb0-d4528c5bd7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:06.528546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1de3a9-5f38-4429-9fb0-d4528c5bd7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:06.528832 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1de3a9-5f38-4429-9fb0-d4528c5bd7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:06.529112 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1de3a9-5f38-4429-9fb0-d4528c5bd7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:06.529882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1de3a9-5f38-4429-9fb0-d4528c5bd7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:06.531511 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1de3a9-5f38-4429-9fb0-d4528c5bd7d8 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:06.541458 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1409/2814] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:57:06.545260 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d74f58-acf4-4982-a02a-5736566bce0c admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:06.555854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d74f58-acf4-4982-a02a-5736566bce0c admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:06.560489 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95c648-271e-4e0d-a940-02b92711f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:06.562191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95c648-271e-4e0d-a940-02b92711f219 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:06.562191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95c648-271e-4e0d-a940-02b92711f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:06.562191 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95c648-271e-4e0d-a940-02b92711f219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:06.562490 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95c648-271e-4e0d-a940-02b92711f219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:06.564031 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef95c648-271e-4e0d-a940-02b92711f219 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:06.574640 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1406/2815] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:57:06.578791 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1de3a9-5f38-4429-9fb0-d4528c5bd7d8 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:06.588850 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1de3a9-5f38-4429-9fb0-d4528c5bd7d8 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:06.593530 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da8c35-cd75-45b2-9842-a5eda2cecbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:06.594452 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da8c35-cd75-45b2-9842-a5eda2cecbc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:06.594788 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da8c35-cd75-45b2-9842-a5eda2cecbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:06.595071 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da8c35-cd75-45b2-9842-a5eda2cecbc2 admin admin] PATH_INFO: `/v3/projects/0e8d2285c2b24676be73c99ef03ab9fd/users/7c8d8246f9fd4d9598eb991d3d9bb1f3/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:06.649206 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da8c35-cd75-45b2-9842-a5eda2cecbc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8d2285c2b24676be73c99ef03ab9fd, user_id=7c8d8246f9fd4d9598eb991d3d9bb1f3, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:06.651896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da8c35-cd75-45b2-9842-a5eda2cecbc2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:06.748867 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1410/2816] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:57:06 2022] PUT /identity/v3/projects/0e8d2285c2b24676be73c99ef03ab9fd/users/7c8d8246f9fd4d9598eb991d3d9bb1f3/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:57:06.760885 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d15f1-fa34-45e3-9ab0-0c7517427083 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:06.762616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d15f1-fa34-45e3-9ab0-0c7517427083 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:06.762616 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d15f1-fa34-45e3-9ab0-0c7517427083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:06.787911 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-879d15f1-fa34-45e3-9ab0-0c7517427083 None None] MFA Rules not processed for user `7c8d8246f9fd4d9598eb991d3d9bb1f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:06.789116 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-879d15f1-fa34-45e3-9ab0-0c7517427083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:06.852343 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1407/2817] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:57:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:06.864075 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da8c35-cd75-45b2-9842-a5eda2cecbc2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:06.865961 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-33da8c35-cd75-45b2-9842-a5eda2cecbc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:06.922712 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da8c35-cd75-45b2-9842-a5eda2cecbc2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:06.927152 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556c7f2-1bda-408d-9e9b-e543ce01cb69 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669a11ce83b746eeb7f4e7d0acca4b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:06.927799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556c7f2-1bda-408d-9e9b-e543ce01cb69 service glance] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:06.928088 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556c7f2-1bda-408d-9e9b-e543ce01cb69 service glance] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:06.928368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556c7f2-1bda-408d-9e9b-e543ce01cb69 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:06.936576 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556c7f2-1bda-408d-9e9b-e543ce01cb69 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:06.938041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556c7f2-1bda-408d-9e9b-e543ce01cb69 service glance] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:06.947082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1411/2818] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:57:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:57:16.849232 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:16.943132 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:20.022493 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d15f1-fa34-45e3-9ab0-0c7517427083 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:20.023876 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-879d15f1-fa34-45e3-9ab0-0c7517427083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:20.100126 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d15f1-fa34-45e3-9ab0-0c7517427083 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:20.105661 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cb8a2-20d3-41d3-9643-b7766a5a45f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:20.106346 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cb8a2-20d3-41d3-9643-b7766a5a45f7 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:20.106626 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cb8a2-20d3-41d3-9643-b7766a5a45f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:20.106905 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cb8a2-20d3-41d3-9643-b7766a5a45f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:20.108689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8d0cb8a2-20d3-41d3-9643-b7766a5a45f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:20.166746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cb8a2-20d3-41d3-9643-b7766a5a45f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:20.168319 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cb8a2-20d3-41d3-9643-b7766a5a45f7 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:20.177202 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1408/2819] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:57:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:57:21.774989 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556c7f2-1bda-408d-9e9b-e543ce01cb69 service glance] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:21.776818 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-7556c7f2-1bda-408d-9e9b-e543ce01cb69 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:21.837062 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556c7f2-1bda-408d-9e9b-e543ce01cb69 service glance] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:21.840772 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3a9dc-a558-4506-bfd3-af4b1ed50a65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:21.841431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3a9dc-a558-4506-bfd3-af4b1ed50a65 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:21.841715 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3a9dc-a558-4506-bfd3-af4b1ed50a65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:21.842020 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3a9dc-a558-4506-bfd3-af4b1ed50a65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:21.843799 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-a3c3a9dc-a558-4506-bfd3-af4b1ed50a65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:21.859625 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3a9dc-a558-4506-bfd3-af4b1ed50a65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:21.861266 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3a9dc-a558-4506-bfd3-af4b1ed50a65 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:21.876121 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1412/2820] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:57:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:57:21.967046 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cb8a2-20d3-41d3-9643-b7766a5a45f7 service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:22.038632 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cb8a2-20d3-41d3-9643-b7766a5a45f7 service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:22.044004 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77d295-3832-441c-96cf-dedd5a4df06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:22.045006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77d295-3832-441c-96cf-dedd5a4df06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:22.045299 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77d295-3832-441c-96cf-dedd5a4df06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:22.045581 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77d295-3832-441c-96cf-dedd5a4df06e admin admin] PATH_INFO: `/v3/users/7c8d8246f9fd4d9598eb991d3d9bb1f3` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:22.047100 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77d295-3832-441c-96cf-dedd5a4df06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c8d8246f9fd4d9598eb991d3d9bb1f3)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:22.049112 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77d295-3832-441c-96cf-dedd5a4df06e admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:22.213923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:22.220223 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6c77d295-3832-441c-96cf-dedd5a4df06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c8d8246f9fd4d9598eb991d3d9bb1f3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:22.220886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6c77d295-3832-441c-96cf-dedd5a4df06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c8d8246f9fd4d9598eb991d3d9bb1f3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:22.221495 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6c77d295-3832-441c-96cf-dedd5a4df06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c8d8246f9fd4d9598eb991d3d9bb1f3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:22.234234 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6c77d295-3832-441c-96cf-dedd5a4df06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c8d8246f9fd4d9598eb991d3d9bb1f3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:22.244496 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6c77d295-3832-441c-96cf-dedd5a4df06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c8d8246f9fd4d9598eb991d3d9bb1f3'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:22.318983 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1409/2821] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:57:21 2022] DELETE /identity/v3/users/7c8d8246f9fd4d9598eb991d3d9bb1f3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:22.323911 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ff982-f13f-44c0-a98e-3946115222d4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:22.324197 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ff982-f13f-44c0-a98e-3946115222d4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:22.324473 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ff982-f13f-44c0-a98e-3946115222d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:22.341679 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-900ff982-f13f-44c0-a98e-3946115222d4 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:22.342935 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-900ff982-f13f-44c0-a98e-3946115222d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:22.401303 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1413/2822] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:57:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:22.410739 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77d295-3832-441c-96cf-dedd5a4df06e admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:22.412165 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6c77d295-3832-441c-96cf-dedd5a4df06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:22.471465 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77d295-3832-441c-96cf-dedd5a4df06e admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:22.475231 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcd053-51b7-4486-b6ff-65bae33a920e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:22.475949 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcd053-51b7-4486-b6ff-65bae33a920e service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:22.476233 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcd053-51b7-4486-b6ff-65bae33a920e service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:22.476508 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcd053-51b7-4486-b6ff-65bae33a920e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:22.485802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcd053-51b7-4486-b6ff-65bae33a920e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:22.487267 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcd053-51b7-4486-b6ff-65bae33a920e service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:22.496854 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1410/2823] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:57:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:57:22.903631 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ff982-f13f-44c0-a98e-3946115222d4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:22.905094 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-900ff982-f13f-44c0-a98e-3946115222d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:22.917013 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ff982-f13f-44c0-a98e-3946115222d4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:22.922263 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cd859-a8a3-401f-a690-07b6eb1fc4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:22.923234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cd859-a8a3-401f-a690-07b6eb1fc4b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:22.923520 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cd859-a8a3-401f-a690-07b6eb1fc4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:22.923792 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cd859-a8a3-401f-a690-07b6eb1fc4b0 admin admin] PATH_INFO: `/v3/projects/0e8d2285c2b24676be73c99ef03ab9fd` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:22.925082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052cd859-a8a3-401f-a690-07b6eb1fc4b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8d2285c2b24676be73c99ef03ab9fd)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:22.927133 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052cd859-a8a3-401f-a690-07b6eb1fc4b0 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:23.069390 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-052cd859-a8a3-401f-a690-07b6eb1fc4b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8d2285c2b24676be73c99ef03ab9fd', 'request_id': 'req-052cd859-a8a3-401f-a690-07b6eb1fc4b0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:23.145341 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcd053-51b7-4486-b6ff-65bae33a920e service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:23.153226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-052cd859-a8a3-401f-a690-07b6eb1fc4b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8d2285c2b24676be73c99ef03ab9fd', 'request_id': 'req-052cd859-a8a3-401f-a690-07b6eb1fc4b0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:23.154273 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcd053-51b7-4486-b6ff-65bae33a920e service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:23.160495 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-052cd859-a8a3-401f-a690-07b6eb1fc4b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8d2285c2b24676be73c99ef03ab9fd', 'request_id': 'req-052cd859-a8a3-401f-a690-07b6eb1fc4b0'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:23.171903 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-052cd859-a8a3-401f-a690-07b6eb1fc4b0 admin admin] The token cache is being invalidate because project 0e8d2285c2b24676be73c99ef03ab9fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:57:23.172191 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-052cd859-a8a3-401f-a690-07b6eb1fc4b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:23.172827 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-052cd859-a8a3-401f-a690-07b6eb1fc4b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:23.174831 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1414/2824] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:57:22 2022] DELETE /identity/v3/projects/0e8d2285c2b24676be73c99ef03ab9fd => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:23.180194 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddcf80-24c5-4044-9317-44c41443df2b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:23.180711 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddcf80-24c5-4044-9317-44c41443df2b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:23.181166 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cddcf80-24c5-4044-9317-44c41443df2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:23.200292 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6cddcf80-24c5-4044-9317-44c41443df2b None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:23.202560 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6cddcf80-24c5-4044-9317-44c41443df2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:23.210733 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90a36e-0e8a-4e1e-94fb-68ddb156c157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:23.211454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90a36e-0e8a-4e1e-94fb-68ddb156c157 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:23.211735 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90a36e-0e8a-4e1e-94fb-68ddb156c157 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:23.212015 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90a36e-0e8a-4e1e-94fb-68ddb156c157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:23.213941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-2a90a36e-0e8a-4e1e-94fb-68ddb156c157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:23.227234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:23.270431 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1415/2825] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:23.278385 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d5a58-17b5-46ec-ae39-41fc35085840 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:23.278678 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d5a58-17b5-46ec-ae39-41fc35085840 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:23.278959 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d5a58-17b5-46ec-ae39-41fc35085840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:23.295697 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90a36e-0e8a-4e1e-94fb-68ddb156c157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:23.297494 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90a36e-0e8a-4e1e-94fb-68ddb156c157 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:23.297655 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d56d5a58-17b5-46ec-ae39-41fc35085840 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:23.298786 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d56d5a58-17b5-46ec-ae39-41fc35085840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:23.305802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:23.307802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1416/2826] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:57:23.311835 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d5a58-17b5-46ec-ae39-41fc35085840 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:23.314179 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1411/2827] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:57:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:57:23.321921 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d5a58-17b5-46ec-ae39-41fc35085840 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:23.326900 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe95fd4-6eb4-4909-846e-3fb9540475c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:23.327581 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe95fd4-6eb4-4909-846e-3fb9540475c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:23.327866 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe95fd4-6eb4-4909-846e-3fb9540475c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:23.328144 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe95fd4-6eb4-4909-846e-3fb9540475c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:23.329030 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe95fd4-6eb4-4909-846e-3fb9540475c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80614) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:57:23.329345 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe95fd4-6eb4-4909-846e-3fb9540475c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:23.331005 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe95fd4-6eb4-4909-846e-3fb9540475c2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:23.346983 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1417/2828] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:57:23.351043 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90a36e-0e8a-4e1e-94fb-68ddb156c157 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:23.360547 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90a36e-0e8a-4e1e-94fb-68ddb156c157 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:23.364975 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aced4e3-00de-4396-ac26-92589733fdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:23.366363 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced4e3-00de-4396-ac26-92589733fdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:23.366724 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced4e3-00de-4396-ac26-92589733fdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:23.367070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aced4e3-00de-4396-ac26-92589733fdc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:23.367851 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aced4e3-00de-4396-ac26-92589733fdc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:23.370095 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aced4e3-00de-4396-ac26-92589733fdc0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:23.460759 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1412/2829] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:57:23 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:57:23.462281 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe95fd4-6eb4-4909-846e-3fb9540475c2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:23.472650 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe95fd4-6eb4-4909-846e-3fb9540475c2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:23.532636 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d5c1d-11e8-4a9c-98a9-04761bfb2eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:23.533523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d5c1d-11e8-4a9c-98a9-04761bfb2eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:23.533839 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d5c1d-11e8-4a9c-98a9-04761bfb2eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:23.534196 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d5c1d-11e8-4a9c-98a9-04761bfb2eb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:23.534957 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d5c1d-11e8-4a9c-98a9-04761bfb2eb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:23.536868 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d5c1d-11e8-4a9c-98a9-04761bfb2eb2 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:23.643273 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1418/2830] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:57:23 2022] POST /identity/v3/users => generated 291 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:57:23.644669 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aced4e3-00de-4396-ac26-92589733fdc0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:23.655677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aced4e3-00de-4396-ac26-92589733fdc0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:23.660263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fa3f7-9ad0-4643-8382-6c38a19474c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:23.661012 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fa3f7-9ad0-4643-8382-6c38a19474c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:23.661310 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fa3f7-9ad0-4643-8382-6c38a19474c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:23.661568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fa3f7-9ad0-4643-8382-6c38a19474c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:23.662900 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fa3f7-9ad0-4643-8382-6c38a19474c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:23.664479 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fa3f7-9ad0-4643-8382-6c38a19474c7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:23.675885 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1413/2831] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:57:23.682028 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d5c1d-11e8-4a9c-98a9-04761bfb2eb2 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:23.690468 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d5c1d-11e8-4a9c-98a9-04761bfb2eb2 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:23.695406 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5508c-4de3-4404-8369-510c8d01f71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:23.700973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5508c-4de3-4404-8369-510c8d01f71e admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:23.700973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5508c-4de3-4404-8369-510c8d01f71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:23.700973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5508c-4de3-4404-8369-510c8d01f71e admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:23.700973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5508c-4de3-4404-8369-510c8d01f71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:23.700973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5508c-4de3-4404-8369-510c8d01f71e admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:23.715962 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1419/2832] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:57:23.720133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fa3f7-9ad0-4643-8382-6c38a19474c7 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:23.733093 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fa3f7-9ad0-4643-8382-6c38a19474c7 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:23.747863 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb81486-c0d1-47be-b347-f0aa073e02bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:23.748581 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81486-c0d1-47be-b347-f0aa073e02bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:23.749085 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81486-c0d1-47be-b347-f0aa073e02bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:23.749439 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb81486-c0d1-47be-b347-f0aa073e02bb admin admin] PATH_INFO: `/v3/projects/e8829be838de4223ae1d645a46a96200/users/6520b3b65f714d00a9820c40d4ffa13d/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:23.773423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb81486-c0d1-47be-b347-f0aa073e02bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8829be838de4223ae1d645a46a96200, user_id=6520b3b65f714d00a9820c40d4ffa13d, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:23.773423 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb81486-c0d1-47be-b347-f0aa073e02bb admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:23.833886 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1414/2833] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:57:23 2022] PUT /identity/v3/projects/e8829be838de4223ae1d645a46a96200/users/6520b3b65f714d00a9820c40d4ffa13d/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:23.839823 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4fec0-02f4-4d8a-acd8-5ca0df50ae63 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:23.840119 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4fec0-02f4-4d8a-acd8-5ca0df50ae63 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:23.840403 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a4fec0-02f4-4d8a-acd8-5ca0df50ae63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:23.861906 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-10a4fec0-02f4-4d8a-acd8-5ca0df50ae63 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:23.863262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-10a4fec0-02f4-4d8a-acd8-5ca0df50ae63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:23.925997 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1420/2834] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:57:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:23.935913 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb81486-c0d1-47be-b347-f0aa073e02bb admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:23.937715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-feb81486-c0d1-47be-b347-f0aa073e02bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:23.996500 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb81486-c0d1-47be-b347-f0aa073e02bb admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:24.000124 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b4005-c636-400b-b315-faf91d74feae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:24.000773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b4005-c636-400b-b315-faf91d74feae service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:24.001054 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b4005-c636-400b-b315-faf91d74feae service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:24.001332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b4005-c636-400b-b315-faf91d74feae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:24.011247 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b4005-c636-400b-b315-faf91d74feae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:24.012674 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b4005-c636-400b-b315-faf91d74feae service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:24.022880 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1415/2835] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:57:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:57:25.401111 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92b8d-f2a7-4fe4-98d1-f18813efd87a None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:25.401680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92b8d-f2a7-4fe4-98d1-f18813efd87a None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:25.401680 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92b8d-f2a7-4fe4-98d1-f18813efd87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:25.429991 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-49c92b8d-f2a7-4fe4-98d1-f18813efd87a None None] MFA Rules not processed for user `6520b3b65f714d00a9820c40d4ffa13d`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:25.431308 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-49c92b8d-f2a7-4fe4-98d1-f18813efd87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:25.444792 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:25.499291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1421/2836] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:57:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:25.511354 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b4005-c636-400b-b315-faf91d74feae service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:25.512760 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c28b4005-c636-400b-b315-faf91d74feae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:25.570375 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b4005-c636-400b-b315-faf91d74feae service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:25.574255 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944103b-6db2-4205-a616-49442b780592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12ab5b94b21b466e8070771a61378e89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:25.574917 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944103b-6db2-4205-a616-49442b780592 service cinder] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:25.575203 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944103b-6db2-4205-a616-49442b780592 service cinder] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:25.575482 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944103b-6db2-4205-a616-49442b780592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:25.584978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944103b-6db2-4205-a616-49442b780592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:25.586642 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944103b-6db2-4205-a616-49442b780592 service cinder] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:25.598971 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1416/2837] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:57:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:57:25.980151 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c92b8d-f2a7-4fe4-98d1-f18813efd87a None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:25.990225 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c92b8d-f2a7-4fe4-98d1-f18813efd87a None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:25.994289 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed2a53-96c1-4801-972f-61f4f5ea09d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:25.994929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed2a53-96c1-4801-972f-61f4f5ea09d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:25.995211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed2a53-96c1-4801-972f-61f4f5ea09d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:25.995483 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed2a53-96c1-4801-972f-61f4f5ea09d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:25.997291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-54ed2a53-96c1-4801-972f-61f4f5ea09d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:26.009973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed2a53-96c1-4801-972f-61f4f5ea09d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:26.023753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed2a53-96c1-4801-972f-61f4f5ea09d4 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:26.023753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1422/2838] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:57:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:57:27.270006 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8722dc-d7fa-4e16-8561-e656eb0dd1b9 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:27.270540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8722dc-d7fa-4e16-8561-e656eb0dd1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:27.270540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8722dc-d7fa-4e16-8561-e656eb0dd1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:27.288594 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-dc8722dc-d7fa-4e16-8561-e656eb0dd1b9 None None] MFA Rules not processed for user `6520b3b65f714d00a9820c40d4ffa13d`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:27.289868 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dc8722dc-d7fa-4e16-8561-e656eb0dd1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:27.296928 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1417/2839] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:57:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:33.984659 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed2a53-96c1-4801-972f-61f4f5ea09d4 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:33.986900 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-54ed2a53-96c1-4801-972f-61f4f5ea09d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:34.007455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed2a53-96c1-4801-972f-61f4f5ea09d4 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:34.014787 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203b805-ce2c-4336-bbb9-5dfe4415cc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:34.015747 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203b805-ce2c-4336-bbb9-5dfe4415cc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:34.016099 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203b805-ce2c-4336-bbb9-5dfe4415cc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:34.016463 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203b805-ce2c-4336-bbb9-5dfe4415cc89 admin admin] PATH_INFO: `/v3/users/5e35a47b246b4350be6a0d7804a3e7d4` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:34.017933 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203b805-ce2c-4336-bbb9-5dfe4415cc89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e35a47b246b4350be6a0d7804a3e7d4)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:34.019986 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203b805-ce2c-4336-bbb9-5dfe4415cc89 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:34.212211 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2203b805-ce2c-4336-bbb9-5dfe4415cc89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e35a47b246b4350be6a0d7804a3e7d4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:34.266897 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2203b805-ce2c-4336-bbb9-5dfe4415cc89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e35a47b246b4350be6a0d7804a3e7d4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:34.267537 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2203b805-ce2c-4336-bbb9-5dfe4415cc89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e35a47b246b4350be6a0d7804a3e7d4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:34.276012 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2203b805-ce2c-4336-bbb9-5dfe4415cc89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e35a47b246b4350be6a0d7804a3e7d4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:34.276690 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-2203b805-ce2c-4336-bbb9-5dfe4415cc89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e35a47b246b4350be6a0d7804a3e7d4'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:34.296356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1423/2840] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:57:33 2022] DELETE /identity/v3/users/5e35a47b246b4350be6a0d7804a3e7d4 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:34.571603 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8722dc-d7fa-4e16-8561-e656eb0dd1b9 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:34.583164 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8722dc-d7fa-4e16-8561-e656eb0dd1b9 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:34.634636 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:34.650938 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:34.651802 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:34.652082 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:34.652352 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] PATH_INFO: `/v3/projects/58ae50012f124c4590490792b97fe88e` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:34.653529 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58ae50012f124c4590490792b97fe88e)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:34.655569 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:34.777460 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58ae50012f124c4590490792b97fe88e', 'request_id': 'req-8d25bb03-0484-45a3-964a-c8d699608407'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:34.844419 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58ae50012f124c4590490792b97fe88e', 'request_id': 'req-8d25bb03-0484-45a3-964a-c8d699608407'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:34.851306 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58ae50012f124c4590490792b97fe88e', 'request_id': 'req-8d25bb03-0484-45a3-964a-c8d699608407'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:34.865126 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] The token cache is being invalidate because project 58ae50012f124c4590490792b97fe88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:57:34.865426 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:34.866129 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:34.867926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1418/2841] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:57:34 2022] DELETE /identity/v3/projects/58ae50012f124c4590490792b97fe88e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:34.871708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203b805-ce2c-4336-bbb9-5dfe4415cc89 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:34.873240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2203b805-ce2c-4336-bbb9-5dfe4415cc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:34.889980 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203b805-ce2c-4336-bbb9-5dfe4415cc89 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:34.948338 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ed7c2-1cf4-4afb-afef-9babdc8b5425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:34.949213 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed7c2-1cf4-4afb-afef-9babdc8b5425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:34.949497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed7c2-1cf4-4afb-afef-9babdc8b5425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:34.949807 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ed7c2-1cf4-4afb-afef-9babdc8b5425 admin admin] PATH_INFO: `/v3/users/4be2a06b4ded4c8d8598478d240161a2` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:34.951105 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ed7c2-1cf4-4afb-afef-9babdc8b5425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be2a06b4ded4c8d8598478d240161a2)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:34.953018 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ed7c2-1cf4-4afb-afef-9babdc8b5425 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:34.970210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:35.111973 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe5ed7c2-1cf4-4afb-afef-9babdc8b5425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be2a06b4ded4c8d8598478d240161a2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:35.192937 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe5ed7c2-1cf4-4afb-afef-9babdc8b5425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be2a06b4ded4c8d8598478d240161a2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:35.194224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe5ed7c2-1cf4-4afb-afef-9babdc8b5425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be2a06b4ded4c8d8598478d240161a2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:35.202040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe5ed7c2-1cf4-4afb-afef-9babdc8b5425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be2a06b4ded4c8d8598478d240161a2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:35.202708 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-fe5ed7c2-1cf4-4afb-afef-9babdc8b5425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be2a06b4ded4c8d8598478d240161a2'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:35.222041 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1424/2842] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:57:34 2022] DELETE /identity/v3/users/4be2a06b4ded4c8d8598478d240161a2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:35.445444 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:35.447599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:35.461070 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25bb03-0484-45a3-964a-c8d699608407 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:35.519478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297df20d-0e88-4627-8e14-fc3c0c168782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:35.520347 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297df20d-0e88-4627-8e14-fc3c0c168782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:35.520634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297df20d-0e88-4627-8e14-fc3c0c168782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:35.520920 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297df20d-0e88-4627-8e14-fc3c0c168782 admin admin] PATH_INFO: `/v3/projects/1d9ac36012bc40e49d8b4016059dbadd` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:35.522363 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297df20d-0e88-4627-8e14-fc3c0c168782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d9ac36012bc40e49d8b4016059dbadd)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:35.524406 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297df20d-0e88-4627-8e14-fc3c0c168782 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:35.639163 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-297df20d-0e88-4627-8e14-fc3c0c168782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d9ac36012bc40e49d8b4016059dbadd', 'request_id': 'req-297df20d-0e88-4627-8e14-fc3c0c168782'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:35.695371 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-297df20d-0e88-4627-8e14-fc3c0c168782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d9ac36012bc40e49d8b4016059dbadd', 'request_id': 'req-297df20d-0e88-4627-8e14-fc3c0c168782'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:35.701238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-297df20d-0e88-4627-8e14-fc3c0c168782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d9ac36012bc40e49d8b4016059dbadd', 'request_id': 'req-297df20d-0e88-4627-8e14-fc3c0c168782'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:35.712291 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-297df20d-0e88-4627-8e14-fc3c0c168782 admin admin] The token cache is being invalidate because project 1d9ac36012bc40e49d8b4016059dbadd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80615) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:57:35.712580 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-297df20d-0e88-4627-8e14-fc3c0c168782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:35.713224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-297df20d-0e88-4627-8e14-fc3c0c168782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:57:35.715061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1419/2843] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:57:35 2022] DELETE /identity/v3/projects/1d9ac36012bc40e49d8b4016059dbadd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:57:39.982474 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ed7c2-1cf4-4afb-afef-9babdc8b5425 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:39.984038 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fe5ed7c2-1cf4-4afb-afef-9babdc8b5425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:40.041465 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ed7c2-1cf4-4afb-afef-9babdc8b5425 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:57:40.089950 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d820c0f-dda6-4c49-878c-c97ffd40fdda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:57:40.090598 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d820c0f-dda6-4c49-878c-c97ffd40fdda service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:40.090876 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d820c0f-dda6-4c49-878c-c97ffd40fdda service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:40.091148 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d820c0f-dda6-4c49-878c-c97ffd40fdda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:40.092919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4d820c0f-dda6-4c49-878c-c97ffd40fdda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:40.103001 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d820c0f-dda6-4c49-878c-c97ffd40fdda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:57:40.104410 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d820c0f-dda6-4c49-878c-c97ffd40fdda service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:57:40.112205 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1425/2844] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:57:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:57:45.709255 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:50.108742 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:DELETE=9,keystone:SELECT=66,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:57:59.850702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67267397-a09f-4b39-99bb-402a69050113 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:57:59.851308 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67267397-a09f-4b39-99bb-402a69050113 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:57:59.851433 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67267397-a09f-4b39-99bb-402a69050113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:57:59.871637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-67267397-a09f-4b39-99bb-402a69050113 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:57:59.872881 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-67267397-a09f-4b39-99bb-402a69050113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:57:59.932330 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1420/2845] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 20 22:57:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:57:59.955619 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d820c0f-dda6-4c49-878c-c97ffd40fdda service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:57:59.957757 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4d820c0f-dda6-4c49-878c-c97ffd40fdda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:00.032348 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d820c0f-dda6-4c49-878c-c97ffd40fdda service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:00.038532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9293e-32c1-4af3-a258-351766e8de14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:00.039237 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9293e-32c1-4af3-a258-351766e8de14 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:00.039523 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9293e-32c1-4af3-a258-351766e8de14 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:00.039798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9293e-32c1-4af3-a258-351766e8de14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:00.048022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9293e-32c1-4af3-a258-351766e8de14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:00.049631 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9293e-32c1-4af3-a258-351766e8de14 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:00.059813 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1426/2846] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:58:03.964238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b99ee-ccc0-4a63-bfaf-a406945d01ad None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:03.964725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b99ee-ccc0-4a63-bfaf-a406945d01ad None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:03.964725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129b99ee-ccc0-4a63-bfaf-a406945d01ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:03.982888 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-129b99ee-ccc0-4a63-bfaf-a406945d01ad None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:58:03.984111 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-129b99ee-ccc0-4a63-bfaf-a406945d01ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:03.992664 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1421/2847] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 20 22:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:58:04.014665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9293e-32c1-4af3-a258-351766e8de14 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:58:04.016107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-06e9293e-32c1-4af3-a258-351766e8de14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:04.032082 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9293e-32c1-4af3-a258-351766e8de14 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:04.038415 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f07a63-6e31-4340-a3f7-29e607040957 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:04.039059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f07a63-6e31-4340-a3f7-29e607040957 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:04.039343 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f07a63-6e31-4340-a3f7-29e607040957 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:04.039624 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f07a63-6e31-4340-a3f7-29e607040957 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:04.047804 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f07a63-6e31-4340-a3f7-29e607040957 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:04.049371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f07a63-6e31-4340-a3f7-29e607040957 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:04.059059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1427/2848] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:58:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:58:07.313951 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecc42d-4fed-42b3-9c2f-e3676147d7a5 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:07.314528 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecc42d-4fed-42b3-9c2f-e3676147d7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:07.314528 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ecc42d-4fed-42b3-9c2f-e3676147d7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:07.333446 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-b7ecc42d-4fed-42b3-9c2f-e3676147d7a5 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:58:07.339608 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-b7ecc42d-4fed-42b3-9c2f-e3676147d7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:07.342605 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1422/2849] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 20 22:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:58:07.363904 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f07a63-6e31-4340-a3f7-29e607040957 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:58:07.375056 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f07a63-6e31-4340-a3f7-29e607040957 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:07.381059 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a409227-f8f6-4c56-af62-77312456b24f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:07.381702 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a409227-f8f6-4c56-af62-77312456b24f service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:07.382022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a409227-f8f6-4c56-af62-77312456b24f service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:07.382301 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a409227-f8f6-4c56-af62-77312456b24f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:07.390738 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a409227-f8f6-4c56-af62-77312456b24f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:07.392379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a409227-f8f6-4c56-af62-77312456b24f service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:07.402480 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1428/2850] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:58:10.259370 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157257b7-c69e-4cc8-98c2-23206911bda4 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:10.260224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157257b7-c69e-4cc8-98c2-23206911bda4 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:10.260224 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157257b7-c69e-4cc8-98c2-23206911bda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:10.278198 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-157257b7-c69e-4cc8-98c2-23206911bda4 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:58:10.279379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-157257b7-c69e-4cc8-98c2-23206911bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:10.287384 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1423/2851] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 20 22:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:58:10.309675 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a409227-f8f6-4c56-af62-77312456b24f service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:58:10.321661 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a409227-f8f6-4c56-af62-77312456b24f service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:10.327120 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05d64-593e-47f0-bbdf-9e754600bd11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:10.327783 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05d64-593e-47f0-bbdf-9e754600bd11 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:10.328064 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05d64-593e-47f0-bbdf-9e754600bd11 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:10.328339 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05d64-593e-47f0-bbdf-9e754600bd11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:10.337347 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f05d64-593e-47f0-bbdf-9e754600bd11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:10.338960 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f05d64-593e-47f0-bbdf-9e754600bd11 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:10.348368 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1429/2852] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:58:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:58:13.449764 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af41952-e6db-45bf-822e-1822c7496db6 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:13.450298 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af41952-e6db-45bf-822e-1822c7496db6 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:13.450512 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af41952-e6db-45bf-822e-1822c7496db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:13.467696 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-0af41952-e6db-45bf-822e-1822c7496db6 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:58:13.468883 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-0af41952-e6db-45bf-822e-1822c7496db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:13.476839 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1424/2853] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 20 22:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:58:13.512877 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05d64-593e-47f0-bbdf-9e754600bd11 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:58:13.524128 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05d64-593e-47f0-bbdf-9e754600bd11 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:13.529622 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f4dd2-db0c-4ae2-b8a7-d3111936c92d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:13.530295 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f4dd2-db0c-4ae2-b8a7-d3111936c92d service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:13.530580 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f4dd2-db0c-4ae2-b8a7-d3111936c92d service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:13.530855 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f4dd2-db0c-4ae2-b8a7-d3111936c92d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:13.539307 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f4dd2-db0c-4ae2-b8a7-d3111936c92d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:13.540865 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f4dd2-db0c-4ae2-b8a7-d3111936c92d service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:13.550279 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1430/2854] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:58:16.705869 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eed1c-dcce-4c52-b96a-0774951afc81 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:16.706360 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eed1c-dcce-4c52-b96a-0774951afc81 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:16.706462 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eed1c-dcce-4c52-b96a-0774951afc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:16.724175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-739eed1c-dcce-4c52-b96a-0774951afc81 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:58:16.726382 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-739eed1c-dcce-4c52-b96a-0774951afc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:16.734151 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1425/2855] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 20 22:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:58:16.760370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f4dd2-db0c-4ae2-b8a7-d3111936c92d service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:58:16.771628 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f4dd2-db0c-4ae2-b8a7-d3111936c92d service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:16.777367 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed51044-dc5f-409c-a506-0aac2e1f5986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:16.778040 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51044-dc5f-409c-a506-0aac2e1f5986 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:16.778324 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51044-dc5f-409c-a506-0aac2e1f5986 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:16.778600 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed51044-dc5f-409c-a506-0aac2e1f5986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:16.786952 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed51044-dc5f-409c-a506-0aac2e1f5986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:16.789074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed51044-dc5f-409c-a506-0aac2e1f5986 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:16.799397 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1431/2856] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:58:26.581484 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eed1c-dcce-4c52-b96a-0774951afc81 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:58:26.588474 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=43 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:26.594922 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eed1c-dcce-4c52-b96a-0774951afc81 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:26.600870 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd85375-cb04-4566-9c1c-1d36a1c11ff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:26.604324 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd85375-cb04-4566-9c1c-1d36a1c11ff3 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:26.604324 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd85375-cb04-4566-9c1c-1d36a1c11ff3 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:26.604324 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd85375-cb04-4566-9c1c-1d36a1c11ff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:26.604324 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dbd85375-cb04-4566-9c1c-1d36a1c11ff3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:26.616317 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd85375-cb04-4566-9c1c-1d36a1c11ff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:26.617851 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd85375-cb04-4566-9c1c-1d36a1c11ff3 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:26.628540 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1426/2857] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:58:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:58:26.794584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=64 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:31.662660 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dedcb4-da70-419c-9ba0-3058b0bd6e0b None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:31.663256 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dedcb4-da70-419c-9ba0-3058b0bd6e0b None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:31.663256 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dedcb4-da70-419c-9ba0-3058b0bd6e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:31.681891 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-d9dedcb4-da70-419c-9ba0-3058b0bd6e0b None None] MFA Rules not processed for user `6520b3b65f714d00a9820c40d4ffa13d`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:58:31.683081 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d9dedcb4-da70-419c-9ba0-3058b0bd6e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:31.736672 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1432/2858] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:58:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:58:31.971620 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd85375-cb04-4566-9c1c-1d36a1c11ff3 service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:58:31.973125 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dbd85375-cb04-4566-9c1c-1d36a1c11ff3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:31.985931 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd85375-cb04-4566-9c1c-1d36a1c11ff3 service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:31.989558 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3ca20-1eb2-4622-9fcb-0f5fe9bc5103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:31.990239 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3ca20-1eb2-4622-9fcb-0f5fe9bc5103 service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:31.990524 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3ca20-1eb2-4622-9fcb-0f5fe9bc5103 service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:31.990801 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3ca20-1eb2-4622-9fcb-0f5fe9bc5103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:31.992538 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-e2f3ca20-1eb2-4622-9fcb-0f5fe9bc5103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:32.001927 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3ca20-1eb2-4622-9fcb-0f5fe9bc5103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:32.003344 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3ca20-1eb2-4622-9fcb-0f5fe9bc5103 service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:32.011819 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1427/2859] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:58:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:58:32.440956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dedcb4-da70-419c-9ba0-3058b0bd6e0b None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:58:32.445101 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d9dedcb4-da70-419c-9ba0-3058b0bd6e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:32.515182 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dedcb4-da70-419c-9ba0-3058b0bd6e0b None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:32.520310 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbc4d4-45dc-4b0e-a7d4-0ee139112061 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c9898ccf874dce88f08bebdbae02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:32.520960 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbc4d4-45dc-4b0e-a7d4-0ee139112061 service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:32.521243 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbc4d4-45dc-4b0e-a7d4-0ee139112061 service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:32.521546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbc4d4-45dc-4b0e-a7d4-0ee139112061 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:32.523443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-fdbbc4d4-45dc-4b0e-a7d4-0ee139112061 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:32.534841 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbc4d4-45dc-4b0e-a7d4-0ee139112061 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:32.536443 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbc4d4-45dc-4b0e-a7d4-0ee139112061 service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:32.546299 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1433/2860] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:58:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:58:39.992394 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3ca20-1eb2-4622-9fcb-0f5fe9bc5103 service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:58:40.006415 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3ca20-1eb2-4622-9fcb-0f5fe9bc5103 service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:40.012710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f5765-ce4a-4629-91f3-05318486b39d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:40.013958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f5765-ce4a-4629-91f3-05318486b39d service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:40.013958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f5765-ce4a-4629-91f3-05318486b39d service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:40.013958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f5765-ce4a-4629-91f3-05318486b39d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:40.015762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-176f5765-ce4a-4629-91f3-05318486b39d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:40.028702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f5765-ce4a-4629-91f3-05318486b39d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:40.030252 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f5765-ce4a-4629-91f3-05318486b39d service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:40.040774 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1428/2861] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:58:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:58:42.542097 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=57 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:45.477318 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788474f8-deaa-418d-b8b1-bbb1c35df755 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:45.478022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788474f8-deaa-418d-b8b1-bbb1c35df755 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:45.478022 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788474f8-deaa-418d-b8b1-bbb1c35df755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:45.496025 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-788474f8-deaa-418d-b8b1-bbb1c35df755 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:58:45.497853 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-788474f8-deaa-418d-b8b1-bbb1c35df755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:45.505794 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1434/2862] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 20 22:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:58:45.525652 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f5765-ce4a-4629-91f3-05318486b39d service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:58:45.537092 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f5765-ce4a-4629-91f3-05318486b39d service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:45.542680 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1981-e591-451e-b116-06cb07b96c79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:45.543314 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1981-e591-451e-b116-06cb07b96c79 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:45.543599 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1981-e591-451e-b116-06cb07b96c79 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:45.543879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b1981-e591-451e-b116-06cb07b96c79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:45.552172 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b1981-e591-451e-b116-06cb07b96c79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:45.553778 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b1981-e591-451e-b116-06cb07b96c79 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:45.563965 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1429/2863] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:58:48.861044 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e16a1e-0bde-494e-9692-3eaa272a65ea None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:48.861606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e16a1e-0bde-494e-9692-3eaa272a65ea None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:48.861606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e16a1e-0bde-494e-9692-3eaa272a65ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:48.879748 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-b3e16a1e-0bde-494e-9692-3eaa272a65ea None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:58:48.880982 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-b3e16a1e-0bde-494e-9692-3eaa272a65ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:48.889532 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1435/2864] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 20 22:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:58:48.909812 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1981-e591-451e-b116-06cb07b96c79 service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:58:48.920958 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b1981-e591-451e-b116-06cb07b96c79 service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:48.926362 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaf5f0-739a-40f3-9b98-87dc43dd57fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:48.926994 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf5f0-739a-40f3-9b98-87dc43dd57fd service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:48.927274 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf5f0-739a-40f3-9b98-87dc43dd57fd service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:48.927546 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaf5f0-739a-40f3-9b98-87dc43dd57fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:48.935899 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcaf5f0-739a-40f3-9b98-87dc43dd57fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:48.937453 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcaf5f0-739a-40f3-9b98-87dc43dd57fd service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:48.946716 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1430/2865] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:58:51.792268 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386a66b-cdad-4dc4-b1d4-c0cb607e9b29 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:51.792797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386a66b-cdad-4dc4-b1d4-c0cb607e9b29 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:51.792797 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6386a66b-cdad-4dc4-b1d4-c0cb607e9b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:51.811426 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-6386a66b-cdad-4dc4-b1d4-c0cb607e9b29 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:58:51.812626 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-6386a66b-cdad-4dc4-b1d4-c0cb607e9b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:51.820505 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1436/2866] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 20 22:58:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:58:51.842691 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaf5f0-739a-40f3-9b98-87dc43dd57fd service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:58:51.854153 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaf5f0-739a-40f3-9b98-87dc43dd57fd service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:51.860248 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0dcd2-d7d4-4be6-83ec-471d8d9d1ba2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:51.860888 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0dcd2-d7d4-4be6-83ec-471d8d9d1ba2 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:51.861172 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0dcd2-d7d4-4be6-83ec-471d8d9d1ba2 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:51.861482 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac0dcd2-d7d4-4be6-83ec-471d8d9d1ba2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:51.869820 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0dcd2-d7d4-4be6-83ec-471d8d9d1ba2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:51.871396 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac0dcd2-d7d4-4be6-83ec-471d8d9d1ba2 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:51.880789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1431/2867] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:58:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:58:55.039753 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3775-6cf9-4ed8-8e17-d9d287a36567 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:55.040304 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3775-6cf9-4ed8-8e17-d9d287a36567 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:55.040418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bc3775-6cf9-4ed8-8e17-d9d287a36567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:55.058132 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-86bc3775-6cf9-4ed8-8e17-d9d287a36567 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:58:55.059326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-86bc3775-6cf9-4ed8-8e17-d9d287a36567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:55.067210 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1437/2868] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 20 22:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:58:55.089880 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0dcd2-d7d4-4be6-83ec-471d8d9d1ba2 service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:58:55.102175 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac0dcd2-d7d4-4be6-83ec-471d8d9d1ba2 service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:55.108027 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17481ba4-a96c-451f-ba94-03a2d5809c53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:55.111861 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17481ba4-a96c-451f-ba94-03a2d5809c53 service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:55.111861 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17481ba4-a96c-451f-ba94-03a2d5809c53 service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:55.111861 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17481ba4-a96c-451f-ba94-03a2d5809c53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:55.117212 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17481ba4-a96c-451f-ba94-03a2d5809c53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:55.118807 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17481ba4-a96c-451f-ba94-03a2d5809c53 service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:55.128692 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1432/2869] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:58:58.250656 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c92c7-a382-4896-8075-4aafa50249ba None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:58.251173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c92c7-a382-4896-8075-4aafa50249ba None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:58.251173 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c92c7-a382-4896-8075-4aafa50249ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:58.270159 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-4d5c92c7-a382-4896-8075-4aafa50249ba None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:58:58.271359 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-4d5c92c7-a382-4896-8075-4aafa50249ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:58:58.279223 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1438/2870] 10.222.0.15 () {58 vars in 1016 bytes} [Wed Jul 20 22:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:58:58.300078 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17481ba4-a96c-451f-ba94-03a2d5809c53 service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:58:58.306018 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=42 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:58:58.312517 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17481ba4-a96c-451f-ba94-03a2d5809c53 service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:58:58.318148 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a24f61-b23b-4280-9e35-1523f298d0ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:58:58.318773 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24f61-b23b-4280-9e35-1523f298d0ec service nova] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:58:58.319051 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24f61-b23b-4280-9e35-1523f298d0ec service nova] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:58:58.319323 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a24f61-b23b-4280-9e35-1523f298d0ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:58:58.327334 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a24f61-b23b-4280-9e35-1523f298d0ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:58:58.329320 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a24f61-b23b-4280-9e35-1523f298d0ec service nova] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:58:58.339033 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1433/2871] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:59:08.264117 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=15 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:08.335133 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=5 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:30.022016 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c92c7-a382-4896-8075-4aafa50249ba None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:30.033577 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c92c7-a382-4896-8075-4aafa50249ba None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:30.039264 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6122f1e-bf0c-4081-9c14-a3051c8cf80d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c9898ccf874dce88f08bebdbae02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:30.039905 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6122f1e-bf0c-4081-9c14-a3051c8cf80d service placement] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:30.040184 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6122f1e-bf0c-4081-9c14-a3051c8cf80d service placement] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:30.040455 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6122f1e-bf0c-4081-9c14-a3051c8cf80d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:30.042234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-d6122f1e-bf0c-4081-9c14-a3051c8cf80d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:59:30.054771 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6122f1e-bf0c-4081-9c14-a3051c8cf80d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:30.056350 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6122f1e-bf0c-4081-9c14-a3051c8cf80d service placement] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:30.066595 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1439/2872] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:59:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:59:30.129356 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a24f61-b23b-4280-9e35-1523f298d0ec service nova] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:30.131590 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-f4a24f61-b23b-4280-9e35-1523f298d0ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:59:30.145379 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a24f61-b23b-4280-9e35-1523f298d0ec service nova] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:30.150879 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465fc862-ebd3-455e-9ed3-f47ae16aa8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:30.152478 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fc862-ebd3-455e-9ed3-f47ae16aa8c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:30.152762 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fc862-ebd3-455e-9ed3-f47ae16aa8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:30.153207 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465fc862-ebd3-455e-9ed3-f47ae16aa8c9 admin admin] PATH_INFO: `/v3/users/6520b3b65f714d00a9820c40d4ffa13d` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:30.154430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fc862-ebd3-455e-9ed3-f47ae16aa8c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6520b3b65f714d00a9820c40d4ffa13d)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:30.156329 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465fc862-ebd3-455e-9ed3-f47ae16aa8c9 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:30.314302 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-465fc862-ebd3-455e-9ed3-f47ae16aa8c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6520b3b65f714d00a9820c40d4ffa13d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:59:30.314957 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-465fc862-ebd3-455e-9ed3-f47ae16aa8c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6520b3b65f714d00a9820c40d4ffa13d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:59:30.315568 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-465fc862-ebd3-455e-9ed3-f47ae16aa8c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6520b3b65f714d00a9820c40d4ffa13d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:59:30.327290 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-465fc862-ebd3-455e-9ed3-f47ae16aa8c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6520b3b65f714d00a9820c40d4ffa13d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:59:30.334689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-465fc862-ebd3-455e-9ed3-f47ae16aa8c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6520b3b65f714d00a9820c40d4ffa13d'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:59:30.379284 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1434/2873] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 22:59:30 2022] DELETE /identity/v3/users/6520b3b65f714d00a9820c40d4ffa13d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:59:30.668017 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6122f1e-bf0c-4081-9c14-a3051c8cf80d service placement] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:30.680808 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6122f1e-bf0c-4081-9c14-a3051c8cf80d service placement] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:30.738641 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0a0293-26ae-4871-8218-8a1729d332f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:30.739684 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a0293-26ae-4871-8218-8a1729d332f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:30.739979 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a0293-26ae-4871-8218-8a1729d332f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:30.740255 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0a0293-26ae-4871-8218-8a1729d332f5 admin admin] PATH_INFO: `/v3/projects/e8829be838de4223ae1d645a46a96200` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:30.741460 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a0293-26ae-4871-8218-8a1729d332f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8829be838de4223ae1d645a46a96200)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:30.743384 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0a0293-26ae-4871-8218-8a1729d332f5 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:30.854559 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be0a0293-26ae-4871-8218-8a1729d332f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8829be838de4223ae1d645a46a96200', 'request_id': 'req-be0a0293-26ae-4871-8218-8a1729d332f5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:59:30.945219 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be0a0293-26ae-4871-8218-8a1729d332f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8829be838de4223ae1d645a46a96200', 'request_id': 'req-be0a0293-26ae-4871-8218-8a1729d332f5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:59:30.951798 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be0a0293-26ae-4871-8218-8a1729d332f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8829be838de4223ae1d645a46a96200', 'request_id': 'req-be0a0293-26ae-4871-8218-8a1729d332f5'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:59:30.963074 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be0a0293-26ae-4871-8218-8a1729d332f5 admin admin] The token cache is being invalidate because project e8829be838de4223ae1d645a46a96200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:59:30.963369 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be0a0293-26ae-4871-8218-8a1729d332f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:59:30.964015 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-be0a0293-26ae-4871-8218-8a1729d332f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:59:30.965584 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1440/2874] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 22:59:30 2022] DELETE /identity/v3/projects/e8829be838de4223ae1d645a46a96200 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:59:30.970673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60610ad-d629-4d37-bd52-8f1b2551a74e None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:30.971099 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60610ad-d629-4d37-bd52-8f1b2551a74e None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:30.971442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60610ad-d629-4d37-bd52-8f1b2551a74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:30.990570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c60610ad-d629-4d37-bd52-8f1b2551a74e None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:59:30.991768 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c60610ad-d629-4d37-bd52-8f1b2551a74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:59:31.050543 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1435/2875] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:59:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:59:31.059483 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321dd2-ca70-4410-8b68-f828ac0a45d4 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:31.059977 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321dd2-ca70-4410-8b68-f828ac0a45d4 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:31.060094 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321dd2-ca70-4410-8b68-f828ac0a45d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:31.081094 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-13321dd2-ca70-4410-8b68-f828ac0a45d4 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:59:31.082371 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-13321dd2-ca70-4410-8b68-f828ac0a45d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:59:31.090651 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1441/2876] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:59:31.095028 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60610ad-d629-4d37-bd52-8f1b2551a74e None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:31.105644 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60610ad-d629-4d37-bd52-8f1b2551a74e None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:31.110393 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1763b0b-d8a1-45f5-b755-cb4eab4c6e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:31.111058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1763b0b-d8a1-45f5-b755-cb4eab4c6e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:31.111345 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1763b0b-d8a1-45f5-b755-cb4eab4c6e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:31.111621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1763b0b-d8a1-45f5-b755-cb4eab4c6e78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:31.112364 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1763b0b-d8a1-45f5-b755-cb4eab4c6e78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80615) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:59:31.112683 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1763b0b-d8a1-45f5-b755-cb4eab4c6e78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:31.114945 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1763b0b-d8a1-45f5-b755-cb4eab4c6e78 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:31.126548 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1436/2877] 10.222.0.83 () {58 vars in 1152 bytes} [Wed Jul 20 22:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:59:31.130985 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13321dd2-ca70-4410-8b68-f828ac0a45d4 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:31.140467 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13321dd2-ca70-4410-8b68-f828ac0a45d4 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:31.145068 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863079ef-24a3-4370-aa2d-75e6fa40301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:31.145851 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863079ef-24a3-4370-aa2d-75e6fa40301c admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:31.146135 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863079ef-24a3-4370-aa2d-75e6fa40301c admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:31.146407 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863079ef-24a3-4370-aa2d-75e6fa40301c admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:31.147107 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863079ef-24a3-4370-aa2d-75e6fa40301c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:31.148992 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863079ef-24a3-4370-aa2d-75e6fa40301c admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:31.266929 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1442/2878] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:59:31 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:59:31.271073 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1763b0b-d8a1-45f5-b755-cb4eab4c6e78 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:31.281141 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1763b0b-d8a1-45f5-b755-cb4eab4c6e78 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:31.335109 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d026f57-4f88-48da-9155-a279da7e6cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:31.335772 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d026f57-4f88-48da-9155-a279da7e6cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:31.336053 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d026f57-4f88-48da-9155-a279da7e6cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:31.336328 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d026f57-4f88-48da-9155-a279da7e6cc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:31.337020 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d026f57-4f88-48da-9155-a279da7e6cc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:31.338973 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d026f57-4f88-48da-9155-a279da7e6cc5 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:31.345326 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:31.416715 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1437/2879] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:59:31 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:59:31.420817 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863079ef-24a3-4370-aa2d-75e6fa40301c admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:31.431623 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863079ef-24a3-4370-aa2d-75e6fa40301c admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:31.437690 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60349226-90b9-4adc-a182-1b6f56efee77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:31.438388 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60349226-90b9-4adc-a182-1b6f56efee77 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:31.438668 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60349226-90b9-4adc-a182-1b6f56efee77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:31.438945 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60349226-90b9-4adc-a182-1b6f56efee77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:31.439666 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60349226-90b9-4adc-a182-1b6f56efee77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:31.441270 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60349226-90b9-4adc-a182-1b6f56efee77 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:31.452489 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1443/2880] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:59:31.456621 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d026f57-4f88-48da-9155-a279da7e6cc5 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:31.466976 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d026f57-4f88-48da-9155-a279da7e6cc5 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:31.471978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1afb5-4f3f-4cf5-a3f0-95c3eb55de69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:31.472634 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1afb5-4f3f-4cf5-a3f0-95c3eb55de69 admin admin] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:31.472923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1afb5-4f3f-4cf5-a3f0-95c3eb55de69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:31.473201 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1afb5-4f3f-4cf5-a3f0-95c3eb55de69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:31.474791 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1afb5-4f3f-4cf5-a3f0-95c3eb55de69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:31.476392 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1afb5-4f3f-4cf5-a3f0-95c3eb55de69 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:31.486702 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1438/2881] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:59:31.490821 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60349226-90b9-4adc-a182-1b6f56efee77 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:31.500746 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60349226-90b9-4adc-a182-1b6f56efee77 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:31.505432 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ab759-11dc-49ba-939a-3636bf701d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:31.506327 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ab759-11dc-49ba-939a-3636bf701d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:31.506606 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ab759-11dc-49ba-939a-3636bf701d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:31.506906 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0ab759-11dc-49ba-939a-3636bf701d89 admin admin] PATH_INFO: `/v3/projects/cd83801fead74a0bbf5fcf1a862da268/users/37d22efe31c64a7f90a1b0d5b9387469/roles/2749d7dcfd844991883fa3f4e90ed75c` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:31.521802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ab759-11dc-49ba-939a-3636bf701d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd83801fead74a0bbf5fcf1a862da268, user_id=37d22efe31c64a7f90a1b0d5b9387469, role_id=2749d7dcfd844991883fa3f4e90ed75c)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:31.524370 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0ab759-11dc-49ba-939a-3636bf701d89 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:31.620142 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1444/2882] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:59:31 2022] PUT /identity/v3/projects/cd83801fead74a0bbf5fcf1a862da268/users/37d22efe31c64a7f90a1b0d5b9387469/roles/2749d7dcfd844991883fa3f4e90ed75c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:59:31.625192 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4374c-6c61-43d2-9c0b-4a6d73d8fc92 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:31.625514 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4374c-6c61-43d2-9c0b-4a6d73d8fc92 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:31.625898 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa4374c-6c61-43d2-9c0b-4a6d73d8fc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:31.643248 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-dfa4374c-6c61-43d2-9c0b-4a6d73d8fc92 None None] MFA Rules not processed for user `641e54d5e34b4a43ad3182391125ef78`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:59:31.644461 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-dfa4374c-6c61-43d2-9c0b-4a6d73d8fc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:59:31.704766 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1439/2883] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:59:31.715418 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ab759-11dc-49ba-939a-3636bf701d89 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:31.717124 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-5f0ab759-11dc-49ba-939a-3636bf701d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:59:31.732354 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:31.779683 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0ab759-11dc-49ba-939a-3636bf701d89 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:31.783382 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743592a-2f3b-413e-9112-654c6f18b510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:31.784098 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743592a-2f3b-413e-9112-654c6f18b510 service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:31.784383 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743592a-2f3b-413e-9112-654c6f18b510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:31.784664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743592a-2f3b-413e-9112-654c6f18b510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:31.795504 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743592a-2f3b-413e-9112-654c6f18b510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:31.797076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743592a-2f3b-413e-9112-654c6f18b510 service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:31.807232 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1445/2884] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:59:36.802996 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9f27c-99c9-4987-b0c9-cdb0bd48d77d None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:36.803578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9f27c-99c9-4987-b0c9-cdb0bd48d77d None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:36.803578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9f27c-99c9-4987-b0c9-cdb0bd48d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:36.834362 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-ebf9f27c-99c9-4987-b0c9-cdb0bd48d77d None None] MFA Rules not processed for user `37d22efe31c64a7f90a1b0d5b9387469`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:59:36.836062 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-ebf9f27c-99c9-4987-b0c9-cdb0bd48d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:59:36.908255 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1440/2885] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:59:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:59:36.913513 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743592a-2f3b-413e-9112-654c6f18b510 service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:36.923677 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743592a-2f3b-413e-9112-654c6f18b510 service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:36.928977 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d7afe-d79d-442a-b2ab-22d56d52f3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:36.929675 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d7afe-d79d-442a-b2ab-22d56d52f3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:36.930024 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d7afe-d79d-442a-b2ab-22d56d52f3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:36.930297 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d7afe-d79d-442a-b2ab-22d56d52f3e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:36.930993 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d7afe-d79d-442a-b2ab-22d56d52f3e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:36.932956 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d7afe-d79d-442a-b2ab-22d56d52f3e6 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:37.032838 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1446/2886] 10.222.0.83 () {60 vars in 1152 bytes} [Wed Jul 20 22:59:36 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:59:37.037710 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9f27c-99c9-4987-b0c9-cdb0bd48d77d None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:37.048693 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9f27c-99c9-4987-b0c9-cdb0bd48d77d None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:37.118640 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cd4f4-50d1-4cab-9523-36d8417b931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:37.119331 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cd4f4-50d1-4cab-9523-36d8417b931f admin admin] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:37.119617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cd4f4-50d1-4cab-9523-36d8417b931f admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:37.119896 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606cd4f4-50d1-4cab-9523-36d8417b931f admin admin] PATH_INFO: `/v3/users` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:37.120597 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cd4f4-50d1-4cab-9523-36d8417b931f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:37.122570 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606cd4f4-50d1-4cab-9523-36d8417b931f admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:37.208986 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:37.215010 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1441/2887] 10.222.0.83 () {60 vars in 1143 bytes} [Wed Jul 20 22:59:37 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:59:37.218949 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d7afe-d79d-442a-b2ab-22d56d52f3e6 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:37.229646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d7afe-d79d-442a-b2ab-22d56d52f3e6 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:37.234224 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c74559-2d98-424d-924c-f5d1e2abf748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:37.234966 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c74559-2d98-424d-924c-f5d1e2abf748 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:37.235251 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c74559-2d98-424d-924c-f5d1e2abf748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:37.235546 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c74559-2d98-424d-924c-f5d1e2abf748 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:37.236261 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c74559-2d98-424d-924c-f5d1e2abf748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:37.237882 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c74559-2d98-424d-924c-f5d1e2abf748 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:37.249244 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1447/2888] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:59:37.255288 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cd4f4-50d1-4cab-9523-36d8417b931f admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:37.265578 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606cd4f4-50d1-4cab-9523-36d8417b931f admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:37.270186 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85fbed-4637-4fbc-b270-b9e6b56c7ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:37.271263 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85fbed-4637-4fbc-b270-b9e6b56c7ee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:37.271790 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85fbed-4637-4fbc-b270-b9e6b56c7ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:37.272450 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85fbed-4637-4fbc-b270-b9e6b56c7ee7 admin admin] PATH_INFO: `/v3/projects/543d13a4002e46a4b935cb7600d48c5f/users/46070ced52e24803b0b448e83d6d3fc2/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:37.288339 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85fbed-4637-4fbc-b270-b9e6b56c7ee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=543d13a4002e46a4b935cb7600d48c5f, user_id=46070ced52e24803b0b448e83d6d3fc2, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:37.291145 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85fbed-4637-4fbc-b270-b9e6b56c7ee7 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:37.369617 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1442/2889] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:59:37 2022] PUT /identity/v3/projects/543d13a4002e46a4b935cb7600d48c5f/users/46070ced52e24803b0b448e83d6d3fc2/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:59:37.373470 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c74559-2d98-424d-924c-f5d1e2abf748 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:37.384267 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c74559-2d98-424d-924c-f5d1e2abf748 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:37.440829 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca048e-9215-4cdd-b5b7-8e2b27c1e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:37.441497 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca048e-9215-4cdd-b5b7-8e2b27c1e922 admin admin] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:37.441826 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca048e-9215-4cdd-b5b7-8e2b27c1e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:37.442707 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca048e-9215-4cdd-b5b7-8e2b27c1e922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:37.443485 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca048e-9215-4cdd-b5b7-8e2b27c1e922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:37.445076 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca048e-9215-4cdd-b5b7-8e2b27c1e922 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:37.454881 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1448/2890] 10.222.0.83 () {58 vars in 1121 bytes} [Wed Jul 20 22:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:59:37.459062 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85fbed-4637-4fbc-b270-b9e6b56c7ee7 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:37.469058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85fbed-4637-4fbc-b270-b9e6b56c7ee7 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:37.474161 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e248916-b9eb-4a0b-9efd-7faf30654d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:37.475062 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248916-b9eb-4a0b-9efd-7faf30654d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:37.475341 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248916-b9eb-4a0b-9efd-7faf30654d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:37.475615 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e248916-b9eb-4a0b-9efd-7faf30654d10 admin admin] PATH_INFO: `/v3/projects/543d13a4002e46a4b935cb7600d48c5f/users/46070ced52e24803b0b448e83d6d3fc2/roles/498b8a184d2a4bbc97b95c64cefa5595` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:37.477628 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e248916-b9eb-4a0b-9efd-7faf30654d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=543d13a4002e46a4b935cb7600d48c5f, user_id=46070ced52e24803b0b448e83d6d3fc2, role_id=498b8a184d2a4bbc97b95c64cefa5595)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:37.480287 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e248916-b9eb-4a0b-9efd-7faf30654d10 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:37.491714 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1443/2891] 10.222.0.83 () {60 vars in 1482 bytes} [Wed Jul 20 22:59:37 2022] PUT /identity/v3/projects/543d13a4002e46a4b935cb7600d48c5f/users/46070ced52e24803b0b448e83d6d3fc2/roles/498b8a184d2a4bbc97b95c64cefa5595 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:59:42.902726 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33065f04-d602-40e1-8835-75767325ffd5 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:42.903226 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33065f04-d602-40e1-8835-75767325ffd5 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:42.903357 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33065f04-d602-40e1-8835-75767325ffd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:42.933291 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-33065f04-d602-40e1-8835-75767325ffd5 None None] MFA Rules not processed for user `46070ced52e24803b0b448e83d6d3fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:59:42.934567 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-33065f04-d602-40e1-8835-75767325ffd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:59:43.012326 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1449/2892] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:59:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:59:43.025368 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e248916-b9eb-4a0b-9efd-7faf30654d10 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:43.027238 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-5e248916-b9eb-4a0b-9efd-7faf30654d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:59:43.119442 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e248916-b9eb-4a0b-9efd-7faf30654d10 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:43.123096 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721ce6f-1beb-4497-b7d1-7dfaed3a9109 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '669a11ce83b746eeb7f4e7d0acca4b6f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:43.123750 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721ce6f-1beb-4497-b7d1-7dfaed3a9109 service glance] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:43.124033 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721ce6f-1beb-4497-b7d1-7dfaed3a9109 service glance] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:43.124307 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721ce6f-1beb-4497-b7d1-7dfaed3a9109 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:43.186232 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721ce6f-1beb-4497-b7d1-7dfaed3a9109 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:43.187677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721ce6f-1beb-4497-b7d1-7dfaed3a9109 service glance] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:43.197294 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1444/2893] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:59:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:59:43.424964 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084c7c1-48f8-4011-aa10-4eb6eca6f2cb None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:43.425254 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084c7c1-48f8-4011-aa10-4eb6eca6f2cb None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:43.425535 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084c7c1-48f8-4011-aa10-4eb6eca6f2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:43.431234 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:43.486241 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-8084c7c1-48f8-4011-aa10-4eb6eca6f2cb None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:59:43.487461 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8084c7c1-48f8-4011-aa10-4eb6eca6f2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:59:43.554896 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1450/2894] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:59:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:59:43.710180 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721ce6f-1beb-4497-b7d1-7dfaed3a9109 service glance] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:43.711590 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-a721ce6f-1beb-4497-b7d1-7dfaed3a9109 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:59:43.771637 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:43.805111 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721ce6f-1beb-4497-b7d1-7dfaed3a9109 service glance] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:43.810033 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e0db8-e3ac-406e-93d8-64d61ca09c6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:43.810687 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e0db8-e3ac-406e-93d8-64d61ca09c6d service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:43.810970 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e0db8-e3ac-406e-93d8-64d61ca09c6d service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:43.811248 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e0db8-e3ac-406e-93d8-64d61ca09c6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:43.819934 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e0db8-e3ac-406e-93d8-64d61ca09c6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:43.821513 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e0db8-e3ac-406e-93d8-64d61ca09c6d service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:43.829430 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1445/2895] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:59:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:59:53.550607 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=42 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:53.835501 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=16 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:59:54.239309 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e1f8-2c96-41b9-bd17-522cf43adcb6 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:54.239599 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e1f8-2c96-41b9-bd17-522cf43adcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:54.239876 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e1f8-2c96-41b9-bd17-522cf43adcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:54.258539 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-13f3e1f8-2c96-41b9-bd17-522cf43adcb6 None None] MFA Rules not processed for user `37d22efe31c64a7f90a1b0d5b9387469`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:59:54.259740 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-13f3e1f8-2c96-41b9-bd17-522cf43adcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:59:54.267206 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1451/2896] 10.222.0.83 () {58 vars in 957 bytes} [Wed Jul 20 22:59:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:59:54.526673 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e0db8-e3ac-406e-93d8-64d61ca09c6d service swift] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:54.581960 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e0db8-e3ac-406e-93d8-64d61ca09c6d service swift] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:54.585941 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76421eda-6091-4b03-8751-6fb62e07f0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:54.586589 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76421eda-6091-4b03-8751-6fb62e07f0be service neutron] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:54.586877 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76421eda-6091-4b03-8751-6fb62e07f0be service neutron] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:54.587158 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76421eda-6091-4b03-8751-6fb62e07f0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:54.588956 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-76421eda-6091-4b03-8751-6fb62e07f0be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:59:54.598742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76421eda-6091-4b03-8751-6fb62e07f0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:54.600303 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76421eda-6091-4b03-8751-6fb62e07f0be service neutron] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:54.608412 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1446/2897] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 22:59:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:59:57.894266 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049332b-6273-4b33-87d7-02da086ea414 None None] REQUEST_METHOD: `POST` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:57.894802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049332b-6273-4b33-87d7-02da086ea414 None None] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:57.894802 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049332b-6273-4b33-87d7-02da086ea414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:57.913568 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.auth.core [None req-2049332b-6273-4b33-87d7-02da086ea414 None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80614) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:59:57.915379 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2049332b-6273-4b33-87d7-02da086ea414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:59:57.922732 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1452/2898] 10.222.0.83 () {58 vars in 1009 bytes} [Wed Jul 20 22:59:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:59:57.935553 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76421eda-6091-4b03-8751-6fb62e07f0be service neutron] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:59:57.947835 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76421eda-6091-4b03-8751-6fb62e07f0be service neutron] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:59:57.953487 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9cf53-4c5d-4a0b-a8ac-6c3657773a0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:59:57.954176 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9cf53-4c5d-4a0b-a8ac-6c3657773a0e service swift] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:59:57.954463 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9cf53-4c5d-4a0b-a8ac-6c3657773a0e service swift] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:59:57.954742 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9cf53-4c5d-4a0b-a8ac-6c3657773a0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:59:57.963117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9cf53-4c5d-4a0b-a8ac-6c3657773a0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:59:57.964705 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9cf53-4c5d-4a0b-a8ac-6c3657773a0e service swift] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:59:57.972789 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1447/2899] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 22:59:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 23:00:07.907665 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:00:07.969756 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=32 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:00:22.120861 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049332b-6273-4b33-87d7-02da086ea414 None None] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 23:00:22.122847 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-2049332b-6273-4b33-87d7-02da086ea414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 23:00:22.134655 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049332b-6273-4b33-87d7-02da086ea414 None None] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 23:00:22.139278 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80466f27-0882-4137-a4b8-8f6b778b11db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3faac5703c54396bcdba9e149a6d35e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 23:00:22.140003 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80466f27-0882-4137-a4b8-8f6b778b11db service neutron] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 23:00:22.140282 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80466f27-0882-4137-a4b8-8f6b778b11db service neutron] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 23:00:22.140555 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80466f27-0882-4137-a4b8-8f6b778b11db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 23:00:22.150179 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80466f27-0882-4137-a4b8-8f6b778b11db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 23:00:22.151614 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80466f27-0882-4137-a4b8-8f6b778b11db service neutron] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 23:00:22.162216 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1453/2900] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 23:00:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 23:00:32.157693 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=6 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:01:20.861846 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9cf53-4c5d-4a0b-a8ac-6c3657773a0e service swift] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 23:01:20.867878 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-53d9cf53-4c5d-4a0b-a8ac-6c3657773a0e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 23:01:20.933454 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9cf53-4c5d-4a0b-a8ac-6c3657773a0e service swift] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 23:01:20.938530 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a9b0d4-50bb-4f76-99f8-cd08184b516e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c9898ccf874dce88f08bebdbae02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 23:01:20.939183 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9b0d4-50bb-4f76-99f8-cd08184b516e service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 23:01:20.939467 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9b0d4-50bb-4f76-99f8-cd08184b516e service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 23:01:20.939746 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a9b0d4-50bb-4f76-99f8-cd08184b516e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 23:01:20.941499 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-08a9b0d4-50bb-4f76-99f8-cd08184b516e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 23:01:20.953955 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9b0d4-50bb-4f76-99f8-cd08184b516e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 23:01:20.955520 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a9b0d4-50bb-4f76-99f8-cd08184b516e service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 23:01:20.965823 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1448/2901] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 23:01:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 23:01:30.961398 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=32 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:01:42.238240 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80466f27-0882-4137-a4b8-8f6b778b11db service neutron] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 23:01:42.239976 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-80466f27-0882-4137-a4b8-8f6b778b11db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 23:01:42.328640 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80466f27-0882-4137-a4b8-8f6b778b11db service neutron] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 23:01:42.336071 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a490c7c-08be-414b-ac53-39426b241a50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67c92c8d2b9d41e489e4c03ae4e71fe2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 23:01:42.336071 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a490c7c-08be-414b-ac53-39426b241a50 service nova] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 23:01:42.336071 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a490c7c-08be-414b-ac53-39426b241a50 service nova] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 23:01:42.336071 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a490c7c-08be-414b-ac53-39426b241a50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 23:01:42.338305 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-8a490c7c-08be-414b-ac53-39426b241a50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 23:01:42.352263 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a490c7c-08be-414b-ac53-39426b241a50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 23:01:42.355009 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a490c7c-08be-414b-ac53-39426b241a50 service nova] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 23:01:42.366621 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1454/2902] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 23:01:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 23:01:48.964612 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9ff78-6b93-4715-bfcf-fd1fd9e29e28 None None] REQUEST_METHOD: `POST` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 23:01:48.971079 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9ff78-6b93-4715-bfcf-fd1fd9e29e28 None None] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 23:01:48.971079 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9ff78-6b93-4715-bfcf-fd1fd9e29e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 23:01:48.982525 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.auth.core [None req-c2b9ff78-6b93-4715-bfcf-fd1fd9e29e28 None None] MFA Rules not processed for user `ec5aca1c7f334dab8e7ca86573118d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80615) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 23:01:48.983650 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-c2b9ff78-6b93-4715-bfcf-fd1fd9e29e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 23:01:48.990755 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1449/2903] 10.222.0.83 () {58 vars in 967 bytes} [Wed Jul 20 23:01:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 23:01:49.031447 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a490c7c-08be-414b-ac53-39426b241a50 service nova] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 23:01:49.042709 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a490c7c-08be-414b-ac53-39426b241a50 service nova] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 23:01:49.047533 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a33ec4-cfe1-4d35-ad59-1636697616cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '146610a7cbbc46928a4a8d710c4d1942', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 23:01:49.048165 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a33ec4-cfe1-4d35-ad59-1636697616cb service swift] REQUEST_METHOD: `GET` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 23:01:49.048445 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a33ec4-cfe1-4d35-ad59-1636697616cb service swift] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 23:01:49.048717 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a33ec4-cfe1-4d35-ad59-1636697616cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 23:01:49.056615 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a33ec4-cfe1-4d35-ad59-1636697616cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 23:01:49.058919 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a33ec4-cfe1-4d35-ad59-1636697616cb service swift] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 23:01:49.066773 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1455/2904] 10.222.0.83 () {60 vars in 1384 bytes} [Wed Jul 20 23:01:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 23:01:57.116689 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9ff78-6b93-4715-bfcf-fd1fd9e29e28 None None] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 23:01:57.181040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9ff78-6b93-4715-bfcf-fd1fd9e29e28 None None] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 23:01:57.186117 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e992172-ca08-4a58-a843-8dc68c4ea5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 23:01:57.186987 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e992172-ca08-4a58-a843-8dc68c4ea5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 23:01:57.187272 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e992172-ca08-4a58-a843-8dc68c4ea5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 23:01:57.187538 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e992172-ca08-4a58-a843-8dc68c4ea5b2 admin admin] PATH_INFO: `/v3/users/37d22efe31c64a7f90a1b0d5b9387469` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 23:01:57.188725 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e992172-ca08-4a58-a843-8dc68c4ea5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d22efe31c64a7f90a1b0d5b9387469)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 23:01:57.190700 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e992172-ca08-4a58-a843-8dc68c4ea5b2 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 23:01:57.382506 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6e992172-ca08-4a58-a843-8dc68c4ea5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d22efe31c64a7f90a1b0d5b9387469'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:57.383083 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6e992172-ca08-4a58-a843-8dc68c4ea5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d22efe31c64a7f90a1b0d5b9387469'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:57.383717 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6e992172-ca08-4a58-a843-8dc68c4ea5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d22efe31c64a7f90a1b0d5b9387469'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:57.396061 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6e992172-ca08-4a58-a843-8dc68c4ea5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d22efe31c64a7f90a1b0d5b9387469'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:57.403332 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-6e992172-ca08-4a58-a843-8dc68c4ea5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d22efe31c64a7f90a1b0d5b9387469'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:57.470040 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1450/2905] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 23:01:57 2022] DELETE /identity/v3/users/37d22efe31c64a7f90a1b0d5b9387469 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 23:01:57.714737 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a33ec4-cfe1-4d35-ad59-1636697616cb service swift] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 23:01:57.725328 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a33ec4-cfe1-4d35-ad59-1636697616cb service swift] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 23:01:57.787399 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 23:01:57.788262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 23:01:57.788543 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 23:01:57.788821 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] PATH_INFO: `/v3/projects/cd83801fead74a0bbf5fcf1a862da268` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 23:01:57.790035 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd83801fead74a0bbf5fcf1a862da268)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 23:01:57.792233 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 23:01:57.880785 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd83801fead74a0bbf5fcf1a862da268', 'request_id': 'req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:57.929187 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd83801fead74a0bbf5fcf1a862da268', 'request_id': 'req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:57.936086 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd83801fead74a0bbf5fcf1a862da268', 'request_id': 'req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:57.946356 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] The token cache is being invalidate because project cd83801fead74a0bbf5fcf1a862da268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 23:01:57.946646 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:57.947277 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:57.949419 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1456/2906] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 23:01:57 2022] DELETE /identity/v3/projects/cd83801fead74a0bbf5fcf1a862da268 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 23:01:57.953459 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e992172-ca08-4a58-a843-8dc68c4ea5b2 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 23:01:57.954954 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-6e992172-ca08-4a58-a843-8dc68c4ea5b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 23:01:57.969677 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e992172-ca08-4a58-a843-8dc68c4ea5b2 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 23:01:58.023445 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774307fb-e5fd-471a-af6f-cc4801fe71f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 23:01:58.024320 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774307fb-e5fd-471a-af6f-cc4801fe71f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 23:01:58.024606 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774307fb-e5fd-471a-af6f-cc4801fe71f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 23:01:58.024885 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774307fb-e5fd-471a-af6f-cc4801fe71f0 admin admin] PATH_INFO: `/v3/users/46070ced52e24803b0b448e83d6d3fc2` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 23:01:58.026137 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774307fb-e5fd-471a-af6f-cc4801fe71f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46070ced52e24803b0b448e83d6d3fc2)` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 23:01:58.028058 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774307fb-e5fd-471a-af6f-cc4801fe71f0 admin admin] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 23:01:58.040794 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:01:58.263993 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-774307fb-e5fd-471a-af6f-cc4801fe71f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46070ced52e24803b0b448e83d6d3fc2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:58.264647 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-774307fb-e5fd-471a-af6f-cc4801fe71f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46070ced52e24803b0b448e83d6d3fc2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:58.265171 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-774307fb-e5fd-471a-af6f-cc4801fe71f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46070ced52e24803b0b448e83d6d3fc2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:58.277201 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-774307fb-e5fd-471a-af6f-cc4801fe71f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46070ced52e24803b0b448e83d6d3fc2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:58.283853 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.notifications [None req-774307fb-e5fd-471a-af6f-cc4801fe71f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46070ced52e24803b0b448e83d6d3fc2'} {{(pid=80615) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:58.366592 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1451/2907] 10.222.0.83 () {58 vars in 1223 bytes} [Wed Jul 20 23:01:57 2022] DELETE /identity/v3/users/46070ced52e24803b0b448e83d6d3fc2 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 23:01:58.626085 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] Authenticating user token {{(pid=80614) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 23:01:58.630825 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.fernet_utils [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80614) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 23:01:58.635608 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:01:58.641015 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe5ed1-a14e-4d93-9fd6-51ad79d9d469 admin admin] Validating token access rules against request {{(pid=80614) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 23:01:58.699054 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f32c98-ede8-47db-8df7-55948c3e6c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '641e54d5e34b4a43ad3182391125ef78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '63d2e7ee31ba4d05b54d5a20dae7a17b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80614) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 23:01:58.699961 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f32c98-ede8-47db-8df7-55948c3e6c50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 23:01:58.700262 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f32c98-ede8-47db-8df7-55948c3e6c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 23:01:58.700514 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f32c98-ede8-47db-8df7-55948c3e6c50 admin admin] PATH_INFO: `/v3/projects/543d13a4002e46a4b935cb7600d48c5f` {{(pid=80614) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 23:01:58.701686 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f32c98-ede8-47db-8df7-55948c3e6c50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=543d13a4002e46a4b935cb7600d48c5f)` {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 23:01:58.703600 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f32c98-ede8-47db-8df7-55948c3e6c50 admin admin] RBAC: Authorization granted {{(pid=80614) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 23:01:58.817562 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-21f32c98-ede8-47db-8df7-55948c3e6c50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '543d13a4002e46a4b935cb7600d48c5f', 'request_id': 'req-21f32c98-ede8-47db-8df7-55948c3e6c50'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:58.886664 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-21f32c98-ede8-47db-8df7-55948c3e6c50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '543d13a4002e46a4b935cb7600d48c5f', 'request_id': 'req-21f32c98-ede8-47db-8df7-55948c3e6c50'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:58.893417 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-21f32c98-ede8-47db-8df7-55948c3e6c50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '543d13a4002e46a4b935cb7600d48c5f', 'request_id': 'req-21f32c98-ede8-47db-8df7-55948c3e6c50'} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:58.904048 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-21f32c98-ede8-47db-8df7-55948c3e6c50 admin admin] The token cache is being invalidate because project 543d13a4002e46a4b935cb7600d48c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80614) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 23:01:58.904341 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-21f32c98-ede8-47db-8df7-55948c3e6c50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:58.904981 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG keystone.notifications [None req-21f32c98-ede8-47db-8df7-55948c3e6c50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80614) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 23:01:58.906564 dv-cinder-799871-38-smb devstack@keystone.service[80614]: [pid: 80614|app: 0|req: 1457/2908] 10.222.0.83 () {58 vars in 1232 bytes} [Wed Jul 20 23:01:58 2022] DELETE /identity/v3/projects/543d13a4002e46a4b935cb7600d48c5f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 23:02:08.362978 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:02:08.915718 dv-cinder-799871-38-smb devstack@keystone.service[80614]: DEBUG dbcounter [-] [80614] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 23:06:25.831747 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774307fb-e5fd-471a-af6f-cc4801fe71f0 admin admin] Authenticating user token {{(pid=80615) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 23:06:25.833166 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-774307fb-e5fd-471a-af6f-cc4801fe71f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 23:06:25.972278 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774307fb-e5fd-471a-af6f-cc4801fe71f0 admin admin] Validating token access rules against request {{(pid=80615) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 23:06:26.030320 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16e833-9ad2-43a6-bad6-b19007627951 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c9898ccf874dce88f08bebdbae02d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8cec07c864274d649ecd1944be870bd5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80615) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 23:06:26.030974 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16e833-9ad2-43a6-bad6-b19007627951 service placement] REQUEST_METHOD: `GET` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 23:06:26.031262 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16e833-9ad2-43a6-bad6-b19007627951 service placement] SCRIPT_NAME: `/identity` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 23:06:26.031541 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16e833-9ad2-43a6-bad6-b19007627951 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80615) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 23:06:26.033336 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.fernet_utils [None req-8d16e833-9ad2-43a6-bad6-b19007627951 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80615) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 23:06:26.045316 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16e833-9ad2-43a6-bad6-b19007627951 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 23:06:26.046923 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16e833-9ad2-43a6-bad6-b19007627951 service placement] RBAC: Authorization granted {{(pid=80615) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 23:06:26.056926 dv-cinder-799871-38-smb devstack@keystone.service[80615]: [pid: 80615|app: 0|req: 1452/2909] 10.222.0.83 () {60 vars in 1365 bytes} [Wed Jul 20 23:06:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 23:06:36.052473 dv-cinder-799871-38-smb devstack@keystone.service[80615]: DEBUG dbcounter [-] [80615] Writing DB stats keystone:SELECT=89 {{(pid=80615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}